2024-04-21T22:33:35.578 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-21T22:33:35.578 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --name teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/fsstress validater/valgrind} --verbose --archive /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565 -- /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/orig.config.yaml 2024-04-21T22:33:35.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-21T22:33:35.708 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565 branch: squid description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/fsstress validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7667565' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow request - SLOW_OPS - MON_DOWN sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 430e09df97c8fc7dc2b2ae424f68ed11366c540f owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 676 sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b sleep_before_teardown: 0 subset: 46/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 430e09df97c8fc7dc2b2ae424f68ed11366c540f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAYLhHPaMCkV3T08Pozmj+2JCrLSjQ+bFMvY0UiJot7pDHdauDC6mn6ULbS2PBCvxQAXZVeogxkVMcHs4i2ut8s= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxlERhlpHunrYThHrnrhMAhRqrN+rq0V6FKLncqVuRCVCYV5A/0beJwUrRg4PLa4LNmQDJV/4YxFHNHAkA61qU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-21_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-21T22:33:35.708 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa; will attempt to use it 2024-04-21T22:33:35.709 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks 2024-04-21T22:33:35.709 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-21T22:33:35.711 INFO:teuthology.task.internal:Checking packages... 2024-04-21T22:33:35.734 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '820a2f8ced66152ed3d765c31444b8076ea28c6b' 2024-04-21T22:33:35.734 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-21T22:33:35.734 INFO:teuthology.packaging:ref: None 2024-04-21T22:33:35.735 INFO:teuthology.packaging:tag: None 2024-04-21T22:33:35.735 INFO:teuthology.packaging:branch: squid 2024-04-21T22:33:35.735 INFO:teuthology.packaging:sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:33:35.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-21T22:33:35.943 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:33:35.945 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-21T22:33:35.951 INFO:teuthology.task.internal:no buildpackages task found 2024-04-21T22:33:35.951 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-21T22:33:35.998 INFO:teuthology.task.internal:Saving configuration 2024-04-21T22:33:36.015 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-21T22:33:36.065 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T22:33:36.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:27:38.617363', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOzNL3iy1iVassiVMJ44DNBP7lBLLKLqLL7NQxxdI+gZ'} 2024-04-21T22:33:36.112 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:27:38.615858', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII7VFNJCZGyJ0Mpk4v0bC9vifFVrOuGs2ckcssEe//qX'} 2024-04-21T22:33:36.112 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-21T22:33:36.118 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-21T22:33:36.118 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-21T22:33:36.118 INFO:teuthology.run_tasks:Running task console_log... 2024-04-21T22:33:36.204 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f16df250ee0>, signals=[15]) 2024-04-21T22:33:36.205 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-21T22:33:36.212 INFO:teuthology.task.internal:Opening connections... 2024-04-21T22:33:36.212 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-04-21T22:33:36.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:33:36.294 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-04-21T22:33:36.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:33:36.371 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-21T22:33:36.378 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-04-21T22:33:36.383 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-04-21T22:33:36.383 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-04-21T22:33:36.428 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-21T22:33:36.428 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-21T22:33:36.429 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2024-04-21T22:33:36.430 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-04-21T22:33:36.456 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-04-21T22:33:36.461 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-04-21T22:33:36.462 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-21T22:33:36.511 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-21T22:33:36.511 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-04-21T22:33:36.511 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2024-04-21T22:33:36.511 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-21T22:33:36.511 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2024-04-21T22:33:36.512 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-04-21T22:33:36.512 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-04-21T22:33:36.512 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-21T22:33:36.512 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-21T22:33:36.512 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-21T22:33:36.512 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-21T22:33:36.512 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2024-04-21T22:33:36.512 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-21T22:33:36.535 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-21T22:33:36.545 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-21T22:33:36.565 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-21T22:33:36.565 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-04-21T22:33:36.567 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-04-21T22:33:36.572 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-21T22:33:36.590 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-21T22:33:36.590 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-04-21T22:33:36.615 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-04-21T22:33:36.705 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-21T22:33:36.764 INFO:teuthology.run_tasks:Running task kernel... 2024-04-21T22:33:36.779 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-21T22:33:36.779 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-21T22:33:36.779 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T22:33:36.780 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T22:33:36.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:33:36.784 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-04-21T22:33:36.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:33:36.785 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-04-21T22:33:36.831 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2024-04-21T22:33:36.832 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.15.0-56-generic 2024-04-21T22:33:36.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-04-21T22:33:36.833 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2024-04-21T22:33:36.833 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.15.0-56-generic 2024-04-21T22:33:36.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-04-21T22:33:36.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-04-21T22:33:36.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-04-21T22:33:37.128 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-21T22:33:37.243 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T22:33:37.265 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T22:33:37.266 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-21T22:33:37.316 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-21T22:33:37.325 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-21T22:33:37.346 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [450 kB] 2024-04-21T22:33:37.426 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,381 kB] 2024-04-21T22:33:37.469 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [242 kB] 2024-04-21T22:33:37.473 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-21T22:33:37.473 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,744 kB] 2024-04-21T22:33:37.494 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-21T22:33:37.495 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [294 kB] 2024-04-21T22:33:37.497 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T22:33:37.498 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-21T22:33:37.502 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-21T22:33:37.510 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-21T22:33:37.511 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-21T22:33:37.513 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-21T22:33:37.513 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-21T22:33:37.553 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-21T22:33:37.553 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-21T22:33:37.671 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,381 kB] 2024-04-21T22:33:37.678 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-21T22:33:37.680 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-21T22:33:37.817 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-21T22:33:37.818 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-21T22:33:38.016 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-21T22:33:38.017 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-21T22:33:38.094 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [450 kB] 2024-04-21T22:33:38.111 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [242 kB] 2024-04-21T22:33:38.120 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-21T22:33:38.121 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,744 kB] 2024-04-21T22:33:38.165 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-21T22:33:38.167 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-21T22:33:38.180 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-21T22:33:38.181 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-21T22:33:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-21T22:33:38.182 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-21T22:33:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-21T22:33:38.214 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-21T22:33:38.224 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [294 kB] 2024-04-21T22:33:38.230 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T22:33:38.230 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-21T22:33:38.244 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-21T22:33:38.245 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-21T22:33:38.247 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-21T22:33:38.252 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T22:33:38.254 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T22:33:38.255 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-21T22:33:38.417 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-21T22:33:38.419 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-21T22:33:38.432 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-21T22:33:38.838 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-21T22:33:38.844 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-21T22:33:38.858 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-21T22:33:38.858 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-21T22:33:38.861 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-21T22:33:39.047 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-21T22:33:39.050 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-21T22:33:39.085 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-21T22:33:39.088 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-21T22:33:39.098 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-21T22:33:39.099 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-21T22:33:39.100 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-21T22:33:39.101 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-21T22:33:39.102 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-21T22:33:39.102 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-21T22:33:39.102 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-21T22:33:39.103 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-21T22:33:39.103 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-21T22:33:39.104 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-21T22:33:39.105 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-21T22:33:39.105 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-21T22:33:39.129 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-21T22:33:39.132 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-21T22:33:39.133 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-21T22:33:39.135 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-21T22:33:39.297 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-21T22:33:39.298 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-21T22:33:39.380 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-21T22:33:39.381 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-21T22:33:39.466 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-21T22:33:39.490 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-21T22:33:39.544 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-21T22:33:39.545 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-21T22:33:39.581 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-21T22:33:39.582 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-21T22:33:43.772 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 13.1 MB in 3s (5,217 kB/s) 2024-04-21T22:33:43.853 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 13.1 MB in 3s (5,201 kB/s) 2024-04-21T22:33:45.092 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-04-21T22:33:45.109 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T22:33:45.111 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-21T22:33:45.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T22:33:45.161 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-04-21T22:33:45.193 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-21T22:33:45.337 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-04-21T22:33:45.338 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-04-21T22:33:45.398 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-21T22:33:45.399 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-21T22:33:45.493 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:33:45.493 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:33:45.493 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:33:45.494 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:33:45.494 INFO:teuthology.orchestra.run.smithi110.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-21T22:33:45.494 INFO:teuthology.orchestra.run.smithi110.stdout: python2.7-minimal 2024-04-21T22:33:45.494 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:33:45.495 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-04-21T22:33:45.495 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T22:33:45.495 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-21T22:33:45.495 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi110.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi110.stdout: thermald 2024-04-21T22:33:45.551 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-04-21T22:33:45.551 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T22:33:45.552 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-21T22:33:45.552 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-21T22:33:45.553 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-04-21T22:33:45.553 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-21T22:33:45.573 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:33:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:33:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:33:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:33:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-21T22:33:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7-minimal 2024-04-21T22:33:45.574 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:33:45.576 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-04-21T22:33:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T22:33:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-21T22:33:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-21T22:33:45.577 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-04-21T22:33:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-21T22:33:45.577 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-04-21T22:33:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-04-21T22:33:45.627 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-04-21T22:33:45.627 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T22:33:45.627 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-21T22:33:45.628 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-21T22:33:45.629 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-04-21T22:33:45.629 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-21T22:33:45.687 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T22:33:45.687 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 113 MB of archives. 2024-04-21T22:33:45.688 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-21T22:33:45.688 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi110.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 113 MB of archives. 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-21T22:33:46.164 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-21T22:33:46.265 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-21T22:33:47.156 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-21T22:33:47.156 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-21T22:33:47.157 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-21T22:33:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-21T22:33:47.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-21T22:33:47.301 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-21T22:33:47.587 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-21T22:33:47.776 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 113 MB in 2s (65.3 MB/s) 2024-04-21T22:33:47.959 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-21T22:33:49.857 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-21T22:33:49.857 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-21T22:33:49.858 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-21T22:33:49.999 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-21T22:33:50.003 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:33:50.073 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:33:50.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-21T22:33:50.766 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-21T22:33:51.152 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 113 MB in 5s (21.8 MB/s) 2024-04-21T22:33:51.330 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-21T22:33:52.250 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-21T22:33:52.271 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:33:52.353 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:33:52.820 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-21T22:33:52.840 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:33:52.878 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:33:53.279 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-21T22:33:53.284 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:33:53.370 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:33:55.855 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-21T22:33:55.876 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:33:55.959 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:33:56.417 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-21T22:33:56.437 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:33:56.475 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:33:59.688 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T22:33:59.815 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T22:34:00.148 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T22:34:00.344 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T22:34:00.630 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-21T22:34:00.652 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-21T22:34:00.696 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T22:34:02.806 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T22:34:02.914 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T22:34:03.239 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T22:34:03.638 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-21T22:34:03.656 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-21T22:34:03.696 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T22:34:06.560 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-21T22:34:06.598 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:34:06.643 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:09.211 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T22:34:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-21T22:34:09.328 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T22:34:09.346 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T22:34:09.384 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:09.653 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T22:34:09.775 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:09.901 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-21T22:34:10.029 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:11.334 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-21T22:34:11.335 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-21T22:34:11.335 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-21T22:34:11.335 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:11.498 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:11.972 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T22:34:12.098 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T22:34:12.448 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T22:34:13.251 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:13.337 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:13.463 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-21T22:34:13.592 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:14.651 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-21T22:34:14.777 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-21T22:34:14.903 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:14.910 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-21T22:34:14.910 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-21T22:34:14.911 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-21T22:34:14.911 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:14.966 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-21T22:34:14.966 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:15.061 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:16.464 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:17.872 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-21T22:34:17.998 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-21T22:34:18.125 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T22:34:18.192 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-21T22:34:18.193 INFO:teuthology.orchestra.run.smithi110.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:29.645 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-21T22:34:29.645 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-04-21T22:34:29.662 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T22:34:29.682 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-04-21T22:34:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T22:34:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:30.265 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T22:34:30.269 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T22:34:30.337 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T22:34:30.343 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T22:34:30.503 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T22:34:30.503 INFO:teuthology.orchestra.run.smithi154.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T22:34:30.503 INFO:teuthology.orchestra.run.smithi154.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T22:34:30.547 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-04-21T22:34:31.008 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-04-21T22:34:31.028 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-04-21T22:34:31.028 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-04-21T22:34:31.028 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-04-21T22:34:31.028 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-04-21T22:34:31.028 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-04-21T22:34:31.028 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.105.102 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-04-21T22:34:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-04-21T22:34:31.029 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-21T22:34:31.029 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-21T22:34:31.029 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-21T22:34:31.029 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-21T22:34:31.030 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-04-21T22:34:31.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-04-21T22:34:31.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-04-21T22:34:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T22:34:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-21T22:34:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T22:34:31.385 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T22:34:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-21T22:34:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub' 2024-04-21T22:34:32.347 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T22:34:32.378 INFO:teuthology.orchestra.run.smithi110.stdout:Generating grub configuration file ... 2024-04-21T22:34:32.704 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T22:34:32.725 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:32.735 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-21T22:34:32.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T22:34:32.812 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-21T22:34:33.016 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-21T22:34:33.017 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-21T22:34:33.052 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T22:34:33.057 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T22:34:33.124 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T22:34:33.129 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T22:34:33.181 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-21T22:34:33.181 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:34:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:34:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:34:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:34:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T22:34:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T22:34:33.182 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:34:33.221 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T22:34:33.223 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-04-21T22:34:33.281 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-04-21T22:34:33.281 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-04-21T22:34:33.281 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.105.102 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-04-21T22:34:33.282 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-04-21T22:34:33.283 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-04-21T22:34:33.294 INFO:teuthology.orchestra.run.smithi110.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T22:34:33.294 INFO:teuthology.orchestra.run.smithi110.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T22:34:33.294 INFO:teuthology.orchestra.run.smithi110.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T22:34:33.326 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.vxLii0K82l 2024-04-21T22:34:33.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vxLii0K82l 2024-04-21T22:34:33.327 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-04-21T22:34:33.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.vxLii0K82l 2024-04-21T22:34:33.499 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.vxLii0K82l is 10KB 2024-04-21T22:34:33.512 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.vxLii0K82l 2024-04-21T22:34:33.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-21T22:34:33.569 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:34:33.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-21T22:34:33.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-21T22:34:33.633 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-21T22:34:33.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-04-21T22:34:33.780 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-04-21T22:34:33.800 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-04-21T22:34:33.801 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-04-21T22:34:33.801 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-04-21T22:34:33.801 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-04-21T22:34:33.801 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-04-21T22:34:33.801 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T22:34:33.801 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-04-21T22:34:33.801 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-04-21T22:34:33.802 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.105.102 2024-04-21T22:34:33.802 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T22:34:33.802 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T22:34:33.802 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-04-21T22:34:33.802 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-04-21T22:34:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-04-21T22:34:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-04-21T22:34:33.803 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-21T22:34:33.803 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-21T22:34:33.803 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-21T22:34:33.803 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-21T22:34:33.803 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-04-21T22:34:33.803 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-04-21T22:34:33.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-04-21T22:34:34.112 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T22:34:34.112 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T22:34:34.126 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-21T22:34:34.146 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T22:34:34.783 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-04-21T22:34:34.784 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T22:34:34.786 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-04-21T22:34:34.964 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T22:34:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:35.206 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T22:34:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T22:34:35.255 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T22:34:35.261 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T22:34:35.407 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T22:34:35.407 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T22:34:35.407 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T22:34:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-04-21T22:34:35.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-04-21T22:34:35.470 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-04-21T22:34:35.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T22:34:35.552 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-04-21T22:34:35.753 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-04-21T22:34:35.753 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-04-21T22:34:35.929 INFO:teuthology.orchestra.run.smithi110.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-21T22:34:35.930 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:34:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:34:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:34:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:34:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T22:34:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T22:34:35.930 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:34:35.972 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T22:34:35.974 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-04-21T22:34:35.989 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.105.102 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-04-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-04-21T22:34:35.991 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-04-21T22:34:35.991 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-04-21T22:34:35.991 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-04-21T22:34:36.036 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.ewDSt6Bw0u 2024-04-21T22:34:36.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ewDSt6Bw0u 2024-04-21T22:34:36.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.ewDSt6Bw0u 2024-04-21T22:34:36.206 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.ewDSt6Bw0u is 10KB 2024-04-21T22:34:36.219 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.ewDSt6Bw0u 2024-04-21T22:34:36.224 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-21T22:34:36.276 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:34:36.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-21T22:34:36.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-21T22:34:36.344 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-21T22:34:36.344 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-grub 2024-04-21T22:34:37.548 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-04-21T22:34:37.549 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T22:34:37.550 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-04-21T22:34:37.723 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T22:34:37.728 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T22:34:38.011 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T22:34:38.016 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T22:34:38.060 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T22:34:38.066 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T22:34:38.229 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T22:34:38.229 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T22:34:38.229 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T22:34:38.242 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-04-21T22:34:38.259 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-04-21T22:35:05.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-21T22:35:05.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-21T22:35:05.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:35:08.264 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-21T22:35:08.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-21T22:35:08.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:35:23.806 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-21T22:35:26.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-21T22:35:32.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-21T22:35:32.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:35:35.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-21T22:35:35.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:35:35.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-21T22:35:38.690 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-21T22:35:47.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-21T22:35:47.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:35:50.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-21T22:35:50.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:35:50.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-21T22:36:05.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-21T22:36:05.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:36:22.566 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-21T22:36:23.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-21T22:36:23.493 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-21T22:36:23.493 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-04-21T22:36:23.540 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-105-generic 2024-04-21T22:36:23.540 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-21T22:36:23.540 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-21T22:36:23.540 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-21T22:36:24.541 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-21T22:36:24.541 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-21T22:36:24.619 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-04-21T22:36:24.638 DEBUG:teuthology.parallel:result is None 2024-04-21T22:36:37.801 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-21T22:36:38.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-21T22:36:38.414 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-21T22:36:38.414 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-04-21T22:36:38.463 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-105-generic 2024-04-21T22:36:38.463 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-21T22:36:38.463 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-21T22:36:38.463 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-21T22:36:39.464 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-21T22:36:39.464 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-21T22:36:39.541 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-04-21T22:36:39.567 DEBUG:teuthology.parallel:result is None 2024-04-21T22:36:39.567 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-21T22:36:39.575 INFO:teuthology.task.internal:Creating test directory... 2024-04-21T22:36:39.575 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T22:36:39.577 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T22:36:39.583 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-21T22:36:39.620 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-21T22:36:39.670 INFO:teuthology.task.internal:Creating archive directory... 2024-04-21T22:36:39.670 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T22:36:39.673 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T22:36:39.695 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-21T22:36:39.720 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-21T22:36:39.720 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T22:36:39.725 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T22:36:39.746 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:36:39.754 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:36:39.756 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:36:39.762 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:36:39.764 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-21T22:36:39.775 INFO:teuthology.task.internal:Configuring sudo... 2024-04-21T22:36:39.775 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T22:36:39.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T22:36:39.817 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-21T22:36:39.830 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-21T22:36:39.830 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T22:36:39.857 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T22:36:39.865 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:36:39.908 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:36:39.956 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:36:39.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T22:36:40.013 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:36:40.019 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:36:40.066 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:36:40.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T22:36:40.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-04-21T22:36:40.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-04-21T22:36:40.202 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-21T22:36:40.210 INFO:teuthology.task.internal:Starting timer... 2024-04-21T22:36:40.210 INFO:teuthology.run_tasks:Running task pcp... 2024-04-21T22:36:40.252 INFO:teuthology.run_tasks:Running task selinux... 2024-04-21T22:36:40.283 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2024-04-21T22:36:40.283 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-04-21T22:36:40.283 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-21T22:36:40.283 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-21T22:36:40.283 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-21T22:36:40.283 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-21T22:36:40.317 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-21T22:36:40.334 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-21T22:36:40.335 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-21T22:43:36.762 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-04-21T22:43:36.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-21T22:43:36.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:43:36.849 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-21T22:43:36.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-21T22:43:36.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-21T22:43:36.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:43:37.005 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-21T22:43:37.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-21T22:43:37.079 INFO:teuthology.run_tasks:Running task clock... 2024-04-21T22:43:37.090 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-21T22:43:37.090 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T22:43:37.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:43:37.093 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T22:43:37.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:43:37.122 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-21T22:43:37.122 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Command line: ntpd -gq 2024-04-21T22:43:37.122 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: ---------------------------------------------------- 2024-04-21T22:43:37.122 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: ntp-4 is maintained by Network Time Foundation, 2024-04-21T22:43:37.122 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-21T22:43:37.123 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: corporation. Support and training for ntp-4 are 2024-04-21T22:43:37.123 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: available at https://www.nwtime.org/support 2024-04-21T22:43:37.123 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: ---------------------------------------------------- 2024-04-21T22:43:37.123 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: proto: precision = 0.044 usec (-24) 2024-04-21T22:43:37.123 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: basedate set to 2022-02-04 2024-04-21T22:43:37.123 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: gps base set to 2022-02-06 (week 2196) 2024-04-21T22:43:37.124 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T22:43:37.124 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T22:43:37.124 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: restrict ::: KOD does nothing without LIMITED. 2024-04-21T22:43:37.125 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-21T22:43:37.126 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Listen and drop on 0 v6wildcard [::]:123 2024-04-21T22:43:37.126 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-21T22:43:37.127 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Listen normally on 2 lo 127.0.0.1:123 2024-04-21T22:43:37.127 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2024-04-21T22:43:37.127 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Listen normally on 4 lo [::1]:123 2024-04-21T22:43:37.127 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2024-04-21T22:43:37.127 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:37 ntpd[17226]: Listening on routing socket on fd #22 for interface updates 2024-04-21T22:43:37.153 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-21T22:43:37.154 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Command line: ntpd -gq 2024-04-21T22:43:37.154 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: ---------------------------------------------------- 2024-04-21T22:43:37.154 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: ntp-4 is maintained by Network Time Foundation, 2024-04-21T22:43:37.154 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-21T22:43:37.154 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: corporation. Support and training for ntp-4 are 2024-04-21T22:43:37.154 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: available at https://www.nwtime.org/support 2024-04-21T22:43:37.154 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: ---------------------------------------------------- 2024-04-21T22:43:37.155 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: proto: precision = 0.061 usec (-24) 2024-04-21T22:43:37.155 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: basedate set to 2022-02-04 2024-04-21T22:43:37.156 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: gps base set to 2022-02-06 (week 2196) 2024-04-21T22:43:37.156 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T22:43:37.157 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T22:43:37.157 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: restrict ::: KOD does nothing without LIMITED. 2024-04-21T22:43:37.157 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-21T22:43:37.158 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Listen and drop on 0 v6wildcard [::]:123 2024-04-21T22:43:37.158 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-21T22:43:37.159 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Listen normally on 2 lo 127.0.0.1:123 2024-04-21T22:43:37.159 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-04-21T22:43:37.159 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Listen normally on 4 lo [::1]:123 2024-04-21T22:43:37.159 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-04-21T22:43:37.159 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:37 ntpd[17199]: Listening on routing socket on fd #22 for interface updates 2024-04-21T22:43:38.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:38.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:38 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:38.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:38.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:38 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:38.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:38.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:38 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:38 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:38 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:38 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:38 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:38 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:38 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:39.121 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:39 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:39.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:39 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:39.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:39 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:39.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:39 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:39.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:39 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:39.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:39 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:39.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:39 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:39.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:39 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:40.121 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:40.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:40 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:40.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:40.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:40 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:40.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:40.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:40 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:40.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:40.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:40.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:40.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:40.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:40.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:40.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:40.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:40 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:41.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:41 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:41.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:41 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:41.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:41 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:41.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:41 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:41.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:41 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:41.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:41 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:41.156 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:41 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:42.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:42.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:42.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:42.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:42.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:42 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:42.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:42 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:42.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:42 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:42.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:42 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:42.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:42 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:42.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:42 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:42.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:42 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:43.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:43 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:43.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:43 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:43.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:43 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:43.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:43 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:43.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:43 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:43.122 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:43 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:43.156 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:43.157 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:43.157 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:43.157 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:43.157 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:43.157 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:43.157 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:43.158 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:43.158 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:43.158 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:43.158 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:43.158 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:43 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:44.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:44.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:44.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:44.123 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:44.124 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:44.125 INFO:teuthology.orchestra.run.smithi110.stdout:21 Apr 22:43:44 ntpd[17226]: ntpd: time slew -0.000639 s 2024-04-21T22:43:44.125 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew -0.000639s 2024-04-21T22:43:44.126 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-21T22:43:44.126 INFO:teuthology.orchestra.run.smithi110.stderr:21 Apr 22:43:44 ntpd[17226]: can't open /var/log/ntpstats/loopstats.20240421: Permission denied 2024-04-21T22:43:44.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:44.154 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi154.stdout:21 Apr 22:43:44 ntpd[17199]: ntpd: time slew -0.002692 s 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew -0.002692s 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:21 Apr 22:43:44 ntpd[17199]: can't open /var/log/ntpstats/loopstats.20240421: Permission denied 2024-04-21T22:43:44.206 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-04-21T22:43:44.206 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-04-21T22:43:44.206 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.206 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.206 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.206 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.252 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-04-21T22:43:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-04-21T22:43:44.253 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.253 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.253 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.253 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T22:43:44.254 INFO:teuthology.run_tasks:Running task install... 2024-04-21T22:43:44.264 DEBUG:teuthology.task.install:project ceph 2024-04-21T22:43:44.264 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b'}} 2024-04-21T22:43:44.264 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b'} 2024-04-21T22:43:44.265 INFO:teuthology.task.install:Using flavor: default 2024-04-21T22:43:44.271 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-21T22:43:44.271 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-21T22:43:44.271 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2024-04-21T22:43:44.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-04-21T22:43:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-21T22:43:44.354 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-21T22:43:44.355 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-04-21T22:43:44.355 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-21T22:43:44.355 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-21T22:43:44.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:43:44.359 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-21T22:43:44.389 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-21T22:43:44.389 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2024-04-21T22:43:44.390 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-21T22:43:44.390 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-21T22:43:44.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:43:44.496 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default/ 2024-04-21T22:43:44.496 INFO:teuthology.task.install.deb:Package version is 19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:43:44.534 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default/ 2024-04-21T22:43:44.534 INFO:teuthology.task.install.deb:Package version is 19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:43:44.605 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:43:44.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-21T22:43:44.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-04-21T22:43:44.641 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:43:44.641 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-21T22:43:44.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-04-21T22:43:44.830 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T22:43:44.892 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T22:43:44.908 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T22:43:44.943 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T22:43:44.988 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-21T22:43:44.994 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy InRelease 2024-04-21T22:43:45.003 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy InRelease 2024-04-21T22:43:45.025 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-21T22:43:45.047 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-21T22:43:45.058 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-21T22:43:45.070 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T22:43:45.104 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-21T22:43:45.107 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T22:43:45.113 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-21T22:43:45.141 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-21T22:43:45.174 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-21T22:43:45.184 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-21T22:43:45.222 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-21T22:43:45.258 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 28.9 kB in 0s (63.4 kB/s) 2024-04-21T22:43:45.295 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 28.9 kB in 0s (62.3 kB/s) 2024-04-21T22:43:46.233 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-04-21T22:43:46.245 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-21T22:43:46.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2405-g820a2f8c-1jammy cephadm=19.0.0-2405-g820a2f8c-1jammy ceph-mds=19.0.0-2405-g820a2f8c-1jammy ceph-mgr=19.0.0-2405-g820a2f8c-1jammy ceph-common=19.0.0-2405-g820a2f8c-1jammy ceph-fuse=19.0.0-2405-g820a2f8c-1jammy ceph-test=19.0.0-2405-g820a2f8c-1jammy ceph-volume=19.0.0-2405-g820a2f8c-1jammy radosgw=19.0.0-2405-g820a2f8c-1jammy python3-rados=19.0.0-2405-g820a2f8c-1jammy python3-rgw=19.0.0-2405-g820a2f8c-1jammy python3-cephfs=19.0.0-2405-g820a2f8c-1jammy python3-rbd=19.0.0-2405-g820a2f8c-1jammy libcephfs2=19.0.0-2405-g820a2f8c-1jammy libcephfs-dev=19.0.0-2405-g820a2f8c-1jammy librados2=19.0.0-2405-g820a2f8c-1jammy librbd1=19.0.0-2405-g820a2f8c-1jammy rbd-fuse=19.0.0-2405-g820a2f8c-1jammy ceph-common-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-fuse-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-mds-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-mgr-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-mon-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-osd-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-test-dbg=19.0.0-2405-g820a2f8c-1jammy libcephfs2-dbg=19.0.0-2405-g820a2f8c-1jammy librados2-dbg=19.0.0-2405-g820a2f8c-1jammy libradosstriper1-dbg=19.0.0-2405-g820a2f8c-1jammy librbd1-dbg=19.0.0-2405-g820a2f8c-1jammy librgw2-dbg=19.0.0-2405-g820a2f8c-1jammy radosgw-dbg=19.0.0-2405-g820a2f8c-1jammy rbd-fuse-dbg=19.0.0-2405-g820a2f8c-1jammy rbd-mirror-dbg=19.0.0-2405-g820a2f8c-1jammy rbd-nbd-dbg=19.0.0-2405-g820a2f8c-1jammy python3-cephfs=19.0.0-2405-g820a2f8c-1jammy cephfs-shell=19.0.0-2405-g820a2f8c-1jammy cephfs-top=19.0.0-2405-g820a2f8c-1jammy cephfs-mirror=19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:43:46.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2405-g820a2f8c-1jammy cephadm=19.0.0-2405-g820a2f8c-1jammy ceph-mds=19.0.0-2405-g820a2f8c-1jammy ceph-mgr=19.0.0-2405-g820a2f8c-1jammy ceph-common=19.0.0-2405-g820a2f8c-1jammy ceph-fuse=19.0.0-2405-g820a2f8c-1jammy ceph-test=19.0.0-2405-g820a2f8c-1jammy ceph-volume=19.0.0-2405-g820a2f8c-1jammy radosgw=19.0.0-2405-g820a2f8c-1jammy python3-rados=19.0.0-2405-g820a2f8c-1jammy python3-rgw=19.0.0-2405-g820a2f8c-1jammy python3-cephfs=19.0.0-2405-g820a2f8c-1jammy python3-rbd=19.0.0-2405-g820a2f8c-1jammy libcephfs2=19.0.0-2405-g820a2f8c-1jammy libcephfs-dev=19.0.0-2405-g820a2f8c-1jammy librados2=19.0.0-2405-g820a2f8c-1jammy librbd1=19.0.0-2405-g820a2f8c-1jammy rbd-fuse=19.0.0-2405-g820a2f8c-1jammy ceph-common-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-fuse-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-mds-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-mgr-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-mon-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-osd-dbg=19.0.0-2405-g820a2f8c-1jammy ceph-test-dbg=19.0.0-2405-g820a2f8c-1jammy libcephfs2-dbg=19.0.0-2405-g820a2f8c-1jammy librados2-dbg=19.0.0-2405-g820a2f8c-1jammy libradosstriper1-dbg=19.0.0-2405-g820a2f8c-1jammy librbd1-dbg=19.0.0-2405-g820a2f8c-1jammy librgw2-dbg=19.0.0-2405-g820a2f8c-1jammy radosgw-dbg=19.0.0-2405-g820a2f8c-1jammy rbd-fuse-dbg=19.0.0-2405-g820a2f8c-1jammy rbd-mirror-dbg=19.0.0-2405-g820a2f8c-1jammy rbd-nbd-dbg=19.0.0-2405-g820a2f8c-1jammy python3-cephfs=19.0.0-2405-g820a2f8c-1jammy cephfs-shell=19.0.0-2405-g820a2f8c-1jammy cephfs-top=19.0.0-2405-g820a2f8c-1jammy cephfs-mirror=19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:43:46.303 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-04-21T22:43:46.322 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-21T22:43:46.479 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-04-21T22:43:46.480 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-04-21T22:43:46.521 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-21T22:43:46.521 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-21T22:43:46.651 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:43:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:43:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:43:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:43:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T22:43:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T22:43:46.652 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:43:46.652 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-04-21T22:43:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-21T22:43:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-21T22:43:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-21T22:43:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-21T22:43:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-21T22:43:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-21T22:43:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-21T22:43:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-21T22:43:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-21T22:43:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-21T22:43:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-21T22:43:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-21T22:43:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-21T22:43:46.656 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-04-21T22:43:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2024-04-21T22:43:46.715 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:43:46.715 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:43:46.715 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:43:46.715 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:43:46.716 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T22:43:46.716 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T22:43:46.716 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:43:46.717 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-04-21T22:43:46.717 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-21T22:43:46.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-04-21T22:43:46.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-04-21T22:43:46.720 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-04-21T22:43:46.786 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-04-21T22:43:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-04-21T22:43:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-21T22:43:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-21T22:43:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-21T22:43:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-21T22:43:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-21T22:43:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-21T22:43:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-21T22:43:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-21T22:43:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-21T22:43:46.849 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-04-21T22:43:46.849 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-21T22:43:46.849 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-21T22:43:46.849 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-21T22:43:46.850 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-21T22:43:46.850 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-04-21T22:43:46.850 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-04-21T22:43:46.850 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-21T22:43:46.850 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-04-21T22:43:46.850 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-21T22:43:46.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-21T22:43:46.852 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-21T22:43:46.978 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 142 newly installed, 0 to remove and 302 not upgraded. 2024-04-21T22:43:46.978 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 3,875 MB of archives. 2024-04-21T22:43:46.978 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 4,781 MB of additional disk space will be used. 2024-04-21T22:43:46.978 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-21T22:43:46.992 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 142 newly installed, 0 to remove and 302 not upgraded. 2024-04-21T22:43:46.993 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 3,875 MB of archives. 2024-04-21T22:43:46.993 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 4,781 MB of additional disk space will be used. 2024-04-21T22:43:46.993 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2405-g820a2f8c-1jammy [3,541 kB] 2024-04-21T22:43:47.039 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-21T22:43:47.059 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2405-g820a2f8c-1jammy [3,541 kB] 2024-04-21T22:43:47.060 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-21T22:43:47.106 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-21T22:43:47.122 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-21T22:43:47.167 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-21T22:43:47.209 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2405-g820a2f8c-1jammy [3,218 kB] 2024-04-21T22:43:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-21T22:43:47.311 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2405-g820a2f8c-1jammy [711 kB] 2024-04-21T22:43:47.339 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2405-g820a2f8c-1jammy [356 kB] 2024-04-21T22:43:47.350 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2405-g820a2f8c-1jammy [32.8 kB] 2024-04-21T22:43:47.351 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2405-g820a2f8c-1jammy [180 kB] 2024-04-21T22:43:47.358 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2405-g820a2f8c-1jammy [65.8 kB] 2024-04-21T22:43:47.360 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2405-g820a2f8c-1jammy [330 kB] 2024-04-21T22:43:47.362 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-21T22:43:47.403 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-21T22:43:47.413 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2405-g820a2f8c-1jammy [6,776 kB] 2024-04-21T22:43:47.416 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-21T22:43:47.461 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-21T22:43:47.468 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-21T22:43:47.474 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-21T22:43:47.526 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-21T22:43:47.622 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2405-g820a2f8c-1jammy [112 kB] 2024-04-21T22:43:47.625 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2405-g820a2f8c-1jammy [466 kB] 2024-04-21T22:43:47.642 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-21T22:43:47.645 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2405-g820a2f8c-1jammy [25.6 MB] 2024-04-21T22:43:47.651 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-21T22:43:47.678 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-21T22:43:47.686 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-21T22:43:47.730 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-21T22:43:47.744 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-21T22:43:47.848 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-21T22:43:47.852 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-21T22:43:47.854 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-21T22:43:48.019 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-21T22:43:48.245 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2405-g820a2f8c-1jammy [3,218 kB] 2024-04-21T22:43:48.428 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-21T22:43:48.443 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-21T22:43:48.459 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-21T22:43:48.468 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-21T22:43:48.468 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-21T22:43:48.485 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-21T22:43:48.522 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-21T22:43:48.536 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-21T22:43:48.540 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-21T22:43:48.540 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-21T22:43:48.589 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-21T22:43:48.603 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-21T22:43:48.619 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-21T22:43:48.628 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-21T22:43:48.628 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-21T22:43:48.644 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-21T22:43:48.690 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2405-g820a2f8c-1jammy [711 kB] 2024-04-21T22:43:48.709 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-21T22:43:48.711 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-21T22:43:48.712 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2405-g820a2f8c-1jammy [5,084 kB] 2024-04-21T22:43:48.791 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2405-g820a2f8c-1jammy [356 kB] 2024-04-21T22:43:48.794 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-21T22:43:48.800 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-21T22:43:48.801 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-21T22:43:48.802 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-21T22:43:48.802 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-21T22:43:48.834 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2405-g820a2f8c-1jammy [32.8 kB] 2024-04-21T22:43:48.835 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2405-g820a2f8c-1jammy [180 kB] 2024-04-21T22:43:48.850 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2405-g820a2f8c-1jammy [65.8 kB] 2024-04-21T22:43:48.872 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2405-g820a2f8c-1jammy [244 kB] 2024-04-21T22:43:48.873 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2405-g820a2f8c-1jammy [330 kB] 2024-04-21T22:43:48.876 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-21T22:43:48.886 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2405-g820a2f8c-1jammy [124 kB] 2024-04-21T22:43:48.893 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2405-g820a2f8c-1jammy [1,526 kB] 2024-04-21T22:43:48.896 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2405-g820a2f8c-1jammy [6,776 kB] 2024-04-21T22:43:48.902 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-21T22:43:48.918 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-21T22:43:48.935 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-21T22:43:48.959 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2405-g820a2f8c-1jammy [6,246 kB] 2024-04-21T22:43:48.968 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-21T22:43:49.052 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-21T22:43:49.058 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-21T22:43:49.127 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-21T22:43:49.133 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-21T22:43:49.143 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-21T22:43:49.149 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-21T22:43:49.155 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-21T22:43:49.158 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-21T22:43:49.175 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-21T22:43:49.192 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-21T22:43:49.260 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2405-g820a2f8c-1jammy [22.7 MB] 2024-04-21T22:43:49.339 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-21T22:43:49.384 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-21T22:43:49.400 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-21T22:43:49.407 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-21T22:43:49.412 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-21T22:43:49.421 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-21T22:43:49.436 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-21T22:43:49.597 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-21T22:43:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2405-g820a2f8c-1jammy [112 kB] 2024-04-21T22:43:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2405-g820a2f8c-1jammy [466 kB] 2024-04-21T22:43:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-21T22:43:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2405-g820a2f8c-1jammy [25.6 MB] 2024-04-21T22:43:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-21T22:43:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-21T22:43:49.680 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-21T22:43:49.696 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-21T22:43:49.835 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-21T22:43:49.837 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-21T22:43:49.840 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-21T22:43:49.845 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-21T22:43:49.859 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-21T22:43:49.882 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-21T22:43:49.933 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-21T22:43:49.947 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-21T22:43:50.044 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-21T22:43:50.106 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-21T22:43:50.107 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-21T22:43:50.111 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-21T22:43:50.116 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-21T22:43:50.130 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-21T22:43:50.301 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-21T22:43:50.316 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-21T22:43:50.416 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-21T22:43:50.458 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-21T22:43:50.542 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-21T22:43:50.555 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-21T22:43:50.567 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-21T22:43:50.573 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-21T22:43:50.591 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2405-g820a2f8c-1jammy [14.1 kB] 2024-04-21T22:43:50.593 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2405-g820a2f8c-1jammy [869 kB] 2024-04-21T22:43:50.607 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-21T22:43:50.625 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2405-g820a2f8c-1jammy [2,435 kB] 2024-04-21T22:43:50.686 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-21T22:43:50.731 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-21T22:43:50.777 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2405-g820a2f8c-1jammy [791 kB] 2024-04-21T22:43:50.813 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-21T22:43:50.826 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-21T22:43:50.838 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-21T22:43:50.849 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2405-g820a2f8c-1jammy [147 kB] 2024-04-21T22:43:50.861 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2405-g820a2f8c-1jammy [2,295 kB] 2024-04-21T22:43:50.868 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-21T22:43:50.870 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-21T22:43:50.873 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-21T22:43:50.879 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-21T22:43:51.037 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-21T22:43:51.067 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2405-g820a2f8c-1jammy [8,625 kB] 2024-04-21T22:43:51.140 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-21T22:43:51.142 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-21T22:43:51.145 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-21T22:43:51.309 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-21T22:43:51.376 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-21T22:43:51.396 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2405-g820a2f8c-1jammy [5,084 kB] 2024-04-21T22:43:51.636 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-21T22:43:51.647 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2405-g820a2f8c-1jammy [244 kB] 2024-04-21T22:43:51.652 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2405-g820a2f8c-1jammy [124 kB] 2024-04-21T22:43:51.654 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2405-g820a2f8c-1jammy [14.2 kB] 2024-04-21T22:43:51.654 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2405-g820a2f8c-1jammy [50.7 MB] 2024-04-21T22:43:51.655 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2405-g820a2f8c-1jammy [1,526 kB] 2024-04-21T22:43:51.752 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2405-g820a2f8c-1jammy [6,246 kB] 2024-04-21T22:43:51.770 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-21T22:43:51.781 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-21T22:43:51.781 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-21T22:43:51.851 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-21T22:43:51.851 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-21T22:43:51.853 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-21T22:43:51.854 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-21T22:43:51.856 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-21T22:43:52.022 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-21T22:43:52.041 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-21T22:43:52.051 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-21T22:43:52.052 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-21T22:43:52.117 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-21T22:43:52.122 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-21T22:43:52.122 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-21T22:43:52.124 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-21T22:43:52.125 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-21T22:43:52.126 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-21T22:43:52.136 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2405-g820a2f8c-1jammy [22.7 MB] 2024-04-21T22:43:52.213 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-21T22:43:52.293 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-21T22:43:52.390 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-21T22:43:52.460 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-21T22:43:52.485 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-21T22:43:52.503 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-21T22:43:52.527 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-21T22:43:52.535 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-21T22:43:52.580 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-21T22:43:52.605 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-21T22:43:52.606 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-21T22:43:52.613 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-21T22:43:52.732 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-21T22:43:52.775 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-21T22:43:52.780 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-21T22:43:52.881 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-21T22:43:52.883 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-21T22:43:52.892 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-21T22:43:52.898 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-21T22:43:52.899 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-21T22:43:52.902 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-21T22:43:53.067 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-21T22:43:53.322 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-21T22:43:53.328 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-21T22:43:53.368 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-21T22:43:53.369 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-21T22:43:53.375 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-21T22:43:53.377 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-21T22:43:53.418 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-21T22:43:53.426 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-21T22:43:53.500 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-21T22:43:53.501 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-21T22:43:53.502 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2405-g820a2f8c-1jammy [14.1 kB] 2024-04-21T22:43:53.503 INFO:teuthology.orchestra.run.smithi110.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2405-g820a2f8c-1jammy [869 kB] 2024-04-21T22:43:53.520 INFO:teuthology.orchestra.run.smithi110.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2405-g820a2f8c-1jammy [2,435 kB] 2024-04-21T22:43:53.604 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-21T22:43:53.609 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-21T22:43:53.614 INFO:teuthology.orchestra.run.smithi110.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2405-g820a2f8c-1jammy [791 kB] 2024-04-21T22:43:53.649 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-21T22:43:53.649 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-21T22:43:53.655 INFO:teuthology.orchestra.run.smithi110.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2405-g820a2f8c-1jammy [147 kB] 2024-04-21T22:43:53.656 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-21T22:43:53.658 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-21T22:43:53.659 INFO:teuthology.orchestra.run.smithi110.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2405-g820a2f8c-1jammy [2,295 kB] 2024-04-21T22:43:53.667 INFO:teuthology.orchestra.run.smithi110.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-21T22:43:53.699 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-21T22:43:53.707 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-21T22:43:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-21T22:43:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-21T22:43:53.795 INFO:teuthology.orchestra.run.smithi110.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2405-g820a2f8c-1jammy [8,625 kB] 2024-04-21T22:43:53.946 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-21T22:43:54.109 INFO:teuthology.orchestra.run.smithi110.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-21T22:43:54.124 INFO:teuthology.orchestra.run.smithi110.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-21T22:43:54.252 INFO:teuthology.orchestra.run.smithi110.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2405-g820a2f8c-1jammy [14.2 kB] 2024-04-21T22:43:54.253 INFO:teuthology.orchestra.run.smithi110.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2405-g820a2f8c-1jammy [50.7 MB] 2024-04-21T22:43:54.388 INFO:teuthology.orchestra.run.smithi154.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-21T22:43:54.403 INFO:teuthology.orchestra.run.smithi154.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-21T22:43:55.850 INFO:teuthology.orchestra.run.smithi154.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2405-g820a2f8c-1jammy [121 kB] 2024-04-21T22:43:55.852 INFO:teuthology.orchestra.run.smithi154.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2405-g820a2f8c-1jammy [229 kB] 2024-04-21T22:43:55.857 INFO:teuthology.orchestra.run.smithi154.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2405-g820a2f8c-1jammy [34.0 kB] 2024-04-21T22:43:55.858 INFO:teuthology.orchestra.run.smithi154.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2405-g820a2f8c-1jammy [23.4 kB] 2024-04-21T22:43:55.860 INFO:teuthology.orchestra.run.smithi154.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2405-g820a2f8c-1jammy [39.0 kB] 2024-04-21T22:43:55.861 INFO:teuthology.orchestra.run.smithi154.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2405-g820a2f8c-1jammy [13.4 MB] 2024-04-21T22:43:56.663 INFO:teuthology.orchestra.run.smithi154.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2405-g820a2f8c-1jammy [91.4 kB] 2024-04-21T22:43:56.665 INFO:teuthology.orchestra.run.smithi154.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2405-g820a2f8c-1jammy [3,122 kB] 2024-04-21T22:43:56.850 INFO:teuthology.orchestra.run.smithi154.stdout:Get:126 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2405-g820a2f8c-1jammy [179 kB] 2024-04-21T22:43:56.862 INFO:teuthology.orchestra.run.smithi154.stdout:Get:127 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [776 MB] 2024-04-21T22:43:57.492 INFO:teuthology.orchestra.run.smithi110.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2405-g820a2f8c-1jammy [121 kB] 2024-04-21T22:43:57.573 INFO:teuthology.orchestra.run.smithi110.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2405-g820a2f8c-1jammy [229 kB] 2024-04-21T22:43:57.578 INFO:teuthology.orchestra.run.smithi110.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2405-g820a2f8c-1jammy [34.0 kB] 2024-04-21T22:43:57.579 INFO:teuthology.orchestra.run.smithi110.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2405-g820a2f8c-1jammy [23.4 kB] 2024-04-21T22:43:57.580 INFO:teuthology.orchestra.run.smithi110.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2405-g820a2f8c-1jammy [39.0 kB] 2024-04-21T22:43:57.581 INFO:teuthology.orchestra.run.smithi110.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2405-g820a2f8c-1jammy [13.4 MB] 2024-04-21T22:43:58.278 INFO:teuthology.orchestra.run.smithi110.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2405-g820a2f8c-1jammy [91.4 kB] 2024-04-21T22:43:58.279 INFO:teuthology.orchestra.run.smithi110.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2405-g820a2f8c-1jammy [3,122 kB] 2024-04-21T22:43:58.426 INFO:teuthology.orchestra.run.smithi110.stdout:Get:126 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2405-g820a2f8c-1jammy [179 kB] 2024-04-21T22:43:58.437 INFO:teuthology.orchestra.run.smithi110.stdout:Get:127 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [776 MB] 2024-04-21T22:44:59.583 INFO:teuthology.orchestra.run.smithi154.stdout:Get:128 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [18.9 MB] 2024-04-21T22:45:01.103 INFO:teuthology.orchestra.run.smithi154.stdout:Get:129 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [86.4 MB] 2024-04-21T22:45:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:Get:128 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [18.9 MB] 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi154.stdout:Get:130 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [42.7 MB] 2024-04-21T22:45:07.755 INFO:teuthology.orchestra.run.smithi110.stdout:Get:129 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [86.4 MB] 2024-04-21T22:45:13.593 INFO:teuthology.orchestra.run.smithi154.stdout:Get:131 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [159 MB] 2024-04-21T22:45:16.105 INFO:teuthology.orchestra.run.smithi110.stdout:Get:130 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [42.7 MB] 2024-04-21T22:45:20.058 INFO:teuthology.orchestra.run.smithi110.stdout:Get:131 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [159 MB] 2024-04-21T22:45:34.385 INFO:teuthology.orchestra.run.smithi154.stdout:Get:132 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [540 MB] 2024-04-21T22:45:36.071 INFO:teuthology.orchestra.run.smithi110.stdout:Get:132 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [540 MB] 2024-04-21T22:46:06.008 INFO:teuthology.orchestra.run.smithi154.stdout:Get:133 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [1,216 MB] 2024-04-21T22:46:16.534 INFO:teuthology.orchestra.run.smithi110.stdout:Get:133 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [1,216 MB] 2024-04-21T22:47:24.148 INFO:teuthology.orchestra.run.smithi110.stdout:Get:134 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [17.0 MB] 2024-04-21T22:47:25.048 INFO:teuthology.orchestra.run.smithi110.stdout:Get:135 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [83.0 MB] 2024-04-21T22:47:29.679 INFO:teuthology.orchestra.run.smithi110.stdout:Get:136 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [11.4 MB] 2024-04-21T22:47:30.099 INFO:teuthology.orchestra.run.smithi110.stdout:Get:137 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [103 MB] 2024-04-21T22:47:35.974 INFO:teuthology.orchestra.run.smithi110.stdout:Get:138 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [183 MB] 2024-04-21T22:47:45.098 INFO:teuthology.orchestra.run.smithi154.stdout:Get:134 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [17.0 MB] 2024-04-21T22:47:45.720 INFO:teuthology.orchestra.run.smithi154.stdout:Get:135 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [83.0 MB] 2024-04-21T22:47:45.756 INFO:teuthology.orchestra.run.smithi110.stdout:Get:139 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [355 MB] 2024-04-21T22:47:54.884 INFO:teuthology.orchestra.run.smithi154.stdout:Get:136 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [11.4 MB] 2024-04-21T22:47:55.746 INFO:teuthology.orchestra.run.smithi154.stdout:Get:137 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [103 MB] 2024-04-21T22:48:04.820 INFO:teuthology.orchestra.run.smithi154.stdout:Get:138 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [183 MB] 2024-04-21T22:48:04.827 INFO:teuthology.orchestra.run.smithi110.stdout:Get:140 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [1,792 kB] 2024-04-21T22:48:04.860 INFO:teuthology.orchestra.run.smithi110.stdout:Get:141 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [97.3 MB] 2024-04-21T22:48:10.464 INFO:teuthology.orchestra.run.smithi110.stdout:Get:142 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [3,139 kB] 2024-04-21T22:48:11.135 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 3,875 MB in 4min 24s (14.7 MB/s) 2024-04-21T22:48:11.250 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-21T22:48:11.346 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-21T22:48:11.351 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-21T22:48:11.389 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-21T22:48:11.667 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-21T22:48:11.694 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-21T22:48:11.734 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T22:48:12.062 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cmd2. 2024-04-21T22:48:12.088 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-21T22:48:12.128 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-21T22:48:12.482 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-21T22:48:12.507 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-21T22:48:12.590 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T22:48:12.968 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-21T22:48:12.994 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-21T22:48:13.035 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T22:48:13.363 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-21T22:48:13.390 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-21T22:48:13.430 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T22:48:13.883 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-21T22:48:13.909 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T22:48:13.958 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:48:14.378 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-21T22:48:14.404 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T22:48:14.445 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:48:14.764 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-21T22:48:14.791 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T22:48:14.831 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:48:15.014 INFO:teuthology.orchestra.run.smithi154.stdout:Get:139 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [355 MB] 2024-04-21T22:48:15.184 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-21T22:48:15.210 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-21T22:48:15.251 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T22:48:15.587 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2. 2024-04-21T22:48:15.613 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-librados2_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:15.654 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:16.090 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1. 2024-04-21T22:48:16.117 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-librbd1_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:16.156 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:16.601 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2024-04-21T22:48:16.627 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:16.667 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:16.953 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2024-04-21T22:48:16.980 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:17.012 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:17.315 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-21T22:48:17.341 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:17.381 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:17.634 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2024-04-21T22:48:17.661 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:17.700 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:18.028 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-21T22:48:18.054 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:18.095 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:18.406 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2024-04-21T22:48:18.422 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-21T22:48:18.456 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-21T22:48:18.667 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2024-04-21T22:48:18.693 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:18.734 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:19.078 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-21T22:48:19.104 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-21T22:48:19.145 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T22:48:19.439 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-21T22:48:19.455 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-21T22:48:19.497 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T22:48:19.817 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-21T22:48:19.843 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-21T22:48:19.884 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T22:48:20.220 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua5.1. 2024-04-21T22:48:20.247 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-21T22:48:20.296 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-21T22:48:20.674 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-any. 2024-04-21T22:48:20.700 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-21T22:48:20.748 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-21T22:48:21.046 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package zip. 2024-04-21T22:48:21.070 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-21T22:48:21.109 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking zip (3.0-12build2) ... 2024-04-21T22:48:21.438 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package unzip. 2024-04-21T22:48:21.464 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-21T22:48:21.504 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-21T22:48:21.950 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package luarocks. 2024-04-21T22:48:21.976 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-21T22:48:22.025 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-21T22:48:22.466 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2024-04-21T22:48:22.494 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-librgw2_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:22.541 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:23.094 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2024-04-21T22:48:23.108 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:23.151 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:23.505 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-21T22:48:23.531 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-21T22:48:23.571 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T22:48:23.941 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2024-04-21T22:48:23.967 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:24.016 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:24.469 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2024-04-21T22:48:24.495 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:24.536 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:26.008 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2024-04-21T22:48:26.035 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:26.092 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:26.720 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-21T22:48:26.747 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-21T22:48:26.787 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-21T22:48:27.090 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cheroot. 2024-04-21T22:48:27.117 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-21T22:48:27.156 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T22:48:27.501 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-21T22:48:27.528 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-21T22:48:27.568 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-21T22:48:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-21T22:48:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-21T22:48:28.021 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-21T22:48:28.357 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-21T22:48:28.383 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-21T22:48:28.424 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-21T22:48:28.726 INFO:teuthology.orchestra.run.smithi154.stdout:Get:140 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [1,792 kB] 2024-04-21T22:48:28.727 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempora. 2024-04-21T22:48:28.753 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-21T22:48:28.760 INFO:teuthology.orchestra.run.smithi154.stdout:Get:141 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [97.3 MB] 2024-04-21T22:48:28.793 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-21T22:48:29.154 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-portend. 2024-04-21T22:48:29.181 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-21T22:48:29.230 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-21T22:48:29.599 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-21T22:48:29.626 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-21T22:48:29.674 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-21T22:48:29.977 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-21T22:48:30.004 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-21T22:48:30.043 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-21T22:48:30.399 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-natsort. 2024-04-21T22:48:30.426 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-21T22:48:30.466 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-21T22:48:30.777 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2024-04-21T22:48:30.803 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-21T22:48:30.844 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-21T22:48:31.130 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-21T22:48:31.156 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-21T22:48:31.196 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-21T22:48:31.433 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2024-04-21T22:48:31.459 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-21T22:48:31.491 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T22:48:31.761 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-21T22:48:31.773 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-21T22:48:31.810 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-21T22:48:32.113 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-21T22:48:32.140 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-21T22:48:32.180 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-21T22:48:32.466 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2024-04-21T22:48:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-21T22:48:32.533 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-21T22:48:32.575 INFO:teuthology.orchestra.run.smithi154.stdout:Get:142 https://1.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2405-g820a2f8c-1jammy [3,139 kB] 2024-04-21T22:48:32.869 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2024-04-21T22:48:32.896 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-21T22:48:32.938 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T22:48:33.247 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2024-04-21T22:48:33.263 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 3,875 MB in 4min 46s (13.6 MB/s) 2024-04-21T22:48:33.273 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-21T22:48:33.305 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T22:48:33.406 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-21T22:48:33.505 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-21T22:48:33.510 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-21T22:48:33.554 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-21T22:48:33.592 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2024-04-21T22:48:33.619 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-21T22:48:33.658 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T22:48:33.857 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-21T22:48:33.884 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-21T22:48:33.924 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T22:48:33.970 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-21T22:48:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-21T22:48:34.020 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T22:48:34.235 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cmd2. 2024-04-21T22:48:34.262 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-21T22:48:34.297 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-21T22:48:34.301 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-21T22:48:34.324 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-21T22:48:34.364 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-21T22:48:34.667 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2024-04-21T22:48:34.671 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-21T22:48:34.694 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-21T22:48:34.698 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-21T22:48:34.734 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-21T22:48:34.771 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T22:48:35.020 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2024-04-21T22:48:35.047 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-21T22:48:35.067 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-21T22:48:35.086 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T22:48:35.093 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-21T22:48:35.125 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T22:48:35.453 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-21T22:48:35.467 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-certifi. 2024-04-21T22:48:35.479 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-21T22:48:35.494 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-21T22:48:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T22:48:35.533 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-21T22:48:35.820 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-idna. 2024-04-21T22:48:35.847 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-21T22:48:35.878 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-21T22:48:35.956 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-21T22:48:35.983 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T22:48:36.030 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:48:36.197 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-urllib3. 2024-04-21T22:48:36.224 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-21T22:48:36.264 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T22:48:36.385 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-21T22:48:36.411 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T22:48:36.451 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:48:36.584 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests. 2024-04-21T22:48:36.611 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-21T22:48:36.650 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T22:48:36.788 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-21T22:48:36.814 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T22:48:36.854 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:48:36.962 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-21T22:48:36.989 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-21T22:48:37.028 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T22:48:37.191 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-21T22:48:37.217 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-21T22:48:37.257 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T22:48:37.340 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-21T22:48:37.366 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:37.406 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:37.527 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2024-04-21T22:48:37.542 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-librados2_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:37.619 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:37.795 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-21T22:48:37.821 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:37.861 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:38.063 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2024-04-21T22:48:38.089 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-librbd1_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:38.129 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:38.172 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-21T22:48:38.199 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-21T22:48:38.239 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-21T22:48:38.525 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2024-04-21T22:48:38.552 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-21T22:48:38.574 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-04-21T22:48:38.592 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-21T22:48:38.601 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:38.641 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:38.885 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-04-21T22:48:38.886 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2024-04-21T22:48:38.900 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:38.913 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:38.935 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:38.953 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:39.230 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-21T22:48:39.256 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:39.296 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:39.365 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2024-04-21T22:48:39.391 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:39.431 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:39.548 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-04-21T22:48:39.575 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:39.615 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:39.935 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-21T22:48:39.961 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:40.001 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:40.043 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2024-04-21T22:48:40.070 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:40.109 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:40.304 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-04-21T22:48:40.331 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-21T22:48:40.371 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-21T22:48:40.607 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-04-21T22:48:40.622 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:40.665 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:41.010 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-21T22:48:41.036 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-21T22:48:41.076 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T22:48:41.138 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2024-04-21T22:48:41.150 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-ceph_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:41.187 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:41.354 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-21T22:48:41.369 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-21T22:48:41.437 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T22:48:41.515 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2024-04-21T22:48:41.541 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:41.582 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:41.732 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-21T22:48:41.747 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-21T22:48:41.790 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T22:48:42.119 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua5.1. 2024-04-21T22:48:42.145 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-21T22:48:42.185 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-21T22:48:42.201 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2024-04-21T22:48:42.228 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:42.268 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:42.513 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-any. 2024-04-21T22:48:42.529 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-21T22:48:42.571 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-21T22:48:42.621 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2024-04-21T22:48:42.647 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-cephadm_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:42.679 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:42.816 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package zip. 2024-04-21T22:48:42.843 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-21T22:48:42.874 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking zip (3.0-12build2) ... 2024-04-21T22:48:42.999 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-21T22:48:43.025 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-21T22:48:43.065 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-21T22:48:43.161 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package unzip. 2024-04-21T22:48:43.187 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-21T22:48:43.227 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-21T22:48:43.402 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-21T22:48:43.428 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T22:48:43.468 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T22:48:43.623 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package luarocks. 2024-04-21T22:48:43.650 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-21T22:48:43.689 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-21T22:48:44.072 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-04-21T22:48:44.099 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-librgw2_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:44.139 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:44.464 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-babel. 2024-04-21T22:48:44.491 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T22:48:44.531 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T22:48:44.667 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-04-21T22:48:44.693 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:44.733 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:44.859 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2024-04-21T22:48:44.886 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-21T22:48:44.926 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T22:48:45.061 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-21T22:48:45.088 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-21T22:48:45.128 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T22:48:45.262 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-21T22:48:45.289 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:45.328 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:45.447 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-04-21T22:48:45.474 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:45.514 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:45.665 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-21T22:48:45.692 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-21T22:48:45.732 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-21T22:48:45.884 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-04-21T22:48:45.911 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:45.942 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:46.035 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2024-04-21T22:48:46.061 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-21T22:48:46.101 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T22:48:46.438 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-21T22:48:46.464 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:46.504 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:47.273 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-04-21T22:48:47.299 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:47.348 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:47.801 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-21T22:48:47.817 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-21T22:48:47.859 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T22:48:47.927 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-21T22:48:47.953 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-21T22:48:47.993 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-21T22:48:48.296 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2024-04-21T22:48:48.323 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-21T22:48:48.355 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2024-04-21T22:48:48.362 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T22:48:48.382 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-21T22:48:48.421 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T22:48:48.691 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-21T22:48:48.717 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-21T22:48:48.758 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-21T22:48:48.766 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-21T22:48:48.784 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-21T22:48:48.910 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-21T22:48:49.069 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-21T22:48:49.095 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-21T22:48:49.152 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-21T22:48:49.221 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2024-04-21T22:48:49.248 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-21T22:48:49.288 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T22:48:49.430 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-21T22:48:49.456 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-21T22:48:49.488 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-21T22:48:49.791 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2024-04-21T22:48:49.818 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-21T22:48:49.858 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-21T22:48:50.014 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-21T22:48:50.042 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:50.080 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:50.161 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2024-04-21T22:48:50.187 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-21T22:48:50.227 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-21T22:48:50.513 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-21T22:48:50.540 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-21T22:48:50.580 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-21T22:48:50.849 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-21T22:48:50.877 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-21T22:48:50.925 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-21T22:48:51.100 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2024-04-21T22:48:51.127 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-21T22:48:51.167 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-21T22:48:51.295 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-04-21T22:48:51.322 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-21T22:48:51.361 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-21T22:48:51.445 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-21T22:48:51.460 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-21T22:48:51.494 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-21T22:48:51.631 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-04-21T22:48:51.658 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-21T22:48:51.698 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-21T22:48:51.873 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-21T22:48:51.900 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-21T22:48:51.931 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T22:48:52.001 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-21T22:48:52.027 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-21T22:48:52.067 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-21T22:48:52.192 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2024-04-21T22:48:52.208 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-21T22:48:52.251 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-21T22:48:52.370 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-04-21T22:48:52.397 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-21T22:48:52.437 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T22:48:52.580 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2024-04-21T22:48:52.607 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-21T22:48:52.646 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-21T22:48:52.757 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-21T22:48:52.783 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-21T22:48:52.823 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-21T22:48:52.949 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-21T22:48:52.977 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-21T22:48:53.015 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T22:48:53.134 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-21T22:48:53.161 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-21T22:48:53.201 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-21T22:48:53.361 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2024-04-21T22:48:53.388 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-21T22:48:53.435 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-21T22:48:53.504 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-04-21T22:48:53.531 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-21T22:48:53.570 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-21T22:48:53.839 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-21T22:48:53.867 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-21T22:48:53.914 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T22:48:53.932 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-04-21T22:48:53.958 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-21T22:48:54.001 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T22:48:54.293 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-04-21T22:48:54.320 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-21T22:48:54.360 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T22:48:54.603 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-21T22:48:54.619 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:54.646 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-04-21T22:48:54.661 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:54.673 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-21T22:48:54.704 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T22:48:54.980 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-21T22:48:55.008 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-21T22:48:55.032 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-21T22:48:55.047 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T22:48:55.047 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-21T22:48:55.090 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T22:48:55.375 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-21T22:48:55.377 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-21T22:48:55.402 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T22:48:55.404 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-21T22:48:55.435 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-21T22:48:55.441 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T22:48:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2024-04-21T22:48:55.677 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T22:48:55.719 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-21T22:48:55.738 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-04-21T22:48:55.765 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-21T22:48:55.805 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-21T22:48:55.972 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2024-04-21T22:48:55.987 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-21T22:48:56.030 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-21T22:48:56.116 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-04-21T22:48:56.143 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-21T22:48:56.182 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T22:48:56.342 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2024-04-21T22:48:56.369 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-21T22:48:56.408 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-21T22:48:56.538 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2024-04-21T22:48:56.565 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-21T22:48:56.604 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-21T22:48:56.780 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2024-04-21T22:48:56.807 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:56.846 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:56.940 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2024-04-21T22:48:56.967 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-21T22:48:57.007 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-21T22:48:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2024-04-21T22:48:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-21T22:48:57.560 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T22:48:57.863 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2024-04-21T22:48:57.890 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-21T22:48:57.929 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T22:48:58.241 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-21T22:48:58.269 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-21T22:48:58.308 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T22:48:58.570 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-21T22:48:58.585 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:58.633 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:59.022 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-21T22:48:59.042 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:59.082 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:59.125 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-volume. 2024-04-21T22:48:59.153 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:48:59.191 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-volume (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:59.377 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-21T22:48:59.403 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-21T22:48:59.445 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-21T22:48:59.571 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-21T22:48:59.598 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:48:59.637 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:48:59.729 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-04-21T22:48:59.756 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-21T22:48:59.796 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-21T22:48:59.882 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-colorama. 2024-04-21T22:48:59.897 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-21T22:48:59.931 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-21T22:49:00.115 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-04-21T22:49:00.142 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-shell. 2024-04-21T22:49:00.181 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:00.242 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-shell (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:00.503 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-top. 2024-04-21T22:49:00.519 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-top (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:00.585 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-04-21T22:49:00.612 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:00.668 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:00.814 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-21T22:49:00.841 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:00.880 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:01.175 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-21T22:49:01.202 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-21T22:49:01.233 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T22:49:01.305 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-04-21T22:49:01.332 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:01.372 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:01.554 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-21T22:49:01.582 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-21T22:49:01.621 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-21T22:49:02.025 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2024-04-21T22:49:02.052 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-21T22:49:02.091 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T22:49:02.416 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-04-21T22:49:02.443 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:02.483 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:02.505 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pkg-config. 2024-04-21T22:49:02.532 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-21T22:49:02.571 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T22:49:02.802 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-04-21T22:49:02.829 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:02.849 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-21T22:49:02.869 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:02.877 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-21T22:49:02.916 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-21T22:49:03.230 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-04-21T22:49:03.257 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:03.297 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:03.319 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-21T22:49:03.347 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-21T22:49:03.377 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-21T22:49:03.658 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-04-21T22:49:03.680 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2024-04-21T22:49:03.684 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-cephadm_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:03.708 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-21T22:49:03.741 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:03.746 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-21T22:49:04.044 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-21T22:49:04.066 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2024-04-21T22:49:04.071 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-21T22:49:04.094 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-21T22:49:04.111 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-21T22:49:04.141 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-21T22:49:04.413 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-21T22:49:04.440 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T22:49:04.461 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2024-04-21T22:49:04.489 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-21T22:49:04.496 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T22:49:04.527 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-21T22:49:04.856 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2024-04-21T22:49:04.884 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-21T22:49:04.930 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-21T22:49:05.259 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pygments. 2024-04-21T22:49:05.287 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-21T22:49:05.325 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T22:49:05.460 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2024-04-21T22:49:05.488 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T22:49:05.527 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T22:49:05.805 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-21T22:49:05.833 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-21T22:49:05.846 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-04-21T22:49:05.871 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-21T22:49:05.873 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-21T22:49:05.913 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T22:49:06.174 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-toml. 2024-04-21T22:49:06.202 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-21T22:49:06.232 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-21T22:49:06.249 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-21T22:49:06.277 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:06.315 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:06.485 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2024-04-21T22:49:06.512 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-21T22:49:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T22:49:06.661 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-21T22:49:06.688 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-21T22:49:06.727 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-21T22:49:06.863 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2024-04-21T22:49:06.891 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-21T22:49:06.929 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-21T22:49:07.055 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-04-21T22:49:07.082 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-21T22:49:07.122 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T22:49:07.199 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-21T22:49:07.215 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-21T22:49:07.257 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-21T22:49:07.458 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-21T22:49:07.485 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:07.525 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:08.003 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2024-04-21T22:49:08.031 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../122-radosgw_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:08.069 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:08.813 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-21T22:49:08.841 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-21T22:49:08.880 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T22:49:08.881 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2024-04-21T22:49:08.910 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:08.939 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:09.250 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-mirror. 2024-04-21T22:49:09.278 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:09.318 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:09.376 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-04-21T22:49:09.402 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-21T22:49:09.443 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T22:49:09.738 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-nbd. 2024-04-21T22:49:09.766 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:09.805 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-nbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:09.830 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-21T22:49:09.857 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-21T22:49:09.982 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-21T22:49:10.074 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-21T22:49:10.102 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:10.132 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:10.260 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-04-21T22:49:10.288 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-21T22:49:10.326 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T22:49:11.086 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-21T22:49:11.114 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:11.153 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:12.081 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-04-21T22:49:12.108 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-21T22:49:12.147 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-21T22:49:12.458 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-21T22:49:12.486 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-21T22:49:12.525 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-21T22:49:12.820 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-21T22:49:12.836 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-21T22:49:12.878 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T22:49:13.198 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-04-21T22:49:13.226 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-21T22:49:13.264 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-21T22:49:13.585 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-04-21T22:49:13.613 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-21T22:49:13.651 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-21T22:49:13.947 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-21T22:49:13.974 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-21T22:49:14.005 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T22:49:14.291 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-04-21T22:49:14.318 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-21T22:49:14.357 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-21T22:49:14.677 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-21T22:49:14.705 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-21T22:49:14.753 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T22:49:15.383 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-21T22:49:15.399 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:15.441 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:15.736 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-21T22:49:15.752 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-21T22:49:15.794 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T22:49:16.097 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-21T22:49:16.124 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T22:49:16.164 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T22:49:16.433 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-04-21T22:49:16.449 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T22:49:16.491 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-21T22:49:16.744 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-04-21T22:49:16.759 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-21T22:49:16.802 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-21T22:49:17.072 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-04-21T22:49:17.088 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-21T22:49:17.130 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-21T22:49:17.501 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-04-21T22:49:17.517 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:17.551 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:18.010 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-21T22:49:18.038 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:18.086 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:18.579 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-21T22:49:18.595 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:18.638 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:19.707 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-21T22:49:19.732 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:19.773 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:19.797 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-04-21T22:49:19.824 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:19.863 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:20.251 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-21T22:49:20.278 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:20.317 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:20.459 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-21T22:49:20.475 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:20.517 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:20.620 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-colorama. 2024-04-21T22:49:20.648 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-21T22:49:20.687 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-21T22:49:20.948 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-shell. 2024-04-21T22:49:20.964 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:21.006 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-shell (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:21.267 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-top. 2024-04-21T22:49:21.283 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2405-g820a2f8c-1jammy_all.deb ... 2024-04-21T22:49:21.325 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-top (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:21.578 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-21T22:49:21.594 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:21.636 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:21.947 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-21T22:49:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-21T22:49:22.014 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T22:49:22.331 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-21T22:49:22.360 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:22.360 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-21T22:49:22.387 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-21T22:49:22.406 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:22.427 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-21T22:49:22.797 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-04-21T22:49:22.825 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-21T22:49:22.864 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T22:49:23.252 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pkg-config. 2024-04-21T22:49:23.279 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-21T22:49:23.310 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T22:49:23.564 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-21T22:49:23.591 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-21T22:49:23.630 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-21T22:49:24.067 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-21T22:49:24.094 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-21T22:49:24.133 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-21T22:49:24.419 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-04-21T22:49:24.446 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-21T22:49:24.485 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-21T22:49:24.814 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-04-21T22:49:24.841 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-21T22:49:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-21T22:49:25.175 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-04-21T22:49:25.202 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-21T22:49:25.241 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-21T22:49:25.528 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-04-21T22:49:25.544 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-21T22:49:25.586 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-21T22:49:25.940 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2024-04-21T22:49:25.967 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-21T22:49:26.006 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T22:49:26.427 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-21T22:49:26.455 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-21T22:49:26.485 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-21T22:49:26.796 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2024-04-21T22:49:26.824 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-21T22:49:26.863 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-21T22:49:27.166 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-04-21T22:49:27.193 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-21T22:49:27.234 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T22:49:27.586 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-04-21T22:49:27.613 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-21T22:49:27.652 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-21T22:49:27.780 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-21T22:49:27.796 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:27.838 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:27.947 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-21T22:49:27.975 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-21T22:49:28.160 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-21T22:49:29.092 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-04-21T22:49:29.119 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../122-radosgw_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:29.160 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-04-21T22:49:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:30.061 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:30.390 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-mirror. 2024-04-21T22:49:30.418 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:30.456 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:30.858 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-nbd. 2024-04-21T22:49:30.874 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:30.917 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-nbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:31.161 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-21T22:49:31.177 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:31.219 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:38.856 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-21T22:49:38.884 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:38.922 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:39.425 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-21T22:49:39.441 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:40.019 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:40.020 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-21T22:49:40.020 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:40.020 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:40.023 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2-dbg. 2024-04-21T22:49:40.040 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:40.085 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:40.552 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-21T22:49:40.580 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:40.620 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:41.167 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-21T22:49:41.183 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:41.225 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:41.288 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-21T22:49:41.304 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:41.337 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:41.627 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-21T22:49:41.643 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:41.686 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:42.972 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-21T22:49:42.999 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:43.038 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:43.132 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-21T22:49:43.159 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:43.198 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:45.007 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-21T22:49:45.023 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:45.057 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:48.551 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-21T22:49:48.570 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:48.609 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:48.718 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-21T22:49:48.734 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:48.778 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:49.054 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-21T22:49:49.081 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:49.120 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-mirror-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:50.330 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-21T22:49:50.346 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:49:50.388 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-nbd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:50.761 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-21T22:49:51.019 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T22:49:51.145 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T22:49:51.411 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-21T22:49:51.763 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-21T22:49:52.201 INFO:teuthology.orchestra.run.smithi110.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-21T22:49:52.439 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:52.972 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2024-04-21T22:49:53.112 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T22:49:53.404 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-21T22:49:53.664 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-21T22:49:53.790 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-21T22:49:54.050 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-21T22:49:54.309 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T22:49:54.435 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-21T22:49:54.737 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T22:49:55.096 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-21T22:49:55.348 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-21T22:49:55.582 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-21T22:49:55.900 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-21T22:49:56.160 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-21T22:49:56.411 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-21T22:49:56.755 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-21T22:49:56.997 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:49:57.239 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T22:49:57.341 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T22:49:57.475 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-21T22:49:57.734 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T22:49:57.869 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-21T22:49:58.111 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-21T22:49:58.485 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-21T22:49:58.518 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-21T22:49:58.581 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T22:49:58.707 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-21T22:49:59.075 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T22:49:59.201 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-21T22:49:59.469 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T22:49:59.728 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-21T22:50:00.009 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-21T22:50:00.036 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:00.046 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up zip (3.0-12build2) ... 2024-04-21T22:50:00.075 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T22:50:00.444 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2-dbg. 2024-04-21T22:50:00.461 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:00.494 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:00.816 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T22:50:01.075 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T22:50:01.201 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-21T22:50:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T22:50:01.572 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-21T22:50:01.595 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:01.611 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-21T22:50:01.638 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:01.996 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-21T22:50:02.033 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-21T22:50:02.060 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:02.099 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:02.231 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T22:50:02.599 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T22:50:02.884 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-21T22:50:03.193 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T22:50:03.285 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-21T22:50:03.298 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:03.326 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:03.528 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-21T22:50:03.762 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-21T22:50:03.880 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:04.156 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-idna (3.3-1) ... 2024-04-21T22:50:04.465 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T22:50:05.204 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-21T22:50:05.228 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:05.270 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:05.638 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T22:50:05.848 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:50:05.957 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-21T22:50:06.225 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T22:50:06.351 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-21T22:50:06.477 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T22:50:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-21T22:50:07.013 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-21T22:50:07.255 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:50:07.356 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-21T22:50:07.649 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-21T22:50:07.909 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-21T22:50:08.185 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-21T22:50:08.428 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-21T22:50:08.679 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-21T22:50:08.690 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-21T22:50:08.718 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:08.757 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:08.946 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T22:50:09.034 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-21T22:50:09.062 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:09.072 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-21T22:50:09.100 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-mirror-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:09.357 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T22:50:09.483 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T22:50:09.784 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-21T22:50:10.094 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-21T22:50:10.286 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-21T22:50:10.302 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-2405-g820a2f8c-1jammy_amd64.deb ... 2024-04-21T22:50:10.336 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-nbd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:10.344 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T22:50:10.454 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-21T22:50:10.563 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T22:50:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-21T22:50:10.659 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-21T22:50:10.881 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T22:50:10.917 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T22:50:10.982 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T22:50:11.043 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T22:50:11.296 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-21T22:50:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-21T22:50:11.601 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-21T22:50:11.644 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-21T22:50:11.770 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-21T22:50:12.021 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-21T22:50:12.029 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:50:12.095 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:12.146 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T22:50:12.464 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T22:50:12.612 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-04-21T22:50:12.757 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T22:50:12.768 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T22:50:13.033 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-21T22:50:13.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-21T22:50:13.245 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-21T22:50:13.296 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-21T22:50:13.422 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-21T22:50:13.513 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-21T22:50:13.681 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-21T22:50:13.764 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T22:50:13.941 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T22:50:14.007 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-21T22:50:14.050 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-21T22:50:14.352 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T22:50:14.359 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-21T22:50:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T22:50:14.737 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-21T22:50:14.996 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-21T22:50:15.004 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T22:50:15.105 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:15.206 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:15.256 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-21T22:50:15.307 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-21T22:50:15.524 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-21T22:50:15.635 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:15.763 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:15.809 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-21T22:50:15.887 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-21T22:50:16.068 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-21T22:50:16.172 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:16.272 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:16.328 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-21T22:50:16.390 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:16.491 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:16.617 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:16.704 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:16.827 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T22:50:16.827 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T22:50:16.963 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T22:50:17.098 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T22:50:17.224 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-21T22:50:17.285 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:17.428 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:17.467 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T22:50:17.554 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:17.592 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-21T22:50:17.680 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:17.789 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:17.885 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-21T22:50:17.890 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-top (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:17.991 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T22:50:18.419 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-21T22:50:18.450 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-21T22:50:18.514 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T22:50:18.649 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-21T22:50:19.008 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T22:50:19.134 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-21T22:50:19.410 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T22:50:19.462 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:19.669 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-21T22:50:19.696 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:19.822 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:19.923 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:19.979 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up zip (3.0-12build2) ... 2024-04-21T22:50:20.024 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-nbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:20.105 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T22:50:20.125 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:20.243 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:20.369 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-nbd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:20.520 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-shell (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:20.646 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:20.772 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:20.790 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T22:50:21.025 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T22:50:21.151 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-21T22:50:21.264 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2024-04-21T22:50:21.277 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T22:50:21.570 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-21T22:50:21.641 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2024-04-21T22:50:21.750 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2024-04-21T22:50:21.765 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-21T22:50:21.908 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-21T22:50:21.954 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-21T22:50:22.203 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-21T22:50:22.205 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T22:50:22.574 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T22:50:22.690 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:22.850 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-21T22:50:22.877 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:50:22.877 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:50:23.151 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T22:50:23.366 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:23.492 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:23.503 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-21T22:50:23.787 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-21T22:50:23.913 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:23.956 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:50:23.956 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:50:24.200 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1) ... 2024-04-21T22:50:24.402 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:24.518 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T22:50:24.789 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-21T22:50:25.237 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:25.452 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T22:50:25.453 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T22:50:25.715 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T22:50:25.939 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:25.975 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:50:26.065 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:26.110 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-21T22:50:26.278 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:50:26.278 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:50:26.386 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T22:50:26.512 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-21T22:50:26.638 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T22:50:26.766 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:26.922 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-21T22:50:26.984 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T22:50:26.984 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T22:50:27.173 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-21T22:50:27.425 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:50:27.476 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:27.551 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-21T22:50:27.602 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:27.728 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:27.852 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-21T22:50:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:28.103 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-21T22:50:28.137 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T22:50:28.137 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T22:50:28.363 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-21T22:50:28.589 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:28.614 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-21T22:50:28.748 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:28.865 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-21T22:50:28.874 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-mirror-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:29.000 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:29.124 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T22:50:29.126 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:29.277 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:29.284 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-21T22:50:29.498 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T22:50:29.498 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T22:50:29.568 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T22:50:29.694 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T22:50:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-21T22:50:29.996 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:30.122 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:30.239 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:30.296 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-21T22:50:30.390 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:30.516 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-volume (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:30.547 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T22:50:30.673 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-21T22:50:30.808 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T22:50:30.877 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T22:50:30.897 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-21T22:50:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T22:50:31.143 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T22:50:31.155 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T22:50:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T22:50:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-21T22:50:31.930 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-21T22:50:32.056 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-21T22:50:32.206 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T22:50:32.315 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T22:50:32.450 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T22:50:32.768 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T22:50:32.985 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T22:50:32.988 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-21T22:50:33.068 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T22:50:33.090 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-04-21T22:50:33.290 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-04-21T22:50:33.290 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-04-21T22:50:33.353 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-21T22:50:33.485 INFO:teuthology.orchestra.run.smithi110.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-21T22:50:33.485 INFO:teuthology.orchestra.run.smithi110.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-21T22:50:33.485 INFO:teuthology.orchestra.run.smithi110.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-21T22:50:33.485 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:50:33.485 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:50:33.485 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:50:33.485 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:50:33.486 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T22:50:33.486 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T22:50:33.486 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:50:33.486 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-04-21T22:50:33.487 INFO:teuthology.orchestra.run.smithi110.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-21T22:50:33.487 INFO:teuthology.orchestra.run.smithi110.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-21T22:50:33.487 INFO:teuthology.orchestra.run.smithi110.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-21T22:50:33.487 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-21T22:50:33.488 INFO:teuthology.orchestra.run.smithi110.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T22:50:33.488 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-04-21T22:50:33.488 INFO:teuthology.orchestra.run.smithi110.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-21T22:50:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-21T22:50:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-21T22:50:33.530 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-04-21T22:50:33.531 INFO:teuthology.orchestra.run.smithi110.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-21T22:50:33.531 INFO:teuthology.orchestra.run.smithi110.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-21T22:50:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-21T22:50:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-21T22:50:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-21T22:50:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-21T22:50:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T22:50:33.533 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-04-21T22:50:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-21T22:50:33.564 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-21T22:50:33.615 INFO:teuthology.orchestra.run.smithi110.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-21T22:50:33.615 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 55.7 MB of archives. 2024-04-21T22:50:33.615 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-21T22:50:33.615 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-21T22:50:33.777 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-21T22:50:33.785 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-21T22:50:33.824 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-21T22:50:33.827 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-21T22:50:33.828 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-21T22:50:33.828 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-21T22:50:33.838 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-21T22:50:33.839 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-21T22:50:33.841 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-21T22:50:33.842 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-21T22:50:33.843 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-21T22:50:33.844 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-21T22:50:33.849 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-21T22:50:33.867 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-21T22:50:33.867 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-21T22:50:33.869 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-21T22:50:34.101 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T22:50:34.213 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-21T22:50:34.216 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-21T22:50:34.216 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-21T22:50:34.220 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-21T22:50:34.220 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-21T22:50:34.224 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-21T22:50:34.226 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-21T22:50:34.235 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-21T22:50:34.235 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-21T22:50:34.261 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-21T22:50:34.261 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-21T22:50:34.273 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-21T22:50:34.295 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-21T22:50:34.299 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-21T22:50:34.299 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-21T22:50:34.300 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-21T22:50:34.300 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-21T22:50:34.312 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-21T22:50:34.313 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-21T22:50:34.360 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-21T22:50:34.539 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-21T22:50:34.539 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-21T22:50:34.539 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-21T22:50:34.539 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-21T22:50:34.540 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-21T22:50:34.540 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-21T22:50:34.551 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-21T22:50:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-21T22:50:34.745 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-21T22:50:34.963 INFO:teuthology.orchestra.run.smithi110.stdout:Preconfiguring packages ... 2024-04-21T22:50:35.038 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T22:50:35.162 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 55.7 MB in 1s (55.1 MB/s) 2024-04-21T22:50:35.366 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T22:50:35.455 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174276 files and directories currently installed.) 2024-04-21T22:50:35.461 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T22:50:35.492 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:35.584 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T22:50:35.618 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:35.744 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-21T22:50:36.064 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:36.190 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:36.196 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-21T22:50:36.324 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-21T22:50:36.601 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:36.727 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:36.853 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:37.004 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:37.130 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:37.131 INFO:teuthology.orchestra.run.smithi110.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-21T22:50:37.340 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T22:50:37.340 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T22:50:37.388 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package flex. 2024-04-21T22:50:37.480 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174276 files and directories currently installed.) 2024-04-21T22:50:37.486 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-21T22:50:37.529 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-21T22:50:37.839 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:37.949 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:38.046 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T22:50:38.075 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:38.201 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:38.327 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:38.385 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-21T22:50:38.453 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-top (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:38.579 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T22:50:38.813 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T22:50:39.340 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174349 files and directories currently installed.) 2024-04-21T22:50:39.345 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T22:50:39.476 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T22:50:39.824 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:39.869 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T22:50:39.950 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.076 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.093 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T22:50:40.202 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.328 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-nbd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.454 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.462 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T22:50:40.571 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.713 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-nbd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.836 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package bison. 2024-04-21T22:50:40.840 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-shell (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:40.938 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174349 files and directories currently installed.) 2024-04-21T22:50:40.944 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-21T22:50:40.988 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T22:50:41.016 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:41.142 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:41.364 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-21T22:50:41.380 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-21T22:50:41.414 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T22:50:41.685 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-04-21T22:50:41.751 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package dump. 2024-04-21T22:50:41.778 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-21T22:50:41.817 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking dump (0.4b47-3) ... 2024-04-21T22:50:42.070 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-04-21T22:50:42.122 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package indent. 2024-04-21T22:50:42.149 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:50:42.188 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T22:50:42.222 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-04-21T22:50:42.240 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-21T22:50:42.376 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-21T22:50:42.441 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-21T22:50:42.457 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-21T22:50:42.491 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T22:50:42.708 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-21T22:50:42.812 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-21T22:50:42.840 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-21T22:50:42.878 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T22:50:43.165 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-21T22:50:43.181 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-21T22:50:43.193 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:43.223 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T22:50:43.402 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:50:43.403 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:50:43.501 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-21T22:50:43.527 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-21T22:50:43.568 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T22:50:43.829 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-21T22:50:43.846 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-21T22:50:43.878 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:43.887 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T22:50:44.004 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:44.140 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjson-perl. 2024-04-21T22:50:44.168 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-21T22:50:44.207 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-21T22:50:44.475 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:50:44.476 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:50:44.494 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-21T22:50:44.522 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-21T22:50:44.552 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T22:50:45.108 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:45.618 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-21T22:50:46.076 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:46.240 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-21T22:50:46.268 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T22:50:46.301 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T22:50:46.301 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T22:50:46.307 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:50:46.576 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-21T22:50:46.593 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T22:50:46.626 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:50:46.762 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:46.871 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-mirror (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:46.929 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-21T22:50:46.957 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T22:50:46.996 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:50:47.065 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:50:47.065 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:50:47.349 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-21T22:50:47.377 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-21T22:50:47.416 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T22:50:47.514 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:47.720 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T22:50:47.720 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T22:50:47.727 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-21T22:50:47.755 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T22:50:47.793 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T22:50:48.122 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-21T22:50:48.150 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:50:48.188 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:50:48.199 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:48.325 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:48.484 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:48.541 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-21T22:50:48.570 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:50:48.610 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:48.616 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:50:48.893 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T22:50:48.893 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T22:50:48.919 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-21T22:50:48.947 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:50:48.986 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:50:49.238 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-21T22:50:49.266 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T22:50:49.305 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T22:50:49.483 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:49.609 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:49.735 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-mirror-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:49.809 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-21T22:50:49.837 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-21T22:50:49.860 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:49.875 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T22:50:49.978 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:50.130 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:50.342 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T22:50:50.343 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T22:50:50.647 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package modemmanager. 2024-04-21T22:50:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T22:50:50.838 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:50:50.847 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:51.007 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:51.133 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:51.284 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon-dbg (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:51.410 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (19.0.0-2405-g820a2f8c-1jammy) ... 2024-04-21T22:50:51.495 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager. 2024-04-21T22:50:51.524 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T22:50:51.571 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-21T22:50:52.021 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T22:50:52.122 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T22:50:52.230 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ppp. 2024-04-21T22:50:52.257 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-21T22:50:52.316 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T22:50:52.529 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T22:50:52.817 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pptp-linux. 2024-04-21T22:50:52.845 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-21T22:50:52.883 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-21T22:50:53.136 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-21T22:50:53.164 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-21T22:50:53.228 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-21T22:50:53.434 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T22:50:53.531 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-21T22:50:53.559 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-21T22:50:53.598 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-common (238) ... 2024-04-21T22:50:53.852 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-21T22:50:53.879 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:50:53.910 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:50:54.105 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T22:50:54.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-21T22:50:54.162 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-21T22:50:54.371 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-21T22:50:54.372 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-21T22:50:54.507 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-common. 2024-04-21T22:50:54.535 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-21T22:50:54.560 INFO:teuthology.orchestra.run.smithi154.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-21T22:50:54.561 INFO:teuthology.orchestra.run.smithi154.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-21T22:50:54.561 INFO:teuthology.orchestra.run.smithi154.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-21T22:50:54.561 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T22:50:54.561 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T22:50:54.561 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T22:50:54.561 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T22:50:54.562 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T22:50:54.562 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T22:50:54.562 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T22:50:54.562 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-04-21T22:50:54.562 INFO:teuthology.orchestra.run.smithi154.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-21T22:50:54.563 INFO:teuthology.orchestra.run.smithi154.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-21T22:50:54.563 INFO:teuthology.orchestra.run.smithi154.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-21T22:50:54.563 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-21T22:50:54.563 INFO:teuthology.orchestra.run.smithi154.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T22:50:54.564 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-04-21T22:50:54.564 INFO:teuthology.orchestra.run.smithi154.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-21T22:50:54.564 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-21T22:50:54.565 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-21T22:50:54.593 INFO:teuthology.orchestra.run.smithi110.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-21T22:50:54.604 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-04-21T22:50:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-21T22:50:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-21T22:50:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-21T22:50:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-21T22:50:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-21T22:50:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-21T22:50:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T22:50:54.607 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-04-21T22:50:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-21T22:50:54.630 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-common (238) ... 2024-04-21T22:50:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-21T22:50:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 55.7 MB of archives. 2024-04-21T22:50:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-21T22:50:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-21T22:50:55.039 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-14. 2024-04-21T22:50:55.068 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:50:55.109 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:50:55.418 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-21T22:50:55.435 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-21T22:50:55.560 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-21T22:50:55.561 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-21T22:50:55.562 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-21T22:50:55.590 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-21T22:50:55.592 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-21T22:50:55.595 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-21T22:50:55.601 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-21T22:50:55.602 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-21T22:50:55.768 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-21T22:50:56.061 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-21T22:50:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-21T22:50:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-21T22:50:56.161 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-21T22:50:56.410 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql. 2024-04-21T22:50:56.427 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-21T22:50:56.460 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql (14+238) ... 2024-04-21T22:50:56.704 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client. 2024-04-21T22:50:56.732 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-21T22:50:56.770 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client (14+238) ... 2024-04-21T22:50:57.023 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-21T22:50:57.039 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-21T22:50:57.081 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-21T22:50:57.247 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-21T22:50:57.252 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-21T22:50:57.252 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-21T22:50:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-21T22:50:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-21T22:50:57.270 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-21T22:50:57.400 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl8.6. 2024-04-21T22:50:57.429 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-21T22:50:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-21T22:50:57.467 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T22:50:57.703 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl. 2024-04-21T22:50:57.719 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-21T22:50:57.766 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-21T22:50:58.032 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-21T22:50:58.033 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-21T22:50:58.126 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package wpasupplicant. 2024-04-21T22:50:58.151 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-21T22:50:58.189 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T22:50:58.213 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-21T22:50:58.214 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-21T22:50:58.253 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-21T22:50:58.315 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-21T22:50:58.322 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-21T22:50:58.323 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-21T22:50:58.324 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-21T22:50:58.325 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-21T22:50:58.531 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-21T22:50:58.569 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-21T22:50:58.586 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-21T22:50:58.627 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-21T22:50:58.943 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-21T22:50:59.005 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-21T22:50:59.033 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-21T22:50:59.089 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T22:50:59.427 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-common (238) ... 2024-04-21T22:50:59.636 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-21T22:50:59.763 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T22:50:59.769 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-21T22:50:59.770 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-21T22:50:59.770 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-21T22:50:59.770 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-21T22:50:59.771 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-21T22:50:59.771 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-21T22:50:59.796 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-21T22:50:59.797 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-21T22:50:59.881 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:50:59.990 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T22:51:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T22:51:00.204 INFO:teuthology.orchestra.run.smithi154.stdout:Preconfiguring packages ... 2024-04-21T22:51:00.242 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:00.342 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-04-21T22:51:00.664 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174276 files and directories currently installed.) 2024-04-21T22:51:00.670 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T22:51:00.757 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-21T22:51:00.823 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T22:51:00.840 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T22:51:01.220 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T22:51:01.221 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T22:51:01.446 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-21T22:51:01.743 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T22:51:01.894 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T22:51:02.021 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T22:51:02.138 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-21T22:51:02.240 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T22:51:02.357 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T22:51:02.373 INFO:teuthology.orchestra.run.smithi154.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-21T22:51:02.484 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T22:51:02.596 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package flex. 2024-04-21T22:51:02.609 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T22:51:02.690 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174276 files and directories currently installed.) 2024-04-21T22:51:02.695 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-21T22:51:02.736 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-21T22:51:03.215 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T22:51:03.246 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T22:51:03.341 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up dump (0.4b47-3) ... 2024-04-21T22:51:03.417 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-21T22:51:03.451 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-21T22:51:03.610 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:51:03.736 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T22:51:03.853 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T22:51:03.862 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-21T22:51:03.988 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-21T22:51:04.114 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T22:51:04.196 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-21T22:51:04.257 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T22:51:04.383 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T22:51:04.399 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174349 files and directories currently installed.) 2024-04-21T22:51:04.404 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T22:51:04.525 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T22:51:04.560 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T22:51:04.686 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:51:04.812 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-21T22:51:04.951 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T22:51:04.980 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client (14+238) ... 2024-04-21T22:51:05.073 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T22:51:05.098 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-21T22:51:05.400 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T22:51:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:05.526 INFO:teuthology.orchestra.run.smithi110.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-21T22:51:05.526 INFO:teuthology.orchestra.run.smithi110.stdout:which means they are currently configured by ifupdown: 2024-04-21T22:51:05.526 INFO:teuthology.orchestra.run.smithi110.stdout:- enp3s0f1 2024-04-21T22:51:05.526 INFO:teuthology.orchestra.run.smithi110.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-21T22:51:05.526 INFO:teuthology.orchestra.run.smithi110.stdout:remove their configuration from /etc/network/interfaces. 2024-04-21T22:51:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:05.656 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-21T22:51:05.766 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package bison. 2024-04-21T22:51:05.870 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174349 files and directories currently installed.) 2024-04-21T22:51:05.876 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-21T22:51:05.918 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T22:51:05.983 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-21T22:51:06.302 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-21T22:51:06.314 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-21T22:51:06.330 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-21T22:51:06.369 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T22:51:06.705 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package dump. 2024-04-21T22:51:06.733 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-21T22:51:06.772 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking dump (0.4b47-3) ... 2024-04-21T22:51:06.884 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:51:07.027 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T22:51:07.050 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package indent. 2024-04-21T22:51:07.067 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:51:07.109 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T22:51:07.153 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-21T22:51:07.279 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-common (238) ... 2024-04-21T22:51:07.353 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-21T22:51:07.377 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-21T22:51:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T22:51:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-21T22:51:07.810 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-21T22:51:07.849 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T22:51:08.110 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-21T22:51:08.126 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-21T22:51:08.168 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T22:51:08.172 INFO:teuthology.orchestra.run.smithi110.stdout:Adding user postgres to group ssl-cert 2024-04-21T22:51:08.406 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:08.406 INFO:teuthology.orchestra.run.smithi110.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-21T22:51:08.472 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-21T22:51:08.499 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-21T22:51:08.538 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T22:51:08.608 INFO:teuthology.orchestra.run.smithi110.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-21T22:51:08.608 INFO:teuthology.orchestra.run.smithi110.stdout:Removing obsolete dictionary files: 2024-04-21T22:51:08.750 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-21T22:51:08.765 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-21T22:51:08.799 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T22:51:09.052 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjson-perl. 2024-04-21T22:51:09.080 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-21T22:51:09.119 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-21T22:51:09.186 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-21T22:51:09.430 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-21T22:51:09.458 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-21T22:51:09.497 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T22:51:09.591 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:09.917 INFO:teuthology.orchestra.run.smithi110.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-21T22:51:09.938 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-21T22:51:09.990 INFO:teuthology.orchestra.run.smithi110.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-21T22:51:09.990 INFO:teuthology.orchestra.run.smithi110.stdout:This user must also own the server process. 2024-04-21T22:51:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:09.990 INFO:teuthology.orchestra.run.smithi110.stdout:The database cluster will be initialized with locale "en_US". 2024-04-21T22:51:09.990 INFO:teuthology.orchestra.run.smithi110.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-21T22:51:09.990 INFO:teuthology.orchestra.run.smithi110.stdout:The default text search configuration will be set to "english". 2024-04-21T22:51:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:09.991 INFO:teuthology.orchestra.run.smithi110.stdout:Data page checksums are disabled. 2024-04-21T22:51:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:09.991 INFO:teuthology.orchestra.run.smithi110.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-21T22:51:09.991 INFO:teuthology.orchestra.run.smithi110.stdout:creating subdirectories ... ok 2024-04-21T22:51:09.991 INFO:teuthology.orchestra.run.smithi110.stdout:selecting dynamic shared memory implementation ... posix 2024-04-21T22:51:10.007 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default max_connections ... 100 2024-04-21T22:51:10.028 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default shared_buffers ... 128MB 2024-04-21T22:51:10.042 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default time zone ... Etc/UTC 2024-04-21T22:51:10.043 INFO:teuthology.orchestra.run.smithi110.stdout:creating configuration files ... ok 2024-04-21T22:51:10.159 INFO:teuthology.orchestra.run.smithi110.stdout:running bootstrap script ... ok 2024-04-21T22:51:10.968 INFO:teuthology.orchestra.run.smithi110.stdout:performing post-bootstrap initialization ... ok 2024-04-21T22:51:11.168 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-21T22:51:11.195 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T22:51:11.226 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:51:11.520 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-21T22:51:11.548 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T22:51:11.587 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:51:11.670 INFO:teuthology.orchestra.run.smithi110.stdout:syncing data to disk ... ok 2024-04-21T22:51:11.923 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-21T22:51:11.950 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T22:51:11.989 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:51:12.026 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-21T22:51:12.293 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-21T22:51:12.321 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-21T22:51:12.359 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T22:51:12.687 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-21T22:51:12.715 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T22:51:12.754 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T22:51:13.099 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-21T22:51:13.126 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:51:13.174 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:13.560 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-21T22:51:13.588 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:51:13.677 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:51:13.979 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-21T22:51:14.007 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:51:14.046 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:51:14.289 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-21T22:51:14.306 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T22:51:14.348 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T22:51:14.805 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:51:14.852 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-21T22:51:14.880 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-21T22:51:14.916 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-21T22:51:14.918 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T22:51:15.026 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql (14+238) ... 2024-04-21T22:51:15.152 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:51:15.278 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:51:15.297 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package modemmanager. 2024-04-21T22:51:15.324 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T22:51:15.363 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:51:15.530 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T22:51:15.530 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T22:51:15.989 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager. 2024-04-21T22:51:16.017 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T22:51:16.055 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T22:51:16.063 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-21T22:51:16.156 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-21T22:51:16.459 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T22:51:16.603 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T22:51:16.663 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ppp. 2024-04-21T22:51:16.691 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-21T22:51:16.955 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T22:51:17.277 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pptp-linux. 2024-04-21T22:51:17.304 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-21T22:51:17.344 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-21T22:51:17.596 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-21T22:51:17.624 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-21T22:51:17.662 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-21T22:51:17.957 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-21T22:51:17.985 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-21T22:51:18.024 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-common (238) ... 2024-04-21T22:51:18.081 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-21T22:51:18.189 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T22:51:18.336 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-21T22:51:18.364 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:51:18.403 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:18.644 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T22:51:18.649 DEBUG:teuthology.parallel:result is None 2024-04-21T22:51:18.991 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-common. 2024-04-21T22:51:19.019 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-21T22:51:19.069 INFO:teuthology.orchestra.run.smithi154.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-21T22:51:19.088 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-common (238) ... 2024-04-21T22:51:19.582 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-14. 2024-04-21T22:51:19.610 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T22:51:19.652 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:21.002 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql. 2024-04-21T22:51:21.031 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-21T22:51:21.068 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql (14+238) ... 2024-04-21T22:51:21.313 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client. 2024-04-21T22:51:21.341 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-21T22:51:21.379 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client (14+238) ... 2024-04-21T22:51:21.631 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-21T22:51:21.649 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-21T22:51:21.689 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-21T22:51:21.967 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl8.6. 2024-04-21T22:51:21.995 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-21T22:51:22.025 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T22:51:22.304 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl. 2024-04-21T22:51:22.332 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-21T22:51:22.375 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-21T22:51:23.231 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package wpasupplicant. 2024-04-21T22:51:23.260 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-21T22:51:23.298 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T22:51:23.686 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-21T22:51:23.702 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-21T22:51:23.744 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-21T22:51:24.105 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-21T22:51:24.134 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-21T22:51:24.180 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T22:51:24.468 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-common (238) ... 2024-04-21T22:51:24.670 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-21T22:51:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T22:51:24.922 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:25.048 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T22:51:25.174 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T22:51:25.300 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:25.805 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-21T22:51:25.880 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T22:51:26.260 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T22:51:26.260 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T22:51:26.742 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T22:51:26.885 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T22:51:27.011 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T22:51:27.153 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-21T22:51:27.280 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T22:51:27.405 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T22:51:27.531 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T22:51:27.657 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T22:51:28.680 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T22:51:28.806 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up dump (0.4b47-3) ... 2024-04-21T22:51:28.974 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-21T22:51:29.042 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:51:29.167 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T22:51:29.309 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-21T22:51:29.427 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-21T22:51:29.545 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T22:51:29.635 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-21T22:51:29.705 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T22:51:29.831 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T22:51:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T22:51:30.133 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:51:30.259 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-21T22:51:30.420 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client (14+238) ... 2024-04-21T22:51:30.520 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-21T22:51:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:31.027 INFO:teuthology.orchestra.run.smithi154.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-21T22:51:31.027 INFO:teuthology.orchestra.run.smithi154.stdout:which means they are currently configured by ifupdown: 2024-04-21T22:51:31.027 INFO:teuthology.orchestra.run.smithi154.stdout:- enp3s0f1 2024-04-21T22:51:31.027 INFO:teuthology.orchestra.run.smithi154.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-21T22:51:31.027 INFO:teuthology.orchestra.run.smithi154.stdout:remove their configuration from /etc/network/interfaces. 2024-04-21T22:51:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:31.138 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-21T22:51:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-21T22:51:31.781 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-21T22:51:32.281 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T22:51:32.433 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T22:51:32.559 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-21T22:51:32.693 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-common (238) ... 2024-04-21T22:51:33.577 INFO:teuthology.orchestra.run.smithi154.stdout:Adding user postgres to group ssl-cert 2024-04-21T22:51:33.827 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:33.828 INFO:teuthology.orchestra.run.smithi154.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-21T22:51:34.003 INFO:teuthology.orchestra.run.smithi154.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-21T22:51:34.004 INFO:teuthology.orchestra.run.smithi154.stdout:Removing obsolete dictionary files: 2024-04-21T22:51:34.557 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-21T22:51:34.954 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T22:51:35.274 INFO:teuthology.orchestra.run.smithi154.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-21T22:51:35.289 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-21T22:51:35.338 INFO:teuthology.orchestra.run.smithi154.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-21T22:51:35.338 INFO:teuthology.orchestra.run.smithi154.stdout:This user must also own the server process. 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:The database cluster will be initialized with locale "en_US". 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:The default text search configuration will be set to "english". 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:Data page checksums are disabled. 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:creating subdirectories ... ok 2024-04-21T22:51:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:selecting dynamic shared memory implementation ... posix 2024-04-21T22:51:35.354 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default max_connections ... 100 2024-04-21T22:51:35.371 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default shared_buffers ... 128MB 2024-04-21T22:51:35.380 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default time zone ... Etc/UTC 2024-04-21T22:51:35.381 INFO:teuthology.orchestra.run.smithi154.stdout:creating configuration files ... ok 2024-04-21T22:51:35.489 INFO:teuthology.orchestra.run.smithi154.stdout:running bootstrap script ... ok 2024-04-21T22:51:36.146 INFO:teuthology.orchestra.run.smithi154.stdout:performing post-bootstrap initialization ... ok 2024-04-21T22:51:36.865 INFO:teuthology.orchestra.run.smithi154.stdout:syncing data to disk ... ok 2024-04-21T22:51:37.246 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-21T22:51:40.019 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:51:40.145 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-21T22:51:40.270 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql (14+238) ... 2024-04-21T22:51:40.405 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T22:51:40.531 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T22:51:40.786 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T22:51:40.786 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T22:51:41.350 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T22:51:41.443 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-21T22:51:41.762 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T22:51:41.905 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T22:51:43.217 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-21T22:51:43.317 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T22:51:43.815 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T22:51:43.820 DEBUG:teuthology.parallel:result is None 2024-04-21T22:51:43.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:51:44.043 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2024-04-21T22:51:44.062 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:51:44.063 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:51:44.063 INFO:teuthology.task.install:The correct ceph version 19.0.0-2405-g820a2f8c-1jammy is installed. 2024-04-21T22:51:44.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:51:44.200 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-04-21T22:51:44.219 INFO:teuthology.orchestra.run.smithi154.stdout:19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:51:44.220 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2405-g820a2f8c-1jammy 2024-04-21T22:51:44.220 INFO:teuthology.task.install:The correct ceph version 19.0.0-2405-g820a2f8c-1jammy is installed. 2024-04-21T22:51:44.222 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-21T22:51:44.222 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:44.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T22:51:44.236 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:44.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T22:51:44.273 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-21T22:51:44.273 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:44.273 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T22:51:44.292 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T22:51:44.347 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:44.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T22:51:44.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T22:51:44.416 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-21T22:51:44.417 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:44.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T22:51:44.430 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T22:51:44.483 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:44.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T22:51:44.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T22:51:44.552 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-21T22:51:44.552 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:44.552 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T22:51:44.565 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T22:51:44.619 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:44.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T22:51:44.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T22:51:44.688 INFO:teuthology.run_tasks:Running task ceph... 2024-04-21T22:51:44.772 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-21T22:51:44.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-04-21T22:51:44.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-04-21T22:51:44.788 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-21T22:51:44.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-21T22:51:44.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-21T22:51:44.843 INFO:tasks.ceph:Creating extra log directories... 2024-04-21T22:51:44.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-21T22:51:44.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-21T22:51:44.905 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-21T22:51:44.905 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-21T22:51:44.905 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-21T22:51:44.905 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:44.906 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-21T22:51:44.945 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-21T22:51:45.022 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:45.023 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-21T22:51:45.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-21T22:51:45.110 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-21T22:51:45.110 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-21T22:51:45.110 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565', 'branch': 'squid', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/fsstress validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7667565', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '430e09df97c8fc7dc2b2ae424f68ed11366c540f'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 676, 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'sleep_before_teardown': 0, 'subset': '46/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '430e09df97c8fc7dc2b2ae424f68ed11366c540f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAYLhHPaMCkV3T08Pozmj+2JCrLSjQ+bFMvY0UiJot7pDHdauDC6mn6ULbS2PBCvxQAXZVeogxkVMcHs4i2ut8s=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxlERhlpHunrYThHrnrhMAhRqrN+rq0V6FKLncqVuRCVCYV5A/0beJwUrRg4PLa4LNmQDJV/4YxFHNHAkA61qU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-21_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-21T22:51:45.111 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-21T22:51:45.114 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-21T22:51:45.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-04-21T22:51:45.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-04-21T22:51:45.209 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:45.209 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T22:51:45.221 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T22:51:45.221 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-21 22:40:22.077837512 +0000 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-21 22:40:22.073837547 +0000 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-21 22:40:22.073837547 +0000 2024-04-21T22:51:45.269 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-04-21T22:51:45.270 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T22:51:45.323 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-21T22:51:45.323 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-21T22:51:45.323 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000257011 s, 2.0 MB/s 2024-04-21T22:51:45.324 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T22:51:45.374 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-04-21T22:51:45.420 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T22:51:45.421 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:45.421 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-04-21T22:51:45.421 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:45.421 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-21 22:40:22.577833046 +0000 2024-04-21T22:51:45.421 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-21 22:40:22.573833082 +0000 2024-04-21T22:51:45.421 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-21 22:40:22.573833082 +0000 2024-04-21T22:51:45.421 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-04-21T22:51:45.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T22:51:45.474 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-21T22:51:45.474 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-21T22:51:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000253226 s, 2.0 MB/s 2024-04-21T22:51:45.476 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T22:51:45.526 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-04-21T22:51:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T22:51:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:45.573 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-04-21T22:51:45.573 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:45.573 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-21 22:40:23.325826365 +0000 2024-04-21T22:51:45.573 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-21 22:40:23.077828580 +0000 2024-04-21T22:51:45.573 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-21 22:40:23.077828580 +0000 2024-04-21T22:51:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-04-21T22:51:45.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T22:51:45.626 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-21T22:51:45.627 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-21T22:51:45.627 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000305315 s, 1.7 MB/s 2024-04-21T22:51:45.628 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T22:51:45.678 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-21 22:40:23.789822220 +0000 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-21 22:40:23.545824400 +0000 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-21 22:40:23.545824400 +0000 2024-04-21T22:51:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-04-21T22:51:45.726 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T22:51:45.779 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-21T22:51:45.779 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-21T22:51:45.779 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000314751 s, 1.6 MB/s 2024-04-21T22:51:45.780 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T22:51:45.830 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T22:51:45.830 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:45.830 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T22:51:45.836 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T22:51:45.836 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 873 Links: 1 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-21 22:40:22.350259424 +0000 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-21 22:40:22.106261603 +0000 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-21 22:40:22.106261603 +0000 2024-04-21T22:51:45.886 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-21T22:51:45.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T22:51:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-21T22:51:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-21T22:51:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000446309 s, 1.1 MB/s 2024-04-21T22:51:45.942 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T22:51:45.991 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-21 22:40:22.862254851 +0000 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-21 22:40:22.598257209 +0000 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-21 22:40:22.598257209 +0000 2024-04-21T22:51:46.038 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-21T22:51:46.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T22:51:46.091 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-21T22:51:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-21T22:51:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000412204 s, 1.2 MB/s 2024-04-21T22:51:46.093 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T22:51:46.142 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-04-21T22:51:46.189 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T22:51:46.189 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:46.189 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-04-21T22:51:46.190 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:46.190 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-21 22:40:23.406249992 +0000 2024-04-21T22:51:46.190 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-21 22:40:23.126252492 +0000 2024-04-21T22:51:46.190 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-21 22:40:23.126252492 +0000 2024-04-21T22:51:46.190 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-21T22:51:46.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T22:51:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-21T22:51:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-21T22:51:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000413403 s, 1.2 MB/s 2024-04-21T22:51:46.245 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T22:51:46.294 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-04-21T22:51:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T22:51:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:51:46.342 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-04-21T22:51:46.342 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:51:46.342 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-21 22:40:23.926245347 +0000 2024-04-21T22:51:46.342 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-21 22:40:23.682247527 +0000 2024-04-21T22:51:46.342 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-21 22:40:23.682247527 +0000 2024-04-21T22:51:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-21T22:51:46.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T22:51:46.395 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-21T22:51:46.395 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-21T22:51:46.395 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000378946 s, 1.4 MB/s 2024-04-21T22:51:46.397 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T22:51:46.446 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T22:51:46.447 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-21T22:51:46.447 INFO:tasks.ceph:Generating config... 2024-04-21T22:51:46.448 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-21T22:51:46.448 INFO:tasks.ceph:[client] debug client = 20 2024-04-21T22:51:46.448 INFO:tasks.ceph:[client] debug ms = 1 2024-04-21T22:51:46.448 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-21T22:51:46.448 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-21T22:51:46.448 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-04-21T22:51:46.448 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-04-21T22:51:46.448 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-21T22:51:46.449 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-21T22:51:46.450 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-21T22:51:46.450 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-21T22:51:46.450 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-21T22:51:46.450 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-21T22:51:46.450 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-21T22:51:46.450 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-21T22:51:46.450 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-21T22:51:46.450 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-21T22:51:46.450 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-21T22:51:46.450 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-21T22:51:46.450 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-21T22:51:46.450 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-21T22:51:46.450 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-21T22:51:46.450 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-21T22:51:46.451 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-21T22:51:46.451 INFO:tasks.ceph:Setting up mon.a... 2024-04-21T22:51:46.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-21T22:51:46.485 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.keyring 2024-04-21T22:51:46.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-21T22:51:46.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-21T22:51:46.627 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.110'), ('mon.b', '172.21.15.154'), ('mon.c', '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]')] 2024-04-21T22:51:46.627 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.110,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-21T22:51:46.628 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:46.628 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-21T22:51:46.673 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.110 --add b 172.21.15.154 --addv c '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: generated fsid 937714ee-3114-4e7a-bad0-9e54f3261824 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = quincy 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 0 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:fsid 937714ee-3114-4e7a-bad0-9e54f3261824 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:last_changed 2024-04-21T22:51:46.761784+0000 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-04-21T22:51:46.761784+0000 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:min_mon_release 17 (quincy) 2024-04-21T22:51:46.759 INFO:teuthology.orchestra.run.smithi110.stdout:election_strategy: 1 2024-04-21T22:51:46.760 INFO:teuthology.orchestra.run.smithi110.stdout:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-21T22:51:46.760 INFO:teuthology.orchestra.run.smithi110.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-04-21T22:51:46.760 INFO:teuthology.orchestra.run.smithi110.stdout:2: [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] mon.c 2024-04-21T22:51:46.760 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-21T22:51:46.761 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-21T22:51:46.808 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 937714ee-3114-4e7a-bad0-9e54f3261824... 2024-04-21T22:51:46.809 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-21T22:51:46.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-21T22:51:46.882 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-04-21T22:51:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-04-21T22:51:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-21T22:51:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-04-21T22:51:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-21T22:51:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.110,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: mds beacon grace = 60 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: mds heartbeat grace = 60 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: osd heartbeat grace = 60 2024-04-21T22:51:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 937714ee-3114-4e7a-bad0-9e54f3261824 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-04-21T22:51:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression mode = aggressive 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-04-21T22:51:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: osd fast shutdown = False 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.889 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-21T22:51:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon down mkfs grace = 300 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd crush smoke test = False 2024-04-21T22:51:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:51:46.892 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-04-21T22:51:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-04-21T22:51:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-04-21T22:51:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-04-21T22:51:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2024-04-21T22:51:46.893 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: mds valgrind exit = True 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-04-21T22:51:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-04-21T22:51:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-04-21T22:51:46.896 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-21T22:51:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-21T22:51:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-21T22:51:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-21T22:51:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.110,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2024-04-21T22:51:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: mds beacon grace = 60 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: mds heartbeat grace = 60 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: osd heartbeat grace = 60 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 937714ee-3114-4e7a-bad0-9e54f3261824 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-21T22:51:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-21T22:51:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore compression mode = aggressive 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 20 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 20 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-21T22:51:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 10 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: osd fast shutdown = False 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-21T22:51:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-21T22:51:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-21T22:51:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd crush smoke test = False 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-21T22:51:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.e] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.f] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-04-21T22:51:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: mds valgrind exit = True 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-21T22:51:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-21T22:51:46.908 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-21T22:51:46.908 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-21T22:51:46.988 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-21T22:51:46.989 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:46.989 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-21T22:51:46.993 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:46.994 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-21T22:51:47.042 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-04-21T22:51:47.043 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:47.043 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-21T22:51:47.043 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-21T22:51:47.103 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:51:47.103 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:47.152 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-04-21T22:51:47.152 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:47.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-21T22:51:47.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-21T22:51:47.176 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:51:47.176 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:47.221 INFO:tasks.ceph:Setting up mon nodes... 2024-04-21T22:51:47.221 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-21T22:51:47.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-21T22:51:47.266 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-21T22:51:47.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-21T22:51:47.313 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-21T22:51:47.327 INFO:tasks.ceph:Setting up mds nodes... 2024-04-21T22:51:47.327 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-21T22:51:47.367 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-21T22:51:47.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-21T22:51:47.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-21T22:51:47.506 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-21T22:51:47.508 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-21T22:51:47.564 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-21T22:51:47.647 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-21T22:51:47.649 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-21T22:51:47.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-21T22:51:47.750 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-21T22:51:47.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-21T22:51:47.808 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-21T22:51:47.891 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-21T22:51:47.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-21T22:51:47.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-21T22:51:48.029 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-21T22:51:48.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-21T22:51:48.087 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-21T22:51:48.087 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-21T22:51:48.123 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-21T22:51:48.133 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-21T22:51:48.133 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-21T22:51:48.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-21T22:51:48.187 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T22:51:48.187 INFO:tasks.ceph:role: osd.0 2024-04-21T22:51:48.187 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-21T22:51:48.187 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-21T22:51:48.240 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:51:48.241 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:51:48.265 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-04-21T22:51:48.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-04-21T22:51:48.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-21T22:51:48.322 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-21T22:51:48.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:51:48.373 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:51:48.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-21T22:51:48.430 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T22:51:48.430 INFO:tasks.ceph:role: osd.1 2024-04-21T22:51:48.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-21T22:51:48.430 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-21T22:51:48.484 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:51:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:51:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:51:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:51:48.484 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:51:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:51:48.485 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:51:48.485 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:51:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:51:48.485 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:51:48.508 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-04-21T22:51:48.509 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-04-21T22:51:48.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-21T22:51:48.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-21T22:51:48.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:51:48.621 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:51:48.622 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-21T22:51:48.674 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T22:51:48.674 INFO:tasks.ceph:role: osd.2 2024-04-21T22:51:48.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-21T22:51:48.674 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:51:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:51:48.752 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-04-21T22:51:48.754 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-04-21T22:51:48.754 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-21T22:51:48.812 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-21T22:51:48.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:51:48.867 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:51:48.867 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-21T22:51:48.920 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T22:51:48.920 INFO:tasks.ceph:role: osd.3 2024-04-21T22:51:48.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-21T22:51:48.920 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-21T22:51:48.980 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:51:48.980 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:51:48.980 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:51:48.980 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:51:48.980 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:51:48.980 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:51:48.980 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:51:48.981 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:51:48.981 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:51:48.981 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:51:49.003 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-04-21T22:51:49.005 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-04-21T22:51:49.006 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-21T22:51:49.064 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-21T22:51:49.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:51:49.118 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:51:49.119 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:49.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:49.327+0000 7f7b06e997c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-21T22:51:49.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:49.327+0000 7f7b06e997c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-21T22:51:49.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:49.327+0000 7f7b06e997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-21T22:51:49.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:49.327+0000 7f7b06e997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-21T22:51:49.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:49.327+0000 7f7b06e997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-21T22:51:49.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:49.327+0000 7f7b06e997c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-21T22:51:52.309 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-21T22:51:52.323 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:52.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:52.403+0000 7f9fc78707c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-21T22:51:52.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:52.403+0000 7f9fc78707c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-21T22:51:52.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:52.403+0000 7f9fc78707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-21T22:51:52.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:52.403+0000 7f9fc78707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-21T22:51:52.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:52.403+0000 7f9fc78707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-21T22:51:52.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:52.403+0000 7f9fc78707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-21T22:51:55.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-21T22:51:55.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:55.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:55.495+0000 7f1380b5c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-21T22:51:55.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:55.495+0000 7f1380b5c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-21T22:51:55.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:55.495+0000 7f1380b5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-21T22:51:55.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:55.495+0000 7f1380b5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-21T22:51:55.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:55.495+0000 7f1380b5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-21T22:51:55.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:55.495+0000 7f1380b5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-21T22:51:58.460 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-21T22:51:58.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:51:58.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:58.595+0000 7fc9948e77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-21T22:51:58.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:58.595+0000 7fc9948e77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-21T22:51:58.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:58.595+0000 7fc9948e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-21T22:51:58.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:58.595+0000 7fc9948e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-21T22:51:58.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:58.595+0000 7fc9948e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-21T22:51:58.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:51:58.595+0000 7fc9948e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-21T22:52:01.559 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-21T22:52:01.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-21T22:52:01.628 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T22:52:01.628 INFO:tasks.ceph:role: osd.4 2024-04-21T22:52:01.628 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-21T22:52:01.628 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-21T22:52:01.693 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:52:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:52:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:52:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:52:01.693 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:52:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:52:01.694 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:52:01.694 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:52:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:52:01.694 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:52:02.147 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-21T22:52:02.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-21T22:52:02.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-21T22:52:02.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-21T22:52:02.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:52:02.268 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:52:02.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-21T22:52:02.321 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T22:52:02.321 INFO:tasks.ceph:role: osd.5 2024-04-21T22:52:02.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-21T22:52:02.321 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:52:02.384 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:52:02.848 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-21T22:52:02.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-21T22:52:02.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-21T22:52:02.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-21T22:52:03.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:52:03.006 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:52:03.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-21T22:52:03.061 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T22:52:03.061 INFO:tasks.ceph:role: osd.6 2024-04-21T22:52:03.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-21T22:52:03.061 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-21T22:52:03.123 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:52:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:52:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:52:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:52:03.123 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:52:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:52:03.124 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:52:03.124 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:52:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:52:03.124 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:52:03.596 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-21T22:52:03.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-21T22:52:03.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-21T22:52:03.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-21T22:52:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:52:03.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:52:03.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-21T22:52:03.804 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T22:52:03.805 INFO:tasks.ceph:role: osd.7 2024-04-21T22:52:03.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-21T22:52:03.805 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-21T22:52:03.868 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T22:52:03.868 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T22:52:03.868 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T22:52:03.868 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T22:52:03.868 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T22:52:03.868 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-21T22:52:03.869 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T22:52:03.869 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T22:52:03.869 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T22:52:03.869 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T22:52:04.286 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-21T22:52:04.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-21T22:52:04.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-21T22:52:04.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-21T22:52:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T22:52:04.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:52:04.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:52:04.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:04.520+0000 7fc13d3fe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-21T22:52:04.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:04.520+0000 7fc13d3fe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-21T22:52:04.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:04.520+0000 7fc13d3fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-21T22:52:04.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:04.520+0000 7fc13d3fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-21T22:52:04.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:04.520+0000 7fc13d3fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-21T22:52:04.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:04.524+0000 7fc13d3fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-21T22:52:07.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-21T22:52:07.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:52:07.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:07.584+0000 7f4be753a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-21T22:52:07.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:07.584+0000 7f4be753a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-21T22:52:07.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:07.584+0000 7f4be753a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-21T22:52:07.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:07.584+0000 7f4be753a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-21T22:52:07.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:07.584+0000 7f4be753a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-21T22:52:07.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:07.584+0000 7f4be753a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-21T22:52:10.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-21T22:52:10.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:52:10.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:10.704+0000 7f97b67f37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-21T22:52:10.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:10.708+0000 7f97b67f37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-21T22:52:10.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:10.708+0000 7f97b67f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-21T22:52:10.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:10.708+0000 7f97b67f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-21T22:52:10.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:10.708+0000 7f97b67f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-21T22:52:10.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:10.708+0000 7f97b67f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-21T22:52:13.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-21T22:52:13.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:52:13.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:13.812+0000 7fc02bdb07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-21T22:52:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:13.812+0000 7fc02bdb07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-21T22:52:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:13.812+0000 7fc02bdb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-21T22:52:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:13.812+0000 7fc02bdb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-21T22:52:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:13.812+0000 7fc02bdb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-21T22:52:13.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:13.816+0000 7fc02bdb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-21T22:52:15.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:52:15.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:52:16.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-21T22:52:16.804 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-21T22:52:16.805 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:16.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-21T22:52:16.818 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:16.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-21T22:52:16.872 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:16.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-21T22:52:16.932 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:16.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-21T22:52:16.987 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:16.988 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-21T22:52:17.044 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:17.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-21T22:52:17.100 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:17.100 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-21T22:52:17.156 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:17.157 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-21T22:52:17.211 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-21T22:52:17.225 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-21T22:52:17.280 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-21T22:52:17.332 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-21T22:52:17.388 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-21T22:52:17.443 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-21T22:52:17.497 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-21T22:52:17.551 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:17.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-21T22:52:17.604 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:17.604 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-21T22:52:17.610 INFO:tasks.ceph:Adding keys to all mons... 2024-04-21T22:52:17.610 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-21T22:52:17.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDmCVmCPkGEBAAbg24oZtkD4BP+EO3b7Rgsg== 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDmCVmmNALFhAAB5ksCX9PSgGxvMltMgxXtQ== 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDmCVmTutTHhAA9fVZd/L8h+0VTCRQzSyxCg== 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDmCVm7Ou7JhAAnUVhWvErDxI4OrlD6IZAyQ== 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCFmCVm2W/mExAANhBOGbhF3u/KqD5k41wCBA== 2024-04-21T22:52:17.663 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCImCVmEXxFGBAACzUK6r6IVV7FIVisSCCmhw== 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCLmCVm5uXlHRAAgkt4etCuAL+7eZ1wIFKwKw== 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCOmCVmnObWIxAAWQ4kooo1A6Dg1zVxWLwIcA== 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDmCVmSTrMEhAA7iHn37rYodPDdK8OqF9TVQ== 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDmCVmnXrYLBAAouFVGYJgG9SB1MMPdNsPLA== 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDmCVmEpU9NRAAzMds4c5CywoaVt6zjEKarg== 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2024-04-21T22:52:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCEmCVmT5HmARAAJmiNGLc3k7aKeP6oo061Iw== 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCUmCVmvq8xHxAATQnymP3+6QrRr4ggCZCFCw== 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCXmCVmieEKIxAAolevcZpKIXU7INg+6++Lcg== 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCamCVmQMRZKhAAcij6H+WQDuvZDDC8y51nBQ== 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCdmCVmlCDCMBAAkcjbgGpxQtp6hI2TA1RbqQ== 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-04-21T22:52:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCEmCVm6d6DBxAAG4emPE9jLfCWVWZeQd9nmw== 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDmCVmCPkGEBAAbg24oZtkD4BP+EO3b7Rgsg== 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDmCVmmNALFhAAB5ksCX9PSgGxvMltMgxXtQ== 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDmCVmTutTHhAA9fVZd/L8h+0VTCRQzSyxCg== 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.e] 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDmCVm7Ou7JhAAnUVhWvErDxI4OrlD6IZAyQ== 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCFmCVm2W/mExAANhBOGbhF3u/KqD5k41wCBA== 2024-04-21T22:52:17.667 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCImCVmEXxFGBAACzUK6r6IVV7FIVisSCCmhw== 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCLmCVm5uXlHRAAgkt4etCuAL+7eZ1wIFKwKw== 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCOmCVmnObWIxAAWQ4kooo1A6Dg1zVxWLwIcA== 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDmCVmSTrMEhAA7iHn37rYodPDdK8OqF9TVQ== 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDmCVmnXrYLBAAouFVGYJgG9SB1MMPdNsPLA== 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDmCVmEpU9NRAAzMds4c5CywoaVt6zjEKarg== 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.f] 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCEmCVmT5HmARAAJmiNGLc3k7aKeP6oo061Iw== 2024-04-21T22:52:17.668 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCUmCVmvq8xHxAATQnymP3+6QrRr4ggCZCFCw== 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCXmCVmieEKIxAAolevcZpKIXU7INg+6++Lcg== 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCamCVmQMRZKhAAcij6H+WQDuvZDDC8y51nBQ== 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCdmCVmlCDCMBAAkcjbgGpxQtp6hI2TA1RbqQ== 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-21T22:52:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCEmCVm6d6DBxAAG4emPE9jLfCWVWZeQd9nmw== 2024-04-21T22:52:17.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T22:52:17.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T22:52:17.755 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:17.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:17.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:17.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:17.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:17.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:17.976 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.143 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.315 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T22:52:18.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T22:52:18.397 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:18.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:18.486 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:18.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:18.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:18.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T22:52:18.658 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.743 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:18.921 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T22:52:19.001 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-21T22:52:19.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-21T22:52:19.090 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-21T22:52:19.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-21T22:52:19.103 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-21T22:52:19.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-21T22:52:19.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-21T22:52:19.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-21T22:52:19.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-21T22:52:19.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-21T22:52:19.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-21T22:52:19.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-21T22:52:19.550 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:52:19.553 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-21T22:52:19.596 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-21T22:52:19.596 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-21T22:52:19.597 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-21T22:52:19.597 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-21T22:52:19.601 INFO:tasks.ceph.mon.a:Started 2024-04-21T22:52:19.601 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-21T22:52:19.601 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-21T22:52:19.601 DEBUG:teuthology.orchestra.run.smithi154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-21T22:52:19.642 INFO:tasks.ceph.mon.b:Started 2024-04-21T22:52:19.642 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-21T22:52:19.642 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-21T22:52:19.642 DEBUG:teuthology.orchestra.run.smithi154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-21T22:52:19.645 INFO:tasks.ceph.mon.c:Started 2024-04-21T22:52:19.645 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-21T22:52:19.645 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-21T22:52:19.645 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-21T22:52:19.648 INFO:tasks.ceph.mgr.y:Started 2024-04-21T22:52:19.648 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-21T22:52:19.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-21T22:52:19.650 INFO:tasks.ceph.mgr.x:Started 2024-04-21T22:52:19.650 INFO:tasks.ceph:Setting crush tunables to default 2024-04-21T22:52:19.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd crush tunables default 2024-04-21T22:52:19.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28e1a59640 1 Processor -- start 2024-04-21T22:52:19.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28e1a59640 1 -- start start 2024-04-21T22:52:19.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28e1a59640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28dc0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:19.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28e1a59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 0x7f28dc0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:19.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28e1a59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc0cabd0 con 0x7f28dc06c500 2024-04-21T22:52:19.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28e1a59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc158da0 con 0x7f28dc0ca200 2024-04-21T22:52:19.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28e1a59640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc15f550 con 0x7f28dc0c3830 2024-04-21T22:52:19.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28db7fe640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 msgr2=0x7f28dc0ca690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-04-21T22:52:19.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28db7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 0x7f28dc0ca690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:19.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28da7fc640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28dc0c9350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:19.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28daffd640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28dc0c3c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:19.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.767+0000 7f28daffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28dc0c3c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:19.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.971+0000 7f28db7fe640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 msgr2=0x7f28dc0ca690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-04-21T22:52:19.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.971+0000 7f28da7fc640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28dc0c9350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:19.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.971+0000 7f28db7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 0x7f28dc0ca690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:19.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.971+0000 7f28daffd640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28dc0c3c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:19.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:19.971+0000 7f28daffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28dc0c3c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:20.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:20.375+0000 7f28db7fe640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 msgr2=0x7f28dc0ca690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-04-21T22:52:20.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:20.375+0000 7f28db7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 0x7f28dc0ca690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:20.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:20.375+0000 7f28da7fc640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28dc0c9350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:20.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:20.375+0000 7f28daffd640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28dc0c3c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:20.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:20.375+0000 7f28daffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28dc0c3c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:21.179+0000 7f28db7fe640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 msgr2=0x7f28dc0ca690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-04-21T22:52:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:21.179+0000 7f28db7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 0x7f28dc0ca690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:21.179+0000 7f28da7fc640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28dc0c9350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:21.179+0000 7f28daffd640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28dc0c3c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:21.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:21.179+0000 7f28daffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28dc0c3c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:22.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28dc0c3c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:22.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28dc0c3c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:22.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 msgr2=0x7f28dc0ca690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:22.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28dc0ca200 0x7f28dc0ca690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:22.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28dc0c9350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:22.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 0x7f28bc005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:22.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc0cabd0 con 0x7f28bc006130 2024-04-21T22:52:22.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28d8ff9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc158da0 con 0x7f28bc0036a0 2024-04-21T22:52:22.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28da7fc640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:22.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28daffd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 msgr2=0x7f28bc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-04-21T22:52:22.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.767+0000 7f28daffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 0x7f28bc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.971+0000 7f28da7fc640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.971+0000 7f28daffd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 msgr2=0x7f28bc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-04-21T22:52:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:22.971+0000 7f28daffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 0x7f28bc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:23.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:23.375+0000 7f28da7fc640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:23.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:23.375+0000 7f28daffd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 msgr2=0x7f28bc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-04-21T22:52:23.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:23.375+0000 7f28daffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 0x7f28bc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:24.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:24.179+0000 7f28da7fc640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:24.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:24.179+0000 7f28daffd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 msgr2=0x7f28bc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-04-21T22:52:24.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:24.179+0000 7f28daffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 0x7f28bc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28d8ff9640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 msgr2=0x7f28bc005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28d8ff9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc0036a0 0x7f28bc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28d8ff9640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28db7fe640 1 -- reap_dead start 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28d8ff9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28bc00a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28d8ff9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc00aef0 con 0x7f28bc006130 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28d8ff9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc0cabd0 con 0x7f28dc06c500 2024-04-21T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28d8ff9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc158da0 con 0x7f28dc0c3830 2024-04-21T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28daffd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28bc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28da7fc640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28bc00a5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28da7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28bc00a5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.767+0000 7f28db7fe640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:25.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.971+0000 7f28db7fe640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:25.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.971+0000 7f28da7fc640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28bc00a5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:25.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.971+0000 7f28da7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28bc00a5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:25.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:25.971+0000 7f28daffd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28bc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:26.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:26.375+0000 7f28db7fe640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:26.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:26.375+0000 7f28da7fc640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28bc00a5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:26.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:26.375+0000 7f28daffd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28bc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:26.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:26.375+0000 7f28da7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28bc00a5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:27.179+0000 7f28db7fe640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-04-21T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:27.179+0000 7f28da7fc640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28bc00a5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-04-21T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:27.179+0000 7f28da7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28bc00a5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:27.179+0000 7f28daffd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28bc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-04-21T22:52:27.861 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:00:08.116 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T22:52:28.016 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:00:08.205 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T22:52:28.046 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:00:08.235 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T22:52:28.184 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:00:08.439 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T22:52:28.342 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:00:08.531 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T22:52:28.372 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:00:08.561 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T22:52:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 msgr2=0x7f28bc00a5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28dc0c3830 0x7f28bc00a5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06c500 legacy=0x7f28bc009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f28bc006130 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:28.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc158da0 con 0x7f28bc003ae0 2024-04-21T22:52:28.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28d8ff9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc15f550 con 0x7f28bc004400 2024-04-21T22:52:28.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28da7fc640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 msgr2=0x7f28bc004ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-04-21T22:52:28.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28da7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:28.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.767+0000 7f28daffd640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-04-21T22:52:28.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.771+0000 7f28daffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:28.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.971+0000 7f28da7fc640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 msgr2=0x7f28bc004ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-04-21T22:52:28.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.971+0000 7f28da7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:28.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.975+0000 7f28daffd640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-04-21T22:52:28.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:28.975+0000 7f28daffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:29.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:29.375+0000 7f28da7fc640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 msgr2=0x7f28bc004ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-04-21T22:52:29.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:29.375+0000 7f28da7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:29.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:29.379+0000 7f28daffd640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-04-21T22:52:29.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:29.379+0000 7f28daffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:30.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.187+0000 7f28da7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:30.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.259+0000 7f28daffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.271+0000 7f28da7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:37278/0 (socket says 172.21.15.110:37278) 2024-04-21T22:52:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.271+0000 7f28da7fc640 1 -- 172.21.15.110:0/1963069542 learned_addr learned my addr 172.21.15.110:0/1963069542 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:52:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.287+0000 7f28da7fc640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 msgr2=0x7f28bc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.287+0000 7f28da7fc640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 msgr2=0x7f28bc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.287+0000 7f28da7fc640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.287+0000 7f28da7fc640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:30.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.299+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T22:52:30.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.299+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:30.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.299+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:30.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:30.299+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:31.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.767+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 msgr2=0x7f28bc004ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:31.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.767+0000 7f28d8ff9640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc004400 0x7f28bc004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:31.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.767+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:31.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.771+0000 7f28d8ff9640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:31.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.771+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 reap_dead start 2024-04-21T22:52:31.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.771+0000 7f28d8ff9640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:31.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.771+0000 7f28d8ff9640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:31.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc004af0 con 0x7f28bc00a5d0 2024-04-21T22:52:31.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc158da0 con 0x7f28bc003ae0 2024-04-21T22:52:31.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc15f550 con 0x7f28bc009e90 2024-04-21T22:52:31.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.883+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:31.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.887+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:31.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.927+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:31.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.927+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:31.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.927+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:31.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.927+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:31.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.967+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-21T22:52:31.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.967+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:31.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.967+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:31.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:31.967+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:32.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.171+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:32.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.171+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-21T22:52:32.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.171+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:32.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.171+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:32.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.175+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:32.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.579+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:32.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.579+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-21T22:52:32.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.579+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:32.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.579+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:32.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.579+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:32.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.927+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:32.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.931+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:32.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.931+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:32.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.931+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:32.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:32.931+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:33.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.355+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:33.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.359+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:33.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.359+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:33.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.359+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:33.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.359+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:52:33.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.395+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:33.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.399+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:33.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.399+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:33.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.399+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:33.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:33.399+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:34.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.347+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:34.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.347+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:34.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.347+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:34.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.347+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:34.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.347+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:52:34.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 msgr2=0x7f28bc004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:34.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28bc009e90 0x7f28bc004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:34.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 msgr2=0x7f28bc003ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:34.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.110:3300/0 conn(0x7f28bc003ae0 0x7f28bc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:34.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 >> v1:172.21.15.154:6789/0 conn(0x7f28bc00a5d0 legacy=0x7f28bc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:34.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:34.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc00aef0 con 0x7f28bc005b50 2024-04-21T22:52:34.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.771+0000 7f28d8ff9640 1 -- 172.21.15.110:0/1963069542 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc158da0 con 0x7f28bc005200 2024-04-21T22:52:34.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.907+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:34.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.931+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 msgr2=0x7f28bc005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:34.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.931+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 msgr2=0x7f28bc005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:34.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.931+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:34.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:34.931+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:52:35.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.135+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:35.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.139+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 msgr2=0x7f28bc005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T22:52:35.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.139+0000 7f28daffd640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 msgr2=0x7f28bc005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T22:52:35.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.139+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:52:35.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.139+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:52:35.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.251+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279872667 0 0) 0x7f28bc00aef0 con 0x7f28bc005b50 2024-04-21T22:52:35.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.251+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c8003530 con 0x7f28bc005b50 2024-04-21T22:52:35.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2400032639 0 0) 0x7f28c8003530 con 0x7f28bc005b50 2024-04-21T22:52:35.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 msgr2=0x7f28bc005610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:52:35.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 --2- 172.21.15.110:0/1963069542 >> v2:172.21.15.154:3300/0 conn(0x7f28bc005200 0x7f28bc005610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc0cabd0 con 0x7f28bc005b50 2024-04-21T22:52:35.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f28cc0099e0 con 0x7f28bc005b50 2024-04-21T22:52:35.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 >> v1:172.21.15.110:6789/0 conn(0x7f28bc005b50 legacy=0x7f28bc00f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:35.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 reap_dead start 2024-04-21T22:52:35.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c80039c0 0x7f28c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:35.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c8004810 0x7f28c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:35.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:35.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc158da0 con 0x7f28c8004810 2024-04-21T22:52:35.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28c800c150 con 0x7f28c8005220 2024-04-21T22:52:35.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.407+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f28c800c350 con 0x7f28c80039c0 2024-04-21T22:52:35.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.487+0000 7f28da7fc640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c8004810 0x7f28c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.519+0000 7f28daffd640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c80039c0 0x7f28c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:35.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.527+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:35.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.539+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c80039c0 msgr2=0x7f28c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:35.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.539+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c80039c0 0x7f28c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.539+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c8004810 msgr2=0x7f28c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:35.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.539+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c8004810 0x7f28c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.539+0000 7f28db7fe640 1 -- 172.21.15.110:0/1963069542 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c8003530 con 0x7f28c8005220 2024-04-21T22:52:35.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.547+0000 7f28db7fe640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28c800b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0721a0 tx=0x7f28d401d500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f3123ac698e32d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:35.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40b3070 con 0x7f28c8005220 2024-04-21T22:52:35.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d400c040 con 0x7f28c8005220 2024-04-21T22:52:35.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28d9ffb640 1 -- 172.21.15.110:0/1963069542 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40ab070 con 0x7f28c8005220 2024-04-21T22:52:35.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 -- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 msgr2=0x7f28c800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:35.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28c800b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0721a0 tx=0x7f28d401d500 comp rx=0 tx=0).stop 2024-04-21T22:52:35.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 -- 172.21.15.110:0/1963069542 shutdown_connections 2024-04-21T22:52:35.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28c800b9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c8004810 0x7f28c8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 --2- 172.21.15.110:0/1963069542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c80039c0 0x7f28c8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 -- 172.21.15.110:0/1963069542 >> 172.21.15.110:0/1963069542 conn(0x7f28dc062670 msgr2=0x7f28dc071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:35.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 -- 172.21.15.110:0/1963069542 shutdown_connections 2024-04-21T22:52:35.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.699+0000 7f28e1a59640 1 -- 172.21.15.110:0/1963069542 wait complete. 2024-04-21T22:52:35.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.703+0000 7f28e1a59640 1 Processor -- start 2024-04-21T22:52:35.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.703+0000 7f28e1a59640 1 -- start start 2024-04-21T22:52:35.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.707+0000 7f28e1a59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c80039c0 0x7f28dc1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:35.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.707+0000 7f28e1a59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004810 0x7f28dc15af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:35.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.707+0000 7f28e1a59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28dc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:35.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.707+0000 7f28e1a59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc0c4450 con 0x7f28c80039c0 2024-04-21T22:52:35.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.707+0000 7f28e1a59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc15f270 con 0x7f28c8005220 2024-04-21T22:52:35.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.707+0000 7f28e1a59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc0c4020 con 0x7f28c8004810 2024-04-21T22:52:35.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.723+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28dc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:35.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.723+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28dc15b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:34370/0 (socket says 172.21.15.110:34370) 2024-04-21T22:52:35.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.723+0000 7f28db7fe640 1 -- 172.21.15.110:0/2567728593 learned_addr learned my addr 172.21.15.110:0/2567728593 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:52:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.731+0000 7f28daffd640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c80039c0 0x7f28dc1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:35.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.743+0000 7f28daffd640 1 -- 172.21.15.110:0/2567728593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004810 msgr2=0x7f28dc15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:35.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.743+0000 7f28daffd640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004810 0x7f28dc15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.743+0000 7f28daffd640 1 -- 172.21.15.110:0/2567728593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 msgr2=0x7f28dc15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:35.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.743+0000 7f28daffd640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28dc15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:35.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.743+0000 7f28daffd640 1 -- 172.21.15.110:0/2567728593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc15cc30 con 0x7f28c80039c0 2024-04-21T22:52:35.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.747+0000 7f28daffd640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c80039c0 0x7f28dc1532b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006c10 tx=0x7f28c4018b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:35.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.811+0000 7f28d3fff640 1 -- 172.21.15.110:0/2567728593 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c400f040 con 0x7f28c80039c0 2024-04-21T22:52:35.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.811+0000 7f28d3fff640 1 -- 172.21.15.110:0/2567728593 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c4016b80 con 0x7f28c80039c0 2024-04-21T22:52:35.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.811+0000 7f28d3fff640 1 -- 172.21.15.110:0/2567728593 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4022480 con 0x7f28c80039c0 2024-04-21T22:52:35.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.811+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28dc15cf10 con 0x7f28c80039c0 2024-04-21T22:52:35.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.811+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28dc15d4d0 con 0x7f28c80039c0 2024-04-21T22:52:35.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:35.811+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28dc04f510 con 0x7f28c80039c0 2024-04-21T22:52:36.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.027+0000 7f28d3fff640 1 -- 172.21.15.110:0/2567728593 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f28c4022620 con 0x7f28c80039c0 2024-04-21T22:52:36.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.027+0000 7f28d3fff640 1 -- 172.21.15.110:0/2567728593 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f28c402b7e0 con 0x7f28c80039c0 2024-04-21T22:52:36.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.027+0000 7f28d3fff640 1 -- 172.21.15.110:0/2567728593 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f28c40213e0 con 0x7f28c80039c0 2024-04-21T22:52:36.086 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:36.083+0000 7f11bf688180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:52:36.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.103+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f28dc0c9130 con 0x7f28c80039c0 2024-04-21T22:52:36.134 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:36.132+0000 7fef6854d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:52:36.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28d3fff640 1 -- 172.21.15.110:0/2567728593 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f28c4022af0 con 0x7f28c80039c0 2024-04-21T22:52:36.506 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2024-04-21T22:52:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c80039c0 msgr2=0x7f28dc1532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c80039c0 0x7f28dc1532b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006c10 tx=0x7f28c4018b80 comp rx=0 tx=0).stop 2024-04-21T22:52:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 shutdown_connections 2024-04-21T22:52:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8005220 0x7f28dc15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004810 0x7f28dc15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 --2- 172.21.15.110:0/2567728593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28c80039c0 0x7f28dc1532b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 >> 172.21.15.110:0/2567728593 conn(0x7f28dc062670 msgr2=0x7f28dc071330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 shutdown_connections 2024-04-21T22:52:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:36.503+0000 7f28e1a59640 1 -- 172.21.15.110:0/2567728593 wait complete. 2024-04-21T22:52:36.528 INFO:tasks.ceph:check_enable_crimson: False 2024-04-21T22:52:36.528 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-21T22:52:36.528 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:36.528 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-21T22:52:36.544 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:36.544 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-21T22:52:36.594 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:36.591+0000 7f11bf688180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:52:36.598 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:36.598 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-21T22:52:36.640 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:36.640+0000 7fef6854d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:52:36.651 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:52:36.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-21T22:52:36.703 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:36.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-21T22:52:36.716 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:36.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-21T22:52:36.771 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:36.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-21T22:52:36.804 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:36.803+0000 7f11bf688180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:52:36.824 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-21T22:52:36.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-21T22:52:36.849 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:36.848+0000 7fef6854d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:52:36.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a0ad6034-326d-43a8-89d7-155ba7bbbebb 0 2024-04-21T22:52:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.016+0000 7f901b215640 1 Processor -- start 2024-04-21T22:52:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.016+0000 7f901b215640 1 -- start start 2024-04-21T22:52:37.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f901b215640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9014152460 0x7f90140c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f901b215640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014158a70 0x7f901406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f901b215640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90140c8a70 con 0x7f90140c2d00 2024-04-21T22:52:37.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f901b215640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f90140c8820 con 0x7f9014152460 2024-04-21T22:52:37.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f901b215640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f901415ba70 con 0x7f9014158a70 2024-04-21T22:52:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f90197b2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014158a70 0x7f901406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f9013fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f90140c2d00 0x7f901415bf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59194/0 (socket says 172.21.15.154:59194) 2024-04-21T22:52:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f9013fff640 1 -- 172.21.15.154:0/1456839123 learned_addr learned my addr 172.21.15.154:0/1456839123 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-21T22:52:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.020+0000 7f9018fb1640 1 --2- 172.21.15.154:0/1456839123 >> v2:172.21.15.110:3300/0 conn(0x7f9014152460 0x7f90140c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.024+0000 7f90197b2640 1 -- 172.21.15.154:0/1456839123 >> v2:172.21.15.110:3300/0 conn(0x7f9014152460 msgr2=0x7f90140c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.024+0000 7f90197b2640 1 --2- 172.21.15.154:0/1456839123 >> v2:172.21.15.110:3300/0 conn(0x7f9014152460 0x7f90140c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.024+0000 7f90197b2640 1 -- 172.21.15.154:0/1456839123 >> v1:172.21.15.154:6789/0 conn(0x7f90140c2d00 legacy=0x7f901415bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.024+0000 7f90197b2640 1 -- 172.21.15.154:0/1456839123 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90140c8d50 con 0x7f9014158a70 2024-04-21T22:52:37.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.028+0000 7f90197b2640 1 --2- 172.21.15.154:0/1456839123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014158a70 0x7f901406f9b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f900c009d90 tx=0x7f900c01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79630b824586dffb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:37.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f90137fe640 1 -- 172.21.15.154:0/1456839123 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c0b4070 con 0x7f9014158a70 2024-04-21T22:52:37.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f90137fe640 1 -- 172.21.15.154:0/1456839123 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c0af600 con 0x7f9014158a70 2024-04-21T22:52:37.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f90137fe640 1 -- 172.21.15.154:0/1456839123 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c0af9d0 con 0x7f9014158a70 2024-04-21T22:52:37.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 -- 172.21.15.154:0/1456839123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014158a70 msgr2=0x7f901406f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 --2- 172.21.15.154:0/1456839123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014158a70 0x7f901406f9b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f900c009d90 tx=0x7f900c01f150 comp rx=0 tx=0).stop 2024-04-21T22:52:37.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 -- 172.21.15.154:0/1456839123 shutdown_connections 2024-04-21T22:52:37.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 --2- 172.21.15.154:0/1456839123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014158a70 0x7f901406f9b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 --2- 172.21.15.154:0/1456839123 >> v2:172.21.15.110:3300/0 conn(0x7f9014152460 0x7f90140c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 -- 172.21.15.154:0/1456839123 >> 172.21.15.154:0/1456839123 conn(0x7f9014062670 msgr2=0x7f9014071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:37.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 -- 172.21.15.154:0/1456839123 shutdown_connections 2024-04-21T22:52:37.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 -- 172.21.15.154:0/1456839123 wait complete. 2024-04-21T22:52:37.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 Processor -- start 2024-04-21T22:52:37.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 -- start start 2024-04-21T22:52:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90140c2d00 0x7f901414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014152460 0x7f901415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9014158a70 0x7f90141ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.032+0000 7f901b215640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9014070070 con 0x7f9014158a70 2024-04-21T22:52:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.036+0000 7f901b215640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f901406fef0 con 0x7f90140c2d00 2024-04-21T22:52:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.036+0000 7f901b215640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f90140701f0 con 0x7f9014152460 2024-04-21T22:52:37.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.036+0000 7f9013fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014152460 0x7f901415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.036+0000 7f9018fb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90140c2d00 0x7f901414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.036+0000 7f9013fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014152460 0x7f901415ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57322/0 (socket says 172.21.15.154:57322) 2024-04-21T22:52:37.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.036+0000 7f9013fff640 1 -- 172.21.15.154:0/1260583694 learned_addr learned my addr 172.21.15.154:0/1260583694 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:37.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.036+0000 7f90197b2640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9014158a70 0x7f90141ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.040+0000 7f9013fff640 1 -- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90140c2d00 msgr2=0x7f901414cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.040+0000 7f9013fff640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90140c2d00 0x7f901414cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.040+0000 7f9013fff640 1 -- 172.21.15.154:0/1260583694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9014158a70 msgr2=0x7f90141ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.040+0000 7f9013fff640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9014158a70 0x7f90141ee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.040+0000 7f9013fff640 1 -- 172.21.15.154:0/1260583694 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9014070dd0 con 0x7f9014152460 2024-04-21T22:52:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.040+0000 7f9018fb1640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90140c2d00 0x7f901414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:52:37.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.040+0000 7f9013fff640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014152460 0x7f901415ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f900800c460 tx=0x7f900800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.044+0000 7f90117fa640 1 -- 172.21.15.154:0/1260583694 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008017070 con 0x7f9014152460 2024-04-21T22:52:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.044+0000 7f90117fa640 1 -- 172.21.15.154:0/1260583694 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008005cf0 con 0x7f9014152460 2024-04-21T22:52:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.044+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90141ed9e0 con 0x7f9014152460 2024-04-21T22:52:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.044+0000 7f90117fa640 1 -- 172.21.15.154:0/1260583694 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008007290 con 0x7f9014152460 2024-04-21T22:52:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.044+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90141f19f0 con 0x7f9014152460 2024-04-21T22:52:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.044+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901404f510 con 0x7f9014152460 2024-04-21T22:52:37.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.244+0000 7f90117fa640 1 -- 172.21.15.154:0/1260583694 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f900801a070 con 0x7f9014152460 2024-04-21T22:52:37.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.244+0000 7f90117fa640 1 -- 172.21.15.154:0/1260583694 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f9008012400 con 0x7f9014152460 2024-04-21T22:52:37.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.244+0000 7f90117fa640 1 -- 172.21.15.154:0/1260583694 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9008021020 con 0x7f9014152460 2024-04-21T22:52:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.324+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a0ad6034-326d-43a8-89d7-155ba7bbbebb", "id": 0} v 0) -- 0x7f90140c9160 con 0x7f9014152460 2024-04-21T22:52:37.388 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.387+0000 7f11bf688180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:52:37.421 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.420+0000 7fef6854d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:52:37.442 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.439+0000 7f11bf688180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:52:37.475 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.472+0000 7fef6854d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:52:37.495 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.491+0000 7f11bf688180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:52:37.527 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.524+0000 7fef6854d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:52:37.573 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.571+0000 7f11bf688180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:52:37.607 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.604+0000 7fef6854d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:52:37.627 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.623+0000 7f11bf688180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:52:37.661 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.660+0000 7fef6854d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:52:37.704 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.703+0000 7f11bf688180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:52:37.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f90117fa640 1 -- 172.21.15.154:0/1260583694 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0ad6034-326d-43a8-89d7-155ba7bbbebb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f900801c440 con 0x7f9014152460 2024-04-21T22:52:37.730 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-04-21T22:52:37.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014152460 msgr2=0x7f901415ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014152460 0x7f901415ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f900800c460 tx=0x7f900800c920 comp rx=0 tx=0).stop 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 shutdown_connections 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9014158a70 0x7f90141ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014152460 0x7f901415ac50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 --2- 172.21.15.154:0/1260583694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90140c2d00 0x7f901414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 >> 172.21.15.154:0/1260583694 conn(0x7f9014062670 msgr2=0x7f90140c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 shutdown_connections 2024-04-21T22:52:37.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.728+0000 7f901b215640 1 -- 172.21.15.154:0/1260583694 wait complete. 2024-04-21T22:52:37.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1c92af9e-f6a1-4140-9eef-edc99ad1c868 1 2024-04-21T22:52:37.753 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.752+0000 7fef6854d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:52:37.758 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.755+0000 7f11bf688180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:52:37.807 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.804+0000 7fef6854d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:52:37.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.868+0000 7f32b95bf640 1 Processor -- start 2024-04-21T22:52:37.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.868+0000 7f32b95bf640 1 -- start start 2024-04-21T22:52:37.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.868+0000 7f32b95bf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32b40c62a0 0x7f32b40c9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.868+0000 7f32b95bf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32b40c6680 0x7f32b415b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.868+0000 7f32b95bf640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b4158190 con 0x7f32b415bcc0 2024-04-21T22:52:37.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.868+0000 7f32b95bf640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f32b4158aa0 con 0x7f32b40c62a0 2024-04-21T22:52:37.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.868+0000 7f32b95bf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40c8100 con 0x7f32b40c6680 2024-04-21T22:52:37.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32b40c6680 0x7f32b415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32b40c6680 0x7f32b415b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33784/0 (socket says 172.21.15.154:33784) 2024-04-21T22:52:37.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b27fc640 1 -- 172.21.15.154:0/3808215343 learned_addr learned my addr 172.21.15.154:0/3808215343 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:37.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b2ffd640 1 --2- 172.21.15.154:0/3808215343 >> v2:172.21.15.110:3300/0 conn(0x7f32b40c62a0 0x7f32b40c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b27fc640 1 -- 172.21.15.154:0/3808215343 >> v2:172.21.15.110:3300/0 conn(0x7f32b40c62a0 msgr2=0x7f32b40c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:37.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b27fc640 1 --2- 172.21.15.154:0/3808215343 >> v2:172.21.15.110:3300/0 conn(0x7f32b40c62a0 0x7f32b40c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b27fc640 1 -- 172.21.15.154:0/3808215343 >> v1:172.21.15.110:6789/0 conn(0x7f32b415bcc0 legacy=0x7f32b4140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:37.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.872+0000 7f32b27fc640 1 -- 172.21.15.154:0/3808215343 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b415c210 con 0x7f32b40c6680 2024-04-21T22:52:37.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.876+0000 7f32b27fc640 1 --2- 172.21.15.154:0/3808215343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 0x7f32b415b780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32b40cc890 tx=0x7f32a401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=681d9245ba678ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b1ffb640 1 -- 172.21.15.154:0/3808215343 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a40b1070 con 0x7f32b40c6680 2024-04-21T22:52:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b1ffb640 1 -- 172.21.15.154:0/3808215343 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a40ac630 con 0x7f32b40c6680 2024-04-21T22:52:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b1ffb640 1 -- 172.21.15.154:0/3808215343 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a40a8050 con 0x7f32b40c6680 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 -- 172.21.15.154:0/3808215343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 msgr2=0x7f32b415b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 --2- 172.21.15.154:0/3808215343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 0x7f32b415b780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32b40cc890 tx=0x7f32a401c4e0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 -- 172.21.15.154:0/3808215343 shutdown_connections 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 --2- 172.21.15.154:0/3808215343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 0x7f32b415b780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 --2- 172.21.15.154:0/3808215343 >> v2:172.21.15.110:3300/0 conn(0x7f32b40c62a0 0x7f32b40c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 -- 172.21.15.154:0/3808215343 >> 172.21.15.154:0/3808215343 conn(0x7f32b40cc930 msgr2=0x7f32b40ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 -- 172.21.15.154:0/3808215343 shutdown_connections 2024-04-21T22:52:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.884+0000 7f32b95bf640 1 -- 172.21.15.154:0/3808215343 wait complete. 2024-04-21T22:52:37.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 Processor -- start 2024-04-21T22:52:37.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 -- start start 2024-04-21T22:52:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b40c62a0 0x7f32b40c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 0x7f32b413e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b415bcc0 0x7f32b4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4158f10 con 0x7f32b40c62a0 2024-04-21T22:52:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40c9750 con 0x7f32b40c6680 2024-04-21T22:52:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b95bf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f32b4159090 con 0x7f32b415bcc0 2024-04-21T22:52:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b415bcc0 0x7f32b4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b415bcc0 0x7f32b4160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57332/0 (socket says 172.21.15.154:57332) 2024-04-21T22:52:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b37fe640 1 -- 172.21.15.154:0/348847411 learned_addr learned my addr 172.21.15.154:0/348847411 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b27fc640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 0x7f32b413e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.888+0000 7f32b2ffd640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b40c62a0 0x7f32b40c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.892+0000 7f32b37fe640 1 -- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 msgr2=0x7f32b413e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.892+0000 7f32b37fe640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 0x7f32b413e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.892+0000 7f32b37fe640 1 -- 172.21.15.154:0/348847411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b40c62a0 msgr2=0x7f32b40c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.892+0000 7f32b37fe640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b40c62a0 0x7f32b40c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.892+0000 7f32b37fe640 1 -- 172.21.15.154:0/348847411 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b41f71b0 con 0x7f32b415bcc0 2024-04-21T22:52:37.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.892+0000 7f32b37fe640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b415bcc0 0x7f32b4160c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b9c0 tx=0x7f32ac00be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.896+0000 7f329b7fe640 1 -- 172.21.15.154:0/348847411 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac019070 con 0x7f32b415bcc0 2024-04-21T22:52:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.896+0000 7f329b7fe640 1 -- 172.21.15.154:0/348847411 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac00cba0 con 0x7f32b415bcc0 2024-04-21T22:52:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.896+0000 7f329b7fe640 1 -- 172.21.15.154:0/348847411 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac014440 con 0x7f32b415bcc0 2024-04-21T22:52:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.900+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b41f7490 con 0x7f32b415bcc0 2024-04-21T22:52:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.900+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b41f3750 con 0x7f32b415bcc0 2024-04-21T22:52:37.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.900+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b404f510 con 0x7f32b415bcc0 2024-04-21T22:52:37.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.900+0000 7f329b7fe640 1 -- 172.21.15.154:0/348847411 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f32ac01c070 con 0x7f32b415bcc0 2024-04-21T22:52:37.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:37.904+0000 7f329b7fe640 1 -- 172.21.15.154:0/348847411 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f32ac01eb40 con 0x7f32b415bcc0 2024-04-21T22:52:37.907 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.903+0000 7f11bf688180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:52:37.965 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:37.964+0000 7fef6854d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:52:37.968 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:37.967+0000 7f11bf688180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:52:38.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.004+0000 7f329b7fe640 1 -- 172.21.15.154:0/348847411 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f32ac023020 con 0x7f32b415bcc0 2024-04-21T22:52:38.027 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:38.024+0000 7fef6854d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:52:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.076+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1c92af9e-f6a1-4140-9eef-edc99ad1c868", "id": 1} v 0) -- 0x7f32b4155da0 con 0x7f32b415bcc0 2024-04-21T22:52:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f329b7fe640 1 -- 172.21.15.154:0/348847411 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c92af9e-f6a1-4140-9eef-edc99ad1c868", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f32ac014770 con 0x7f32b415bcc0 2024-04-21T22:52:38.309 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b415bcc0 msgr2=0x7f32b4160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b415bcc0 0x7f32b4160c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b9c0 tx=0x7f32ac00be80 comp rx=0 tx=0).stop 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 shutdown_connections 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b415bcc0 0x7f32b4160c70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40c6680 0x7f32b413e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 --2- 172.21.15.154:0/348847411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b40c62a0 0x7f32b40c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 >> 172.21.15.154:0/348847411 conn(0x7f32b40cc930 msgr2=0x7f32b4161ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 shutdown_connections 2024-04-21T22:52:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.308+0000 7f32b95bf640 1 -- 172.21.15.154:0/348847411 wait complete. 2024-04-21T22:52:38.329 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 72b6c77e-64b7-433e-a633-5dba71d0b398 2 2024-04-21T22:52:38.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f322467c640 1 Processor -- start 2024-04-21T22:52:38.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f322467c640 1 -- start start 2024-04-21T22:52:38.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f322467c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c158c60 0x7f321c0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:38.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f322467c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f321c0c9980 0x7f321c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:38.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f322467c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c152730 con 0x7f321c152350 2024-04-21T22:52:38.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f322467c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f321c0c8fd0 con 0x7f321c0c9980 2024-04-21T22:52:38.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f322467c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f321c15b8a0 con 0x7f321c158c60 2024-04-21T22:52:38.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f3221c17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c158c60 0x7f321c0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:38.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f3222c19640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f321c0c9980 0x7f321c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:38.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f3221c17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c158c60 0x7f321c0c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57346/0 (socket says 172.21.15.154:57346) 2024-04-21T22:52:38.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.480+0000 7f3221c17640 1 -- 172.21.15.154:0/1118650897 learned_addr learned my addr 172.21.15.154:0/1118650897 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:38.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.484+0000 7f3221c17640 1 -- 172.21.15.154:0/1118650897 >> v2:172.21.15.154:3300/0 conn(0x7f321c0c9980 msgr2=0x7f321c0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:38.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.484+0000 7f3221c17640 1 --2- 172.21.15.154:0/1118650897 >> v2:172.21.15.154:3300/0 conn(0x7f321c0c9980 0x7f321c0ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.484+0000 7f3221c17640 1 -- 172.21.15.154:0/1118650897 >> v1:172.21.15.154:6789/0 conn(0x7f321c152350 legacy=0x7f321c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:38.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.484+0000 7f3221c17640 1 -- 172.21.15.154:0/1118650897 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c15bb80 con 0x7f321c158c60 2024-04-21T22:52:38.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.488+0000 7f3221c17640 1 --2- 172.21.15.154:0/1118650897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c158c60 0x7f321c0c9440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f320c009870 tx=0x7f320c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=453a75976d13d1e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f3221416640 1 -- 172.21.15.154:0/1118650897 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c0b5070 con 0x7f321c158c60 2024-04-21T22:52:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f3221416640 1 -- 172.21.15.154:0/1118650897 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320c0a89d0 con 0x7f321c158c60 2024-04-21T22:52:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f3221416640 1 -- 172.21.15.154:0/1118650897 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c0a8da0 con 0x7f321c158c60 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- 172.21.15.154:0/1118650897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c158c60 msgr2=0x7f321c0c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 --2- 172.21.15.154:0/1118650897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c158c60 0x7f321c0c9440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f320c009870 tx=0x7f320c01ed10 comp rx=0 tx=0).stop 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- 172.21.15.154:0/1118650897 shutdown_connections 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 --2- 172.21.15.154:0/1118650897 >> v2:172.21.15.154:3300/0 conn(0x7f321c0c9980 0x7f321c0ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 --2- 172.21.15.154:0/1118650897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c158c60 0x7f321c0c9440 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- 172.21.15.154:0/1118650897 >> 172.21.15.154:0/1118650897 conn(0x7f321c0714d0 msgr2=0x7f321c0718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- 172.21.15.154:0/1118650897 shutdown_connections 2024-04-21T22:52:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- 172.21.15.154:0/1118650897 wait complete. 2024-04-21T22:52:38.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 Processor -- start 2024-04-21T22:52:38.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- start start 2024-04-21T22:52:38.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c0c9980 0x7f321c14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f321c152350 0x7f321c1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c158c60 0x7f321c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f321c15c420 con 0x7f321c152350 2024-04-21T22:52:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f321c15c140 con 0x7f321c158c60 2024-04-21T22:52:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.492+0000 7f322467c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f321c0ca020 con 0x7f321c0c9980 2024-04-21T22:52:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.496+0000 7f3222418640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c0c9980 0x7f321c14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.496+0000 7f3222c19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c158c60 0x7f321c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.496+0000 7f3222418640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c0c9980 0x7f321c14d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57352/0 (socket says 172.21.15.154:57352) 2024-04-21T22:52:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.496+0000 7f3222418640 1 -- 172.21.15.154:0/1349862579 learned_addr learned my addr 172.21.15.154:0/1349862579 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.496+0000 7f3221c17640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f321c152350 0x7f321c1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:38.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.500+0000 7f3222c19640 1 -- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c0c9980 msgr2=0x7f321c14d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:38.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.500+0000 7f3222c19640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c0c9980 0x7f321c14d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.500+0000 7f3222c19640 1 -- 172.21.15.154:0/1349862579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f321c152350 msgr2=0x7f321c1f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:38.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.500+0000 7f3222c19640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f321c152350 0x7f321c1f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:38.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.500+0000 7f3222c19640 1 -- 172.21.15.154:0/1349862579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c0cc170 con 0x7f321c158c60 2024-04-21T22:52:38.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.500+0000 7f3222418640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c0c9980 0x7f321c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:52:38.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.504+0000 7f3222c19640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c158c60 0x7f321c14e500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f321400e7d0 tx=0x7f321400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:38.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.504+0000 7f3212ffd640 1 -- 172.21.15.154:0/1349862579 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214017070 con 0x7f321c158c60 2024-04-21T22:52:38.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.504+0000 7f3212ffd640 1 -- 172.21.15.154:0/1349862579 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321400c940 con 0x7f321c158c60 2024-04-21T22:52:38.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.504+0000 7f3212ffd640 1 -- 172.21.15.154:0/1349862579 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321400cd30 con 0x7f321c158c60 2024-04-21T22:52:38.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.508+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c0cc450 con 0x7f321c158c60 2024-04-21T22:52:38.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.508+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c14d070 con 0x7f321c158c60 2024-04-21T22:52:38.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.508+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321c04f510 con 0x7f321c158c60 2024-04-21T22:52:38.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.532+0000 7f3212ffd640 1 -- 172.21.15.154:0/1349862579 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f321401a070 con 0x7f321c158c60 2024-04-21T22:52:38.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.532+0000 7f3212ffd640 1 -- 172.21.15.154:0/1349862579 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3214013470 con 0x7f321c158c60 2024-04-21T22:52:38.652 INFO:tasks.ceph.mgr.y.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-21T22:52:38.652 INFO:tasks.ceph.mgr.y.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-21T22:52:38.652 INFO:tasks.ceph.mgr.y.smithi110.stderr: from numpy import show_config as show_numpy_config 2024-04-21T22:52:38.654 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-21T22:52:38.654 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-21T22:52:38.654 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2024-04-21T22:52:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.728+0000 7f3212ffd640 1 -- 172.21.15.154:0/1349862579 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f32140065c0 con 0x7f321c158c60 2024-04-21T22:52:38.730 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:38.728+0000 7fef6854d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:52:38.739 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:38.735+0000 7f11bf688180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:52:38.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:38.828+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72b6c77e-64b7-433e-a633-5dba71d0b398", "id": 2} v 0) -- 0x7f321c0c9220 con 0x7f321c158c60 2024-04-21T22:52:38.904 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:38.900+0000 7fef6854d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:52:38.935 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:38.931+0000 7f11bf688180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:52:39.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.020+0000 7f3212ffd640 1 -- 172.21.15.154:0/1349862579 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72b6c77e-64b7-433e-a633-5dba71d0b398", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f32140059a0 con 0x7f321c158c60 2024-04-21T22:52:39.023 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c158c60 msgr2=0x7f321c14e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c158c60 0x7f321c14e500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f321400e7d0 tx=0x7f321400ec90 comp rx=0 tx=0).stop 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 shutdown_connections 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c158c60 0x7f321c14e500 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f321c152350 0x7f321c1f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 --2- 172.21.15.154:0/1349862579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c0c9980 0x7f321c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 >> 172.21.15.154:0/1349862579 conn(0x7f321c0714d0 msgr2=0x7f321c0c3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 shutdown_connections 2024-04-21T22:52:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.024+0000 7f322467c640 1 -- 172.21.15.154:0/1349862579 wait complete. 2024-04-21T22:52:39.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a95f70c3-76f1-4d46-97ed-1ed4582803e5 3 2024-04-21T22:52:39.086 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:39.084+0000 7fef6854d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:52:39.092 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:39.091+0000 7f11bf688180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:52:39.152 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:39.152+0000 7fef6854d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:52:39.162 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:39.159+0000 7f11bf688180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:52:39.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.160+0000 7f6b05388640 1 Processor -- start 2024-04-21T22:52:39.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.160+0000 7f6b05388640 1 -- start start 2024-04-21T22:52:39.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6b05388640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b000ca2a0 0x7f6b0006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6b05388640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b00158b90 con 0x7f6b000727a0 2024-04-21T22:52:39.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6b05388640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b00158e70 con 0x7f6b001521d0 2024-04-21T22:52:39.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6b05388640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6b001525b0 con 0x7f6b000ca2a0 2024-04-21T22:52:39.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6afeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6b001521d0 0x7f6b000704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59216/0 (socket says 172.21.15.154:59216) 2024-04-21T22:52:39.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6afeffd640 1 -- 172.21.15.154:0/3080323591 learned_addr learned my addr 172.21.15.154:0/3080323591 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-21T22:52:39.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6afe7fc640 1 --2- 172.21.15.154:0/3080323591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b000ca2a0 0x7f6b0006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6afdffb640 1 -- 172.21.15.154:0/3080323591 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901392869 0 0) 0x7f6b00158e70 con 0x7f6b001521d0 2024-04-21T22:52:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.164+0000 7f6afdffb640 1 -- 172.21.15.154:0/3080323591 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ae8003530 con 0x7f6b001521d0 2024-04-21T22:52:39.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.168+0000 7f6afe7fc640 1 -- 172.21.15.154:0/3080323591 >> v1:172.21.15.154:6789/0 conn(0x7f6b001521d0 legacy=0x7f6b000704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.168+0000 7f6afe7fc640 1 -- 172.21.15.154:0/3080323591 >> v1:172.21.15.110:6789/0 conn(0x7f6b000727a0 legacy=0x7f6b0015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.168+0000 7f6afe7fc640 1 -- 172.21.15.154:0/3080323591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0006bc60 con 0x7f6b000ca2a0 2024-04-21T22:52:39.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.172+0000 7f6afe7fc640 1 --2- 172.21.15.154:0/3080323591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b000ca2a0 0x7f6b0006b1e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6af40097f0 tx=0x7f6af401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ba210a46b7ad8a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6afdffb640 1 -- 172.21.15.154:0/3080323591 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af40b0070 con 0x7f6b000ca2a0 2024-04-21T22:52:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6afdffb640 1 -- 172.21.15.154:0/3080323591 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af40ab600 con 0x7f6b000ca2a0 2024-04-21T22:52:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6afdffb640 1 -- 172.21.15.154:0/3080323591 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af40ab9d0 con 0x7f6b000ca2a0 2024-04-21T22:52:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 -- 172.21.15.154:0/3080323591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b000ca2a0 msgr2=0x7f6b0006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 --2- 172.21.15.154:0/3080323591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b000ca2a0 0x7f6b0006b1e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6af40097f0 tx=0x7f6af401c4e0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 -- 172.21.15.154:0/3080323591 shutdown_connections 2024-04-21T22:52:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 --2- 172.21.15.154:0/3080323591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b000ca2a0 0x7f6b0006b1e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 -- 172.21.15.154:0/3080323591 >> 172.21.15.154:0/3080323591 conn(0x7f6b0006e590 msgr2=0x7f6b0006e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:39.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 -- 172.21.15.154:0/3080323591 shutdown_connections 2024-04-21T22:52:39.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 -- 172.21.15.154:0/3080323591 wait complete. 2024-04-21T22:52:39.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 Processor -- start 2024-04-21T22:52:39.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.176+0000 7f6b05388640 1 -- start start 2024-04-21T22:52:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6b05388640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b000727a0 0x7f6b0014def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6b05388640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b000ca2a0 0x7f6b000c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6b05388640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b001521d0 0x7f6b000c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6b05388640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6b001669c0 con 0x7f6b000727a0 2024-04-21T22:52:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6b05388640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b00166840 con 0x7f6b000ca2a0 2024-04-21T22:52:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6b05388640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6b00166b40 con 0x7f6b001521d0 2024-04-21T22:52:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6afe7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b000ca2a0 0x7f6b000c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6aff7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b001521d0 0x7f6b000c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6afe7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b000ca2a0 0x7f6b000c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33816/0 (socket says 172.21.15.154:33816) 2024-04-21T22:52:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6afe7fc640 1 -- 172.21.15.154:0/3049631797 learned_addr learned my addr 172.21.15.154:0/3049631797 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.180+0000 7f6afeffd640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b000727a0 0x7f6b0014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.184+0000 7f6afe7fc640 1 -- 172.21.15.154:0/3049631797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b001521d0 msgr2=0x7f6b000c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.184+0000 7f6afe7fc640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b001521d0 0x7f6b000c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.184+0000 7f6afe7fc640 1 -- 172.21.15.154:0/3049631797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b000727a0 msgr2=0x7f6b0014def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.184+0000 7f6afe7fc640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b000727a0 0x7f6b0014def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.184+0000 7f6afe7fc640 1 -- 172.21.15.154:0/3049631797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b001f7b80 con 0x7f6b000ca2a0 2024-04-21T22:52:39.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.184+0000 7f6afe7fc640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b000ca2a0 0x7f6b000c2090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6af40097f0 tx=0x7f6af4019280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:39.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.188+0000 7f6ae77fe640 1 -- 172.21.15.154:0/3049631797 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af40b0040 con 0x7f6b000ca2a0 2024-04-21T22:52:39.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.188+0000 7f6ae77fe640 1 -- 172.21.15.154:0/3049631797 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af40ba070 con 0x7f6b000ca2a0 2024-04-21T22:52:39.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.188+0000 7f6ae77fe640 1 -- 172.21.15.154:0/3049631797 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4006e20 con 0x7f6b000ca2a0 2024-04-21T22:52:39.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.188+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b001f7040 con 0x7f6b000ca2a0 2024-04-21T22:52:39.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.188+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b001f75c0 con 0x7f6b000ca2a0 2024-04-21T22:52:39.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.192+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b00144350 con 0x7f6b000ca2a0 2024-04-21T22:52:39.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.192+0000 7f6ae77fe640 1 -- 172.21.15.154:0/3049631797 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6af40b4650 con 0x7f6b000ca2a0 2024-04-21T22:52:39.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.192+0000 7f6ae77fe640 1 -- 172.21.15.154:0/3049631797 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6af40b4dd0 con 0x7f6b000ca2a0 2024-04-21T22:52:39.298 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:39.296+0000 7fef6854d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:52:39.309 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:39.307+0000 7f11bf688180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:52:39.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.308+0000 7f6ae77fe640 1 -- 172.21.15.154:0/3049631797 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6b00144350 con 0x7f6b000ca2a0 2024-04-21T22:52:39.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.388+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a95f70c3-76f1-4d46-97ed-1ed4582803e5", "id": 3} v 0) -- 0x7f6b0004f510 con 0x7f6b000ca2a0 2024-04-21T22:52:39.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.620+0000 7f6ae77fe640 1 -- 172.21.15.154:0/3049631797 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a95f70c3-76f1-4d46-97ed-1ed4582803e5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6af40160d0 con 0x7f6b000ca2a0 2024-04-21T22:52:39.624 INFO:teuthology.orchestra.run.smithi154.stdout:3 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b000ca2a0 msgr2=0x7f6b000c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b000ca2a0 0x7f6b000c2090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6af40097f0 tx=0x7f6af4019280 comp rx=0 tx=0).stop 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 shutdown_connections 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b001521d0 0x7f6b000c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b000ca2a0 0x7f6b000c2090 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 --2- 172.21.15.154:0/3049631797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b000727a0 0x7f6b0014def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 >> 172.21.15.154:0/3049631797 conn(0x7f6b0006e590 msgr2=0x7f6b000732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 shutdown_connections 2024-04-21T22:52:39.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.624+0000 7f6b05388640 1 -- 172.21.15.154:0/3049631797 wait complete. 2024-04-21T22:52:39.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 7578002a-8aec-4fe4-b5f5-d14527a05758 4 2024-04-21T22:52:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.796+0000 7f6653cd7640 1 Processor -- start 2024-04-21T22:52:39.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.796+0000 7f6653cd7640 1 -- start start 2024-04-21T22:52:39.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.796+0000 7f6653cd7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f664c0c98d0 0x7f664c0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.796+0000 7f6653cd7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f664c154980 0x7f664c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.796+0000 7f6653cd7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c0c8410 con 0x7f664c0c9cb0 2024-04-21T22:52:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.796+0000 7f6653cd7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f664c0c81e0 con 0x7f664c154980 2024-04-21T22:52:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.796+0000 7f6653cd7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f664c0c86b0 con 0x7f664c0c98d0 2024-04-21T22:52:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.800+0000 7f6651a73640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f664c0c98d0 0x7f664c0c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.800+0000 7f6651a73640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f664c0c98d0 0x7f664c0c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33820/0 (socket says 172.21.15.154:33820) 2024-04-21T22:52:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.800+0000 7f6651a73640 1 -- 172.21.15.154:0/3663230992 learned_addr learned my addr 172.21.15.154:0/3663230992 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.800+0000 7f6651a73640 1 -- 172.21.15.154:0/3663230992 >> v2:172.21.15.110:3300/0 conn(0x7f664c154980 msgr2=0x7f664c15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.800+0000 7f6651a73640 1 --2- 172.21.15.154:0/3663230992 >> v2:172.21.15.110:3300/0 conn(0x7f664c154980 0x7f664c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.800+0000 7f6651a73640 1 -- 172.21.15.154:0/3663230992 >> v1:172.21.15.110:6789/0 conn(0x7f664c0c9cb0 legacy=0x7f664c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.800+0000 7f6651a73640 1 -- 172.21.15.154:0/3663230992 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c072d30 con 0x7f664c0c98d0 2024-04-21T22:52:39.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.804+0000 7f6651a73640 1 --2- 172.21.15.154:0/3663230992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c0c1bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f664c0c7280 tx=0x7f664801ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155cb2d49c4ec67d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6650a71640 1 -- 172.21.15.154:0/3663230992 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66480b5070 con 0x7f664c0c98d0 2024-04-21T22:52:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6650a71640 1 -- 172.21.15.154:0/3663230992 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66480a89d0 con 0x7f664c0c98d0 2024-04-21T22:52:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6650a71640 1 -- 172.21.15.154:0/3663230992 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66480a8da0 con 0x7f664c0c98d0 2024-04-21T22:52:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 -- 172.21.15.154:0/3663230992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 msgr2=0x7f664c0c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 --2- 172.21.15.154:0/3663230992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c0c1bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f664c0c7280 tx=0x7f664801ecd0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 -- 172.21.15.154:0/3663230992 shutdown_connections 2024-04-21T22:52:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 --2- 172.21.15.154:0/3663230992 >> v2:172.21.15.110:3300/0 conn(0x7f664c154980 0x7f664c15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 --2- 172.21.15.154:0/3663230992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c0c1bb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 -- 172.21.15.154:0/3663230992 >> 172.21.15.154:0/3663230992 conn(0x7f664c06ca80 msgr2=0x7f664c070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 -- 172.21.15.154:0/3663230992 shutdown_connections 2024-04-21T22:52:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.808+0000 7f6653cd7640 1 -- 172.21.15.154:0/3663230992 wait complete. 2024-04-21T22:52:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 Processor -- start 2024-04-21T22:52:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 -- start start 2024-04-21T22:52:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f664c0c9cb0 0x7f664c0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f664c154980 0x7f664c150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f664c06efe0 con 0x7f664c154980 2024-04-21T22:52:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f664c072ae0 con 0x7f664c0c98d0 2024-04-21T22:52:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6653cd7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f664c06f160 con 0x7f664c0c9cb0 2024-04-21T22:52:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6651a73640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6651272640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f664c0c9cb0 0x7f664c0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6651a73640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c14f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33830/0 (socket says 172.21.15.154:33830) 2024-04-21T22:52:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.812+0000 7f6651a73640 1 -- 172.21.15.154:0/4070138723 learned_addr learned my addr 172.21.15.154:0/4070138723 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.816+0000 7f6651a73640 1 -- 172.21.15.154:0/4070138723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f664c0c9cb0 msgr2=0x7f664c0c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.816+0000 7f6651a73640 1 --2- 172.21.15.154:0/4070138723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f664c0c9cb0 0x7f664c0c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.816+0000 7f6651a73640 1 -- 172.21.15.154:0/4070138723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f664c154980 msgr2=0x7f664c150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.816+0000 7f6651a73640 1 --2- 172.21.15.154:0/4070138723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f664c154980 0x7f664c150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.816+0000 7f6651a73640 1 -- 172.21.15.154:0/4070138723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c14fda0 con 0x7f664c0c98d0 2024-04-21T22:52:39.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.816+0000 7f6651a73640 1 --2- 172.21.15.154:0/4070138723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c14f1e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f664801c900 tx=0x7f664801ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.820+0000 7f66427fc640 1 -- 172.21.15.154:0/4070138723 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66480b5050 con 0x7f664c0c98d0 2024-04-21T22:52:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.820+0000 7f66427fc640 1 -- 172.21.15.154:0/4070138723 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66480bf070 con 0x7f664c0c98d0 2024-04-21T22:52:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.820+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664c0c5870 con 0x7f664c0c98d0 2024-04-21T22:52:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.820+0000 7f66427fc640 1 -- 172.21.15.154:0/4070138723 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66480b0c50 con 0x7f664c0c98d0 2024-04-21T22:52:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.820+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f664c0c5e30 con 0x7f664c0c98d0 2024-04-21T22:52:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.824+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664c04f510 con 0x7f664c0c98d0 2024-04-21T22:52:39.940 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:39.940+0000 7fef6854d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:52:39.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.940+0000 7f66427fc640 1 -- 172.21.15.154:0/4070138723 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f66480c4460 con 0x7f664c0c98d0 2024-04-21T22:52:39.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.940+0000 7f66427fc640 1 -- 172.21.15.154:0/4070138723 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f66480ba950 con 0x7f664c0c98d0 2024-04-21T22:52:39.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:39.940+0000 7f66427fc640 1 -- 172.21.15.154:0/4070138723 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f66480cb070 con 0x7f664c0c98d0 2024-04-21T22:52:39.961 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:39.959+0000 7f11bf688180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:52:40.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.012+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7578002a-8aec-4fe4-b5f5-d14527a05758", "id": 4} v 0) -- 0x7f664c073400 con 0x7f664c0c98d0 2024-04-21T22:52:40.018 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:40.016+0000 7fef6854d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:52:40.042 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:40.039+0000 7f11bf688180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:52:40.202 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:40.200+0000 7fef6854d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:52:40.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.220+0000 7f66427fc640 1 -- 172.21.15.154:0/4070138723 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7578002a-8aec-4fe4-b5f5-d14527a05758", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6648018830 con 0x7f664c0c98d0 2024-04-21T22:52:40.224 INFO:teuthology.orchestra.run.smithi154.stdout:4 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 msgr2=0x7f664c14f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 --2- 172.21.15.154:0/4070138723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c14f1e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f664801c900 tx=0x7f664801ba70 comp rx=0 tx=0).stop 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 shutdown_connections 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 --2- 172.21.15.154:0/4070138723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f664c154980 0x7f664c150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 --2- 172.21.15.154:0/4070138723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f664c0c9cb0 0x7f664c0c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 --2- 172.21.15.154:0/4070138723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f664c0c98d0 0x7f664c14f1e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 >> 172.21.15.154:0/4070138723 conn(0x7f664c06ca80 msgr2=0x7f664c0cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 shutdown_connections 2024-04-21T22:52:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.224+0000 7f6653cd7640 1 -- 172.21.15.154:0/4070138723 wait complete. 2024-04-21T22:52:40.231 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:40.227+0000 7f11bf688180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:52:40.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef 5 2024-04-21T22:52:40.281 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:40.280+0000 7fef6854d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:52:40.303 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:40.299+0000 7f11bf688180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:52:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.360+0000 7fd509495640 1 Processor -- start 2024-04-21T22:52:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.360+0000 7fd509495640 1 -- start start 2024-04-21T22:52:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.360+0000 7fd509495640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd50415a270 0x7fd50406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.360+0000 7fd509495640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50406e010 con 0x7fd5040c8be0 2024-04-21T22:52:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.360+0000 7fd509495640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50415a990 con 0x7fd504154670 2024-04-21T22:52:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.360+0000 7fd509495640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd504154a50 con 0x7fd50415a270 2024-04-21T22:52:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.364+0000 7fd5037fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd50415a270 0x7fd50406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.364+0000 7fd5037fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd50415a270 0x7fd50406fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34046/0 (socket says 172.21.15.154:34046) 2024-04-21T22:52:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.364+0000 7fd5037fe640 1 -- 172.21.15.154:0/3596060520 learned_addr learned my addr 172.21.15.154:0/3596060520 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:40.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.364+0000 7fd5037fe640 1 -- 172.21.15.154:0/3596060520 >> v1:172.21.15.154:6789/0 conn(0x7fd504154670 legacy=0x7fd50406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:40.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.364+0000 7fd5037fe640 1 -- 172.21.15.154:0/3596060520 >> v1:172.21.15.110:6789/0 conn(0x7fd5040c8be0 legacy=0x7fd50406f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.364+0000 7fd5037fe640 1 -- 172.21.15.154:0/3596060520 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50415ac70 con 0x7fd50415a270 2024-04-21T22:52:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.368+0000 7fd5037fe640 1 --2- 172.21.15.154:0/3596060520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50415a270 0x7fd50406fc10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009e50 tx=0x7fd4fc01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f60420a73d91f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:40.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd501ffb640 1 -- 172.21.15.154:0/3596060520 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0a56c0 con 0x7fd50415a270 2024-04-21T22:52:40.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd501ffb640 1 -- 172.21.15.154:0/3596060520 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc0a5860 con 0x7fd50415a270 2024-04-21T22:52:40.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd501ffb640 1 -- 172.21.15.154:0/3596060520 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0a5c30 con 0x7fd50415a270 2024-04-21T22:52:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd509495640 1 -- 172.21.15.154:0/3596060520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50415a270 msgr2=0x7fd50406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd509495640 1 --2- 172.21.15.154:0/3596060520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50415a270 0x7fd50406fc10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009e50 tx=0x7fd4fc01c9f0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd509495640 1 -- 172.21.15.154:0/3596060520 shutdown_connections 2024-04-21T22:52:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd509495640 1 --2- 172.21.15.154:0/3596060520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50415a270 0x7fd50406fc10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd509495640 1 -- 172.21.15.154:0/3596060520 >> 172.21.15.154:0/3596060520 conn(0x7fd5040714d0 msgr2=0x7fd5040718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd509495640 1 -- 172.21.15.154:0/3596060520 shutdown_connections 2024-04-21T22:52:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.372+0000 7fd509495640 1 -- 172.21.15.154:0/3596060520 wait complete. 2024-04-21T22:52:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 Processor -- start 2024-04-21T22:52:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 -- start start 2024-04-21T22:52:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040c8be0 0x7fd5041575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd504154670 0x7fd5041f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd50415a270 0x7fd5041f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5040c9e50 con 0x7fd504154670 2024-04-21T22:52:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd50415b230 con 0x7fd5040c8be0 2024-04-21T22:52:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd509495640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd504070150 con 0x7fd50415a270 2024-04-21T22:52:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd502ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040c8be0 0x7fd5041575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd5037fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd50415a270 0x7fd5041f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd502ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040c8be0 0x7fd5041575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34058/0 (socket says 172.21.15.154:34058) 2024-04-21T22:52:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.376+0000 7fd502ffd640 1 -- 172.21.15.154:0/3871045768 learned_addr learned my addr 172.21.15.154:0/3871045768 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.380+0000 7fd502ffd640 1 -- 172.21.15.154:0/3871045768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd50415a270 msgr2=0x7fd5041f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.380+0000 7fd502ffd640 1 --2- 172.21.15.154:0/3871045768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd50415a270 0x7fd5041f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.380+0000 7fd502ffd640 1 -- 172.21.15.154:0/3871045768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd504154670 msgr2=0x7fd5041f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.380+0000 7fd502ffd640 1 --2- 172.21.15.154:0/3871045768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd504154670 0x7fd5041f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.380+0000 7fd502ffd640 1 -- 172.21.15.154:0/3871045768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd504157af0 con 0x7fd5040c8be0 2024-04-21T22:52:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.384+0000 7fd502ffd640 1 --2- 172.21.15.154:0/3871045768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040c8be0 0x7fd5041575b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00c490 tx=0x7fd4ec001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:40.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.384+0000 7fd4fb7fe640 1 -- 172.21.15.154:0/3871045768 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec017070 con 0x7fd5040c8be0 2024-04-21T22:52:40.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.384+0000 7fd4fb7fe640 1 -- 172.21.15.154:0/3871045768 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec003600 con 0x7fd5040c8be0 2024-04-21T22:52:40.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.384+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd504155680 con 0x7fd5040c8be0 2024-04-21T22:52:40.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.388+0000 7fd4fb7fe640 1 -- 172.21.15.154:0/3871045768 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec003a30 con 0x7fd5040c8be0 2024-04-21T22:52:40.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.388+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50414a100 con 0x7fd5040c8be0 2024-04-21T22:52:40.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.388+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50404f510 con 0x7fd5040c8be0 2024-04-21T22:52:40.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.388+0000 7fd4fb7fe640 1 -- 172.21.15.154:0/3871045768 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd4ec01a070 con 0x7fd5040c8be0 2024-04-21T22:52:40.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.388+0000 7fd4fb7fe640 1 -- 172.21.15.154:0/3871045768 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd4ec01b930 con 0x7fd5040c8be0 2024-04-21T22:52:40.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.512+0000 7fd4fb7fe640 1 -- 172.21.15.154:0/3871045768 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd4ec021020 con 0x7fd5040c8be0 2024-04-21T22:52:40.589 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:40.588+0000 7fef6854d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:52:40.597 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:40.595+0000 7f11bf688180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:52:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.608+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef", "id": 5} v 0) -- 0x7fd5040ca7c0 con 0x7fd5040c8be0 2024-04-21T22:52:40.654 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-21T22:52:40.652+0000 7fef6854d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:52:40.674 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:40.671+0000 7f11bf688180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:52:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.768+0000 7fd4fb7fe640 1 -- 172.21.15.154:0/3871045768 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd4ec003ca0 con 0x7fd5040c8be0 2024-04-21T22:52:40.774 INFO:teuthology.orchestra.run.smithi154.stdout:5 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040c8be0 msgr2=0x7fd5041575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 --2- 172.21.15.154:0/3871045768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040c8be0 0x7fd5041575b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00c490 tx=0x7fd4ec001e80 comp rx=0 tx=0).stop 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 shutdown_connections 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 --2- 172.21.15.154:0/3871045768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd50415a270 0x7fd5041f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 --2- 172.21.15.154:0/3871045768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd504154670 0x7fd5041f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 --2- 172.21.15.154:0/3871045768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040c8be0 0x7fd5041575b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 >> 172.21.15.154:0/3871045768 conn(0x7fd5040714d0 msgr2=0x7fd5040744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 shutdown_connections 2024-04-21T22:52:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.772+0000 7fd509495640 1 -- 172.21.15.154:0/3871045768 wait complete. 2024-04-21T22:52:40.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 04879f48-085f-4926-a995-c4e1af1d600e 6 2024-04-21T22:52:40.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.952+0000 7f4c56c6b640 1 Processor -- start 2024-04-21T22:52:40.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.952+0000 7f4c56c6b640 1 -- start start 2024-04-21T22:52:40.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.952+0000 7f4c56c6b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c50156950 0x7f4c500c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.952+0000 7f4c56c6b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c5006ee90 0x7f4c5006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.952+0000 7f4c56c6b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c500c7300 con 0x7f4c50150c20 2024-04-21T22:52:40.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.952+0000 7f4c56c6b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f4c500c5640 con 0x7f4c50156950 2024-04-21T22:52:40.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.952+0000 7f4c56c6b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4c500c4da0 con 0x7f4c5006ee90 2024-04-21T22:52:40.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.956+0000 7f4c55208640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c5006ee90 0x7f4c5006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.956+0000 7f4c55208640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c5006ee90 0x7f4c5006f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34070/0 (socket says 172.21.15.154:34070) 2024-04-21T22:52:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.956+0000 7f4c55208640 1 -- 172.21.15.154:0/1119650129 learned_addr learned my addr 172.21.15.154:0/1119650129 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:40.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.960+0000 7f4c55208640 1 -- 172.21.15.154:0/1119650129 >> v2:172.21.15.110:3300/0 conn(0x7f4c50156950 msgr2=0x7f4c500c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:40.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.960+0000 7f4c55208640 1 --2- 172.21.15.154:0/1119650129 >> v2:172.21.15.110:3300/0 conn(0x7f4c50156950 0x7f4c500c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.960+0000 7f4c55208640 1 -- 172.21.15.154:0/1119650129 >> v1:172.21.15.110:6789/0 conn(0x7f4c50150c20 legacy=0x7f4c500c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:40.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.960+0000 7f4c55208640 1 -- 172.21.15.154:0/1119650129 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500c5080 con 0x7f4c5006ee90 2024-04-21T22:52:40.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.960+0000 7f4c55208640 1 --2- 172.21.15.154:0/1119650129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c5006ee90 0x7f4c5006f2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c500c4560 tx=0x7f4c480213a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcda44d14851e7f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:40.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c477fe640 1 -- 172.21.15.154:0/1119650129 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b8070 con 0x7f4c5006ee90 2024-04-21T22:52:40.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c477fe640 1 -- 172.21.15.154:0/1119650129 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c480b3410 con 0x7f4c5006ee90 2024-04-21T22:52:40.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c477fe640 1 -- 172.21.15.154:0/1119650129 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b37e0 con 0x7f4c5006ee90 2024-04-21T22:52:40.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- 172.21.15.154:0/1119650129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c5006ee90 msgr2=0x7f4c5006f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 --2- 172.21.15.154:0/1119650129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c5006ee90 0x7f4c5006f2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c500c4560 tx=0x7f4c480213a0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- 172.21.15.154:0/1119650129 shutdown_connections 2024-04-21T22:52:40.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 --2- 172.21.15.154:0/1119650129 >> v2:172.21.15.110:3300/0 conn(0x7f4c50156950 0x7f4c500c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 --2- 172.21.15.154:0/1119650129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c5006ee90 0x7f4c5006f2e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- 172.21.15.154:0/1119650129 >> 172.21.15.154:0/1119650129 conn(0x7f4c500cb710 msgr2=0x7f4c500cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:40.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- 172.21.15.154:0/1119650129 shutdown_connections 2024-04-21T22:52:40.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- 172.21.15.154:0/1119650129 wait complete. 2024-04-21T22:52:40.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 Processor -- start 2024-04-21T22:52:40.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- start start 2024-04-21T22:52:40.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c5006ee90 0x7f4c501404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c50150c20 0x7f4c50155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c50156950 0x7f4c5013cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:40.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50151000 con 0x7f4c50156950 2024-04-21T22:52:40.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500c75a0 con 0x7f4c50150c20 2024-04-21T22:52:40.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c56c6b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500c24a0 con 0x7f4c5006ee90 2024-04-21T22:52:40.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c50150c20 0x7f4c50155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:40.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c54a07640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c5006ee90 0x7f4c501404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:40.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c50150c20 0x7f4c50155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34078/0 (socket says 172.21.15.154:34078) 2024-04-21T22:52:40.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.968+0000 7f4c47fff640 1 -- 172.21.15.154:0/3262490776 learned_addr learned my addr 172.21.15.154:0/3262490776 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:40.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.972+0000 7f4c47fff640 1 -- 172.21.15.154:0/3262490776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c5006ee90 msgr2=0x7f4c501404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.972+0000 7f4c47fff640 1 --2- 172.21.15.154:0/3262490776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c5006ee90 0x7f4c501404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.972+0000 7f4c47fff640 1 -- 172.21.15.154:0/3262490776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c50156950 msgr2=0x7f4c5013cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:40.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.972+0000 7f4c47fff640 1 --2- 172.21.15.154:0/3262490776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c50156950 0x7f4c5013cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:40.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.972+0000 7f4c47fff640 1 -- 172.21.15.154:0/3262490776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500c9a70 con 0x7f4c50150c20 2024-04-21T22:52:40.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.976+0000 7f4c47fff640 1 --2- 172.21.15.154:0/3262490776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c50150c20 0x7f4c50155140 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000b410 tx=0x7f4c4000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.980+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40015020 con 0x7f4c50150c20 2024-04-21T22:52:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.980+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c40011830 con 0x7f4c50150c20 2024-04-21T22:52:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.980+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c50146700 con 0x7f4c50150c20 2024-04-21T22:52:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.980+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011c20 con 0x7f4c50150c20 2024-04-21T22:52:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.980+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c50146cc0 con 0x7f4c50150c20 2024-04-21T22:52:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.980+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5004f510 con 0x7f4c50150c20 2024-04-21T22:52:40.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.984+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c40018020 con 0x7f4c50150c20 2024-04-21T22:52:40.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:40.984+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f4c4001add0 con 0x7f4c50150c20 2024-04-21T22:52:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:41.108+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4c4001f020 con 0x7f4c50150c20 2024-04-21T22:52:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:41.188+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "04879f48-085f-4926-a995-c4e1af1d600e", "id": 6} v 0) -- 0x7f4c500c6280 con 0x7f4c50150c20 2024-04-21T22:52:41.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:41.528+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 2) ==== 43764+0+0 (secure 0 0 0) 0x7f4c4002b0b0 con 0x7f4c50150c20 2024-04-21T22:52:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c457fa640 1 -- 172.21.15.154:0/3262490776 <== mon.1 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04879f48-085f-4926-a995-c4e1af1d600e", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f4c400151c0 con 0x7f4c50150c20 2024-04-21T22:52:42.121 INFO:teuthology.orchestra.run.smithi154.stdout:6 2024-04-21T22:52:42.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c50150c20 msgr2=0x7f4c50155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:42.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 --2- 172.21.15.154:0/3262490776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c50150c20 0x7f4c50155140 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000b410 tx=0x7f4c4000b8d0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 shutdown_connections 2024-04-21T22:52:42.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 --2- 172.21.15.154:0/3262490776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c50156950 0x7f4c5013cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 --2- 172.21.15.154:0/3262490776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c50150c20 0x7f4c50155140 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 --2- 172.21.15.154:0/3262490776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c5006ee90 0x7f4c501404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 >> 172.21.15.154:0/3262490776 conn(0x7f4c500cb710 msgr2=0x7f4c500cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 shutdown_connections 2024-04-21T22:52:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.120+0000 7f4c56c6b640 1 -- 172.21.15.154:0/3262490776 wait complete. 2024-04-21T22:52:42.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1d703942-79e0-4e05-9660-535cb4c620a3 7 2024-04-21T22:52:42.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.268+0000 7f34b68ab640 1 Processor -- start 2024-04-21T22:52:42.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.268+0000 7f34b68ab640 1 -- start start 2024-04-21T22:52:42.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34b68ab640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34b00c59e0 0x7f34b013d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:42.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34b68ab640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34b00c5dc0 0x7f34b013dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:42.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34b68ab640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b015b800 con 0x7f34b0158e30 2024-04-21T22:52:42.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34b68ab640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f34b015c410 con 0x7f34b00c5dc0 2024-04-21T22:52:42.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34b68ab640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f34b015bae0 con 0x7f34b00c59e0 2024-04-21T22:52:42.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34affff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34b00c59e0 0x7f34b013d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:42.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34a7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f34b0158e30 0x7f34b00c8930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55210/0 (socket says 172.21.15.154:55210) 2024-04-21T22:52:42.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.272+0000 7f34a7fff640 1 -- 172.21.15.154:0/2159498221 learned_addr learned my addr 172.21.15.154:0/2159498221 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-21T22:52:42.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.276+0000 7f34affff640 1 -- 172.21.15.154:0/2159498221 >> v2:172.21.15.110:3300/0 conn(0x7f34b00c5dc0 msgr2=0x7f34b013dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:42.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.276+0000 7f34affff640 1 --2- 172.21.15.154:0/2159498221 >> v2:172.21.15.110:3300/0 conn(0x7f34b00c5dc0 0x7f34b013dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.276+0000 7f34affff640 1 -- 172.21.15.154:0/2159498221 >> v1:172.21.15.154:6789/0 conn(0x7f34b0158e30 legacy=0x7f34b00c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:42.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.276+0000 7f34affff640 1 -- 172.21.15.154:0/2159498221 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b015bdc0 con 0x7f34b00c59e0 2024-04-21T22:52:42.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.280+0000 7f34affff640 1 --2- 172.21.15.154:0/2159498221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b013d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34b0071b20 tx=0x7f34a001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b28023af2b5859f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.280+0000 7f34af7fe640 1 -- 172.21.15.154:0/2159498221 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a00b5070 con 0x7f34b00c59e0 2024-04-21T22:52:42.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34af7fe640 1 -- 172.21.15.154:0/2159498221 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a00a8970 con 0x7f34b00c59e0 2024-04-21T22:52:42.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34af7fe640 1 -- 172.21.15.154:0/2159498221 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a00a8d40 con 0x7f34b00c59e0 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 -- 172.21.15.154:0/2159498221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 msgr2=0x7f34b013d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 --2- 172.21.15.154:0/2159498221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b013d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34b0071b20 tx=0x7f34a001ec70 comp rx=0 tx=0).stop 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 -- 172.21.15.154:0/2159498221 shutdown_connections 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 --2- 172.21.15.154:0/2159498221 >> v2:172.21.15.110:3300/0 conn(0x7f34b00c5dc0 0x7f34b013dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 --2- 172.21.15.154:0/2159498221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b013d850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 -- 172.21.15.154:0/2159498221 >> 172.21.15.154:0/2159498221 conn(0x7f34b0071f90 msgr2=0x7f34b00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 -- 172.21.15.154:0/2159498221 shutdown_connections 2024-04-21T22:52:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 -- 172.21.15.154:0/2159498221 wait complete. 2024-04-21T22:52:42.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.284+0000 7f34b68ab640 1 Processor -- start 2024-04-21T22:52:42.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b68ab640 1 -- start start 2024-04-21T22:52:42.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b68ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:42.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b68ab640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00c5dc0 0x7f34b00cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:42.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b68ab640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34b0158e30 0x7f34b01ee630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:42.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b68ab640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f34b00c91c0 con 0x7f34b00c5dc0 2024-04-21T22:52:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b68ab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34b00c9040 con 0x7f34b00c59e0 2024-04-21T22:52:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b68ab640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f34b015b480 con 0x7f34b0158e30 2024-04-21T22:52:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34affff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34b4e48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34b0158e30 0x7f34b01ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34affff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b00caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34092/0 (socket says 172.21.15.154:34092) 2024-04-21T22:52:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.288+0000 7f34affff640 1 -- 172.21.15.154:0/1651562706 learned_addr learned my addr 172.21.15.154:0/1651562706 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-21T22:52:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.292+0000 7f34affff640 1 -- 172.21.15.154:0/1651562706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34b0158e30 msgr2=0x7f34b01ee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.292+0000 7f34affff640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34b0158e30 0x7f34b01ee630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.292+0000 7f34affff640 1 -- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00c5dc0 msgr2=0x7f34b00cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.292+0000 7f34affff640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00c5dc0 0x7f34b00cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.292+0000 7f34affff640 1 -- 172.21.15.154:0/1651562706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b01eeb70 con 0x7f34b00c59e0 2024-04-21T22:52:42.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.296+0000 7f34affff640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b00caf40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34a00b3040 tx=0x7f34a001ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:42.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.304+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a00b5040 con 0x7f34b00c59e0 2024-04-21T22:52:42.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.304+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a00bf070 con 0x7f34b00c59e0 2024-04-21T22:52:42.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.304+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a00b0b20 con 0x7f34b00c59e0 2024-04-21T22:52:42.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.304+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b015aec0 con 0x7f34b00c59e0 2024-04-21T22:52:42.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.304+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b00ca460 con 0x7f34b00c59e0 2024-04-21T22:52:42.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.304+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b004f510 con 0x7f34b00c59e0 2024-04-21T22:52:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.428+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 2) ==== 43764+0+0 (secure 0 0 0) 0x7f34a00b0cc0 con 0x7f34b00c59e0 2024-04-21T22:52:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.444+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f34a00b9c40 con 0x7f34b00c59e0 2024-04-21T22:52:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.444+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f34a00187d0 con 0x7f34b00c59e0 2024-04-21T22:52:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:42.528+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d703942-79e0-4e05-9660-535cb4c620a3", "id": 7} v 0) -- 0x7f34b0070970 con 0x7f34b00c59e0 2024-04-21T22:52:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.428+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 3) ==== 87283+0+0 (secure 0 0 0) 0x7f34a00c4b20 con 0x7f34b00c59e0 2024-04-21T22:52:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.428+0000 7f34ad7fa640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3490067af0 0x7f3490069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.428+0000 7f34a7fff640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3490067af0 0x7f3490069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:43.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.428+0000 7f34a7fff640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3490067af0 0x7f3490069ee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f34b006c3e0 tx=0x7f3498007a50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:43.524 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:43.523+0000 7f1166ad1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-21T22:52:43.559 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-21T22:52:43.555+0000 7f1166ad1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-21T22:52:43.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.988+0000 7f34ad7fa640 1 -- 172.21.15.154:0/1651562706 <== mon.1 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d703942-79e0-4e05-9660-535cb4c620a3", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f34a00cd3e0 con 0x7f34b00c59e0 2024-04-21T22:52:43.990 INFO:teuthology.orchestra.run.smithi154.stdout:7 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.988+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3490067af0 msgr2=0x7f3490069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.988+0000 7f34b68ab640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3490067af0 0x7f3490069ee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f34b006c3e0 tx=0x7f3498007a50 comp rx=0 tx=0).stop 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.988+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 msgr2=0x7f34b00caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.988+0000 7f34b68ab640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b00caf40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34a00b3040 tx=0x7f34a001ba10 comp rx=0 tx=0).stop 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 shutdown_connections 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3490067af0 0x7f3490069ee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34b0158e30 0x7f34b01ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00c5dc0 0x7f34b00cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 --2- 172.21.15.154:0/1651562706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b00c59e0 0x7f34b00caf40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:43.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 >> 172.21.15.154:0/1651562706 conn(0x7f34b0071f90 msgr2=0x7f34b013b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:43.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 shutdown_connections 2024-04-21T22:52:43.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-21T22:52:43.992+0000 7f34b68ab640 1 -- 172.21.15.154:0/1651562706 wait complete. 2024-04-21T22:52:44.016 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-21T22:52:44.016 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-21T22:52:44.019 INFO:tasks.ceph.osd.0:Started 2024-04-21T22:52:44.019 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-21T22:52:44.019 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-21T22:52:44.024 INFO:tasks.ceph.osd.1:Started 2024-04-21T22:52:44.024 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-21T22:52:44.024 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-21T22:52:44.026 INFO:tasks.ceph.osd.2:Started 2024-04-21T22:52:44.026 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-21T22:52:44.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-21T22:52:44.029 INFO:tasks.ceph.osd.3:Started 2024-04-21T22:52:44.029 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-21T22:52:44.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-21T22:52:44.031 INFO:tasks.ceph.osd.4:Started 2024-04-21T22:52:44.031 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-21T22:52:44.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-21T22:52:44.033 INFO:tasks.ceph.osd.5:Started 2024-04-21T22:52:44.033 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-21T22:52:44.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-21T22:52:44.035 INFO:tasks.ceph.osd.6:Started 2024-04-21T22:52:44.035 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-21T22:52:44.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-21T22:52:44.037 INFO:tasks.ceph.osd.7:Started 2024-04-21T22:52:44.038 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.163+0000 7f7c9bdcd640 1 Processor -- start 2024-04-21T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c9bdcd640 1 -- start start 2024-04-21T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c9bdcd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c94154560 0x7f7c940c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c9bdcd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c940c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c9bdcd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c940ca0c0 con 0x7f7c9406c700 2024-04-21T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c9bdcd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7c940c9e70 con 0x7f7c94154560 2024-04-21T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c9bdcd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7c940cacd0 con 0x7f7c940c4240 2024-04-21T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c99b69640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c94154560 0x7f7c940c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c99368640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c940c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c99368640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c940c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:34148/0 (socket says 172.21.15.110:34148) 2024-04-21T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.167+0000 7f7c99368640 1 -- 172.21.15.110:0/1929610047 learned_addr learned my addr 172.21.15.110:0/1929610047 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.171+0000 7f7c99368640 1 -- 172.21.15.110:0/1929610047 >> v2:172.21.15.154:3300/0 conn(0x7f7c94154560 msgr2=0x7f7c940c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.171+0000 7f7c99368640 1 --2- 172.21.15.110:0/1929610047 >> v2:172.21.15.154:3300/0 conn(0x7f7c94154560 0x7f7c940c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.171+0000 7f7c99368640 1 -- 172.21.15.110:0/1929610047 >> v1:172.21.15.110:6789/0 conn(0x7f7c9406c700 legacy=0x7f7c9415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.171+0000 7f7c99368640 1 -- 172.21.15.110:0/1929610047 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c940ca3a0 con 0x7f7c940c4240 2024-04-21T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.171+0000 7f7c99368640 1 --2- 172.21.15.110:0/1929610047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c940c8af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f9ee360524a7a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c98b67640 1 -- 172.21.15.110:0/1929610047 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b5070 con 0x7f7c940c4240 2024-04-21T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c98b67640 1 -- 172.21.15.110:0/1929610047 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900a89d0 con 0x7f7c940c4240 2024-04-21T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c98b67640 1 -- 172.21.15.110:0/1929610047 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900a8da0 con 0x7f7c940c4240 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/1929610047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 msgr2=0x7f7c940c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/1929610047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c940c8af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9001ed10 comp rx=0 tx=0).stop 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/1929610047 shutdown_connections 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/1929610047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c940c8af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/1929610047 >> v2:172.21.15.154:3300/0 conn(0x7f7c94154560 0x7f7c940c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/1929610047 >> 172.21.15.110:0/1929610047 conn(0x7f7c94062670 msgr2=0x7f7c94071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/1929610047 shutdown_connections 2024-04-21T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/1929610047 wait complete. 2024-04-21T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 Processor -- start 2024-04-21T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 -- start start 2024-04-21T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c9406c700 0x7f7c941e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c94145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.179+0000 7f7c9bdcd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c94154560 0x7f7c941e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.183+0000 7f7c9bdcd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7c940c9b80 con 0x7f7c9406c700 2024-04-21T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.183+0000 7f7c9bdcd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c940ca960 con 0x7f7c94154560 2024-04-21T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.183+0000 7f7c9bdcd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9415e000 con 0x7f7c940c4240 2024-04-21T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.183+0000 7f7c99368640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c94145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.183+0000 7f7c9a36a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c94154560 0x7f7c941e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.183+0000 7f7c99368640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c94145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:34158/0 (socket says 172.21.15.110:34158) 2024-04-21T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.183+0000 7f7c99368640 1 -- 172.21.15.110:0/3641560400 learned_addr learned my addr 172.21.15.110:0/3641560400 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.187+0000 7f7c99368640 1 -- 172.21.15.110:0/3641560400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c94154560 msgr2=0x7f7c941e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.187+0000 7f7c99368640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c94154560 0x7f7c941e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.187+0000 7f7c99368640 1 -- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c9406c700 msgr2=0x7f7c941e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.187+0000 7f7c99368640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c9406c700 0x7f7c941e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.187+0000 7f7c99368640 1 -- 172.21.15.110:0/3641560400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c941e33a0 con 0x7f7c940c4240 2024-04-21T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.191+0000 7f7c99368640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c94145e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7c9001c940 tx=0x7f7c9001bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.199+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900c0070 con 0x7f7c940c4240 2024-04-21T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.199+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900b1790 con 0x7f7c940c4240 2024-04-21T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.199+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b5040 con 0x7f7c940c4240 2024-04-21T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.199+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c94148740 con 0x7f7c940c4240 2024-04-21T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.199+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9414aa40 con 0x7f7c940c4240 2024-04-21T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.199+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9404f510 con 0x7f7c940c4240 2024-04-21T22:52:44.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.503+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 3) ==== 87283+0+0 (secure 0 0 0) 0x7f7c900b1b60 con 0x7f7c940c4240 2024-04-21T22:52:44.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.503+0000 7f7c8a7fc640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7c78067760 0x7f7c78069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:44.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.503+0000 7f7c99b69640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7c78067760 0x7f7c78069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:44.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.507+0000 7f7c99b69640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7c78067760 0x7f7c78069c20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c84006aa0 tx=0x7f7c84006a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:44.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.523+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7c900f20c0 con 0x7f7c940c4240 2024-04-21T22:52:44.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.523+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f7c900c9080 con 0x7f7c940c4240 2024-04-21T22:52:44.661 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-21T22:52:44.659+0000 7f407ff7b7c0 -1 Falling back to public interface 2024-04-21T22:52:44.666 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-21T22:52:44.664+0000 7fcecc49f7c0 -1 Falling back to public interface 2024-04-21T22:52:44.666 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-21T22:52:44.664+0000 7f6a1ce477c0 -1 Falling back to public interface 2024-04-21T22:52:44.681 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-21T22:52:44.680+0000 7fd17e0747c0 -1 Falling back to public interface 2024-04-21T22:52:44.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.687+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c940c9110 con 0x7f7c940c4240 2024-04-21T22:52:44.696 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-21T22:52:44.695+0000 7f95b31967c0 -1 Falling back to public interface 2024-04-21T22:52:44.705 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-21T22:52:44.703+0000 7f74a017e7c0 -1 Falling back to public interface 2024-04-21T22:52:44.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.723+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f7c900efaa0 con 0x7f7c940c4240 2024-04-21T22:52:44.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.807+0000 7f7c8a7fc640 1 -- 172.21.15.110:0/3641560400 <== mon.2 v2:172.21.15.154:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7c90018870 con 0x7f7c940c4240 2024-04-21T22:52:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:52:44.811 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":10,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:52:43.609435+0000","last_up_change":"0.000000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:52:44.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7c78067760 msgr2=0x7f7c78069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:44.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7c78067760 0x7f7c78069c20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c84006aa0 tx=0x7f7c84006a30 comp rx=0 tx=0).stop 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 msgr2=0x7f7c94145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c94145e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7c9001c940 tx=0x7f7c9001bab0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 shutdown_connections 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7c78067760 0x7f7c78069c20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c94154560 0x7f7c941e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c940c4240 0x7f7c94145e00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 --2- 172.21.15.110:0/3641560400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c9406c700 0x7f7c941e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 >> 172.21.15.110:0/3641560400 conn(0x7f7c94062670 msgr2=0x7f7c94150d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 shutdown_connections 2024-04-21T22:52:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:52:44.811+0000 7f7c9bdcd640 1 -- 172.21.15.110:0/3641560400 wait complete. 2024-04-21T22:52:44.835 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-21T22:52:44.836 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-21T22:52:44.874 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-21T22:52:44.872+0000 7f62b1f397c0 -1 Falling back to public interface 2024-04-21T22:52:44.925 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-21T22:52:44.923+0000 7f7bf424c7c0 -1 Falling back to public interface 2024-04-21T22:52:45.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:52:45.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:52:45.641 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-21T22:52:45.760 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 Processor -- start 2024-04-21T22:52:45.761 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 -- start start 2024-04-21T22:52:45.761 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8dec150a10 0x7f8dec0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:45.761 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:45.762 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8dec0c3700 0x7f8dec156770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:45.762 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8dec0c65d0 con 0x7f8dec150a10 2024-04-21T22:52:45.762 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8dec06c6a0 con 0x7f8dec0c3700 2024-04-21T22:52:45.762 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df22fd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec06c980 con 0x7f8dec06ef90 2024-04-21T22:52:45.762 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8debfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8dec150a10 0x7f8dec0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:45.763 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8debfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8dec150a10 0x7f8dec0c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52222/0 (socket says 172.21.15.110:52222) 2024-04-21T22:52:45.763 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8debfff640 1 -- 172.21.15.110:0/3475727657 learned_addr learned my addr 172.21.15.110:0/3475727657 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:52:45.763 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8deb7fe640 1 --2- 172.21.15.110:0/3475727657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:45.763 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.759+0000 7f8df089a640 1 --2- 172.21.15.110:0/3475727657 >> v2:172.21.15.154:3300/0 conn(0x7f8dec0c3700 0x7f8dec156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:45.765 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.763+0000 7f8debfff640 1 -- 172.21.15.110:0/3475727657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 msgr2=0x7f8dec0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:45.765 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.763+0000 7f8debfff640 1 --2- 172.21.15.110:0/3475727657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.765 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.763+0000 7f8debfff640 1 -- 172.21.15.110:0/3475727657 >> v2:172.21.15.154:3300/0 conn(0x7f8dec0c3700 msgr2=0x7f8dec156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:45.765 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.763+0000 7f8debfff640 1 --2- 172.21.15.110:0/3475727657 >> v2:172.21.15.154:3300/0 conn(0x7f8dec0c3700 0x7f8dec156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.765 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.763+0000 7f8debfff640 1 -- 172.21.15.110:0/3475727657 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec06ddd0 con 0x7f8dec150a10 2024-04-21T22:52:45.769 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.767+0000 7f8debfff640 1 --2- 172.21.15.110:0/3475727657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec0c5100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0c5d20 tx=0x7f8ddc0200e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c58d292a56f7cd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:45.776 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8deaffd640 1 -- 172.21.15.110:0/3475727657 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0b6070 con 0x7f8dec150a10 2024-04-21T22:52:45.776 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8deaffd640 1 -- 172.21.15.110:0/3475727657 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ddc0b1440 con 0x7f8dec150a10 2024-04-21T22:52:45.776 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8deaffd640 1 -- 172.21.15.110:0/3475727657 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc00b040 con 0x7f8dec150a10 2024-04-21T22:52:45.777 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- 172.21.15.110:0/3475727657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 msgr2=0x7f8dec0c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:45.777 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 --2- 172.21.15.110:0/3475727657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec0c5100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0c5d20 tx=0x7f8ddc0200e0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.777 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- 172.21.15.110:0/3475727657 shutdown_connections 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 --2- 172.21.15.110:0/3475727657 >> v2:172.21.15.154:3300/0 conn(0x7f8dec0c3700 0x7f8dec156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 --2- 172.21.15.110:0/3475727657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 --2- 172.21.15.110:0/3475727657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec0c5100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- 172.21.15.110:0/3475727657 >> 172.21.15.110:0/3475727657 conn(0x7f8dec0cc200 msgr2=0x7f8dec0cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- 172.21.15.110:0/3475727657 shutdown_connections 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- 172.21.15.110:0/3475727657 wait complete. 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 Processor -- start 2024-04-21T22:52:45.778 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- start start 2024-04-21T22:52:45.780 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:45.780 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dec0c3700 0x7f8dec14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:45.780 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec1f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:45.780 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec06e670 con 0x7f8dec150a10 2024-04-21T22:52:45.780 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec06e390 con 0x7f8dec0c3700 2024-04-21T22:52:45.780 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.775+0000 7f8df22fd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec150df0 con 0x7f8dec06ef90 2024-04-21T22:52:45.780 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.779+0000 7f8df089a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec1f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:45.781 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.779+0000 7f8df089a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec1f0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52236/0 (socket says 172.21.15.110:52236) 2024-04-21T22:52:45.781 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.779+0000 7f8df089a640 1 -- 172.21.15.110:0/182171816 learned_addr learned my addr 172.21.15.110:0/182171816 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:52:45.781 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.779+0000 7f8deb7fe640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dec0c3700 0x7f8dec14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:45.781 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.779+0000 7f8debfff640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:45.784 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.783+0000 7f8df089a640 1 -- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 msgr2=0x7f8dec146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:45.784 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.783+0000 7f8df089a640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.784 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.783+0000 7f8df089a640 1 -- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dec0c3700 msgr2=0x7f8dec14f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:45.784 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.783+0000 7f8df089a640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dec0c3700 0x7f8dec14f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:45.784 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.783+0000 7f8df089a640 1 -- 172.21.15.110:0/182171816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec144ed0 con 0x7f8dec150a10 2024-04-21T22:52:45.786 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.783+0000 7f8df089a640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec1f0650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007e60 tx=0x7f8de400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:45.790 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.787+0000 7f8de8ff9640 1 -- 172.21.15.110:0/182171816 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de4014420 con 0x7f8dec150a10 2024-04-21T22:52:45.790 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.787+0000 7f8de8ff9640 1 -- 172.21.15.110:0/182171816 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de4019070 con 0x7f8dec150a10 2024-04-21T22:52:45.790 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.787+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec146c90 con 0x7f8dec150a10 2024-04-21T22:52:45.791 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.787+0000 7f8de8ff9640 1 -- 172.21.15.110:0/182171816 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de4014820 con 0x7f8dec150a10 2024-04-21T22:52:45.791 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.787+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec145450 con 0x7f8dec150a10 2024-04-21T22:52:45.791 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.787+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec0689e0 con 0x7f8dec150a10 2024-04-21T22:52:45.810 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.807+0000 7f8de8ff9640 1 -- 172.21.15.110:0/182171816 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f8de40149c0 con 0x7f8dec150a10 2024-04-21T22:52:45.810 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.807+0000 7f8de8ff9640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8dd80678b0 0x7f8dd8069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:45.810 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.807+0000 7f8debfff640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8dd80678b0 0x7f8dd8069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:45.811 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.807+0000 7f8debfff640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8dd80678b0 0x7f8dd8069d70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0b3000 tx=0x7f8ddc00c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:45.812 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:45.811+0000 7f8de8ff9640 1 -- 172.21.15.110:0/182171816 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8de40563a0 con 0x7f8dec150a10 2024-04-21T22:52:46.103 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.099+0000 7f8de8ff9640 1 -- 172.21.15.110:0/182171816 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f8de4057e10 con 0x7f8dec150a10 2024-04-21T22:52:46.273 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.271+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dec0c58f0 con 0x7f8dec150a10 2024-04-21T22:52:46.321 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8de8ff9640 1 -- 172.21.15.110:0/182171816 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8de4057710 con 0x7f8dec150a10 2024-04-21T22:52:46.321 INFO:teuthology.misc.health.smithi110.stdout: 2024-04-21T22:52:46.321 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":10,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:52:43.609435+0000","last_up_change":"0.000000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:52:46.323 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8dd80678b0 msgr2=0x7f8dd8069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:46.323 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8dd80678b0 0x7f8dd8069d70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0b3000 tx=0x7f8ddc00c040 comp rx=0 tx=0).stop 2024-04-21T22:52:46.323 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 msgr2=0x7f8dec1f0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:46.323 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec1f0650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007e60 tx=0x7f8de400e4b0 comp rx=0 tx=0).stop 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 shutdown_connections 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8dd80678b0 0x7f8dd8069d70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dec150a10 0x7f8dec1f0650 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dec0c3700 0x7f8dec14f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 --2- 172.21.15.110:0/182171816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8dec06ef90 0x7f8dec146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 >> 172.21.15.110:0/182171816 conn(0x7f8dec0cc200 msgr2=0x7f8dec0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 shutdown_connections 2024-04-21T22:52:46.324 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:46.319+0000 7f8df22fd640 1 -- 172.21.15.110:0/182171816 wait complete. 2024-04-21T22:52:46.339 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-21T22:52:48.425 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-21T22:52:48.424+0000 7f6a1ce477c0 -1 osd.5 0 log_to_monitors true 2024-04-21T22:52:48.534 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-21T22:52:48.531+0000 7f95b31967c0 -1 osd.1 0 log_to_monitors true 2024-04-21T22:52:48.538 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-21T22:52:48.536+0000 7fd17e0747c0 -1 osd.7 0 log_to_monitors true 2024-04-21T22:52:48.540 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-21T22:52:48.539+0000 7f407ff7b7c0 -1 osd.2 0 log_to_monitors true 2024-04-21T22:52:48.551 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-21T22:52:48.548+0000 7fcecc49f7c0 -1 osd.6 0 log_to_monitors true 2024-04-21T22:52:48.629 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-21T22:52:48.628+0000 7f62b1f397c0 -1 osd.4 0 log_to_monitors true 2024-04-21T22:52:48.638 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-21T22:52:48.635+0000 7f74a017e7c0 -1 osd.3 0 log_to_monitors true 2024-04-21T22:52:48.758 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-21T22:52:48.755+0000 7f7bf424c7c0 -1 osd.0 0 log_to_monitors true 2024-04-21T22:52:50.619 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-21T22:52:50.616+0000 7fd17a01d640 -1 osd.7 0 waiting for initial osdmap 2024-04-21T22:52:50.733 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-21T22:52:50.732+0000 7fd171e52640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:50.737 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-21T22:52:50.736+0000 7f6a18df0640 -1 osd.5 0 waiting for initial osdmap 2024-04-21T22:52:50.797 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-21T22:52:50.796+0000 7f6a10c25640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:52.331 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-21T22:52:52.328+0000 7fcec8c5a640 -1 osd.6 0 waiting for initial osdmap 2024-04-21T22:52:52.337 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-21T22:52:52.336+0000 7f62ae6f4640 -1 osd.4 0 waiting for initial osdmap 2024-04-21T22:52:52.364 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-21T22:52:52.364+0000 7fcec027d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:52.405 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-21T22:52:52.404+0000 7f62a5d17640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:52.488 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-21T22:52:52.483+0000 7f407c736640 -1 osd.2 0 waiting for initial osdmap 2024-04-21T22:52:52.584 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-21T22:52:52.583+0000 7f749c939640 -1 osd.3 0 waiting for initial osdmap 2024-04-21T22:52:52.632 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-21T22:52:52.631+0000 7f95af951640 -1 osd.1 0 waiting for initial osdmap 2024-04-21T22:52:52.652 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-21T22:52:52.651+0000 7f7493f5c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:52.668 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-21T22:52:52.667+0000 7f4073d59640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:52.672 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-21T22:52:52.671+0000 7f95a6f74640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:52.697 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-21T22:52:52.695+0000 7f7bf01f5640 -1 osd.0 0 waiting for initial osdmap 2024-04-21T22:52:52.745 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-21T22:52:52.743+0000 7f7be802a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:52:53.145 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-21T22:52:53.276 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.271+0000 7f23e8739640 1 Processor -- start 2024-04-21T22:52:53.276 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e8739640 1 -- start start 2024-04-21T22:52:53.276 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e8739640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e01525a0 0x7f23e00b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:53.277 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e8739640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23e00c3a60 0x7f23e00c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:53.277 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e8739640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e00c8780 con 0x7f23e00c94f0 2024-04-21T22:52:53.277 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e8739640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f23e0152980 con 0x7f23e00c3a60 2024-04-21T22:52:53.277 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e8739640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f23e00c35d0 con 0x7f23e01525a0 2024-04-21T22:52:53.278 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e64d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e01525a0 0x7f23e00b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:53.278 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e5cd4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23e00c94f0 0x7f23e00cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:48624/0 (socket says 172.21.15.110:48624) 2024-04-21T22:52:53.279 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e5cd4640 1 -- 172.21.15.110:0/2453265513 learned_addr learned my addr 172.21.15.110:0/2453265513 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:52:53.279 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.275+0000 7f23e6cd6640 1 --2- 172.21.15.110:0/2453265513 >> v2:172.21.15.154:3300/0 conn(0x7f23e00c3a60 0x7f23e00c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:53.284 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.283+0000 7f23e64d5640 1 -- 172.21.15.110:0/2453265513 >> v2:172.21.15.154:3300/0 conn(0x7f23e00c3a60 msgr2=0x7f23e00c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:52:53.284 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.283+0000 7f23e64d5640 1 --2- 172.21.15.110:0/2453265513 >> v2:172.21.15.154:3300/0 conn(0x7f23e00c3a60 0x7f23e00c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:53.284 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.283+0000 7f23e64d5640 1 -- 172.21.15.110:0/2453265513 >> v1:172.21.15.154:6789/0 conn(0x7f23e00c94f0 legacy=0x7f23e00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:53.284 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.283+0000 7f23e64d5640 1 -- 172.21.15.110:0/2453265513 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e00c4400 con 0x7f23e01525a0 2024-04-21T22:52:53.289 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.287+0000 7f23e64d5640 1 --2- 172.21.15.110:0/2453265513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e01525a0 0x7f23e00b3860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23d00097c0 tx=0x7f23d001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de94d08bfdbf6145 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:53.295 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.295+0000 7f23e54d3640 1 -- 172.21.15.110:0/2453265513 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d00b5070 con 0x7f23e01525a0 2024-04-21T22:52:53.301 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e54d3640 1 -- 172.21.15.110:0/2453265513 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d00a8990 con 0x7f23e01525a0 2024-04-21T22:52:53.301 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e54d3640 1 -- 172.21.15.110:0/2453265513 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d00a8d60 con 0x7f23e01525a0 2024-04-21T22:52:53.302 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 -- 172.21.15.110:0/2453265513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e01525a0 msgr2=0x7f23e00b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:53.302 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 --2- 172.21.15.110:0/2453265513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e01525a0 0x7f23e00b3860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23d00097c0 tx=0x7f23d001ec90 comp rx=0 tx=0).stop 2024-04-21T22:52:53.302 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 -- 172.21.15.110:0/2453265513 shutdown_connections 2024-04-21T22:52:53.303 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 --2- 172.21.15.110:0/2453265513 >> v2:172.21.15.154:3300/0 conn(0x7f23e00c3a60 0x7f23e00c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:53.303 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 --2- 172.21.15.110:0/2453265513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e01525a0 0x7f23e00b3860 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:53.303 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 -- 172.21.15.110:0/2453265513 >> 172.21.15.110:0/2453265513 conn(0x7f23e006fb50 msgr2=0x7f23e0066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:53.303 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 -- 172.21.15.110:0/2453265513 shutdown_connections 2024-04-21T22:52:53.303 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 -- 172.21.15.110:0/2453265513 wait complete. 2024-04-21T22:52:53.303 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.299+0000 7f23e8739640 1 Processor -- start 2024-04-21T22:52:53.303 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e8739640 1 -- start start 2024-04-21T22:52:53.305 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e8739640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e00c3a60 0x7f23e014b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:53.305 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e8739640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23e00c94f0 0x7f23e006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:53.305 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e8739640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e01525a0 0x7f23e014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:53.305 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e8739640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00c8d00 con 0x7f23e00c94f0 2024-04-21T22:52:53.305 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e8739640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00c8a20 con 0x7f23e01525a0 2024-04-21T22:52:53.305 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e8739640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f23e01590a0 con 0x7f23e00c3a60 2024-04-21T22:52:53.305 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.303+0000 7f23e5cd4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23e00c94f0 0x7f23e006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:53.307 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.307+0000 7f23e5cd4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23e00c94f0 0x7f23e006cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33858/0 (socket says 172.21.15.110:33858) 2024-04-21T22:52:53.307 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.307+0000 7f23e5cd4640 1 -- 172.21.15.110:0/99318206 learned_addr learned my addr 172.21.15.110:0/99318206 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:52:53.313 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.311+0000 7f23e64d5640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e00c3a60 0x7f23e014b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:53.316 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.315+0000 7f23e6cd6640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e01525a0 0x7f23e014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:53.318 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.315+0000 7f23e5cd4640 1 -- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e00c3a60 msgr2=0x7f23e014b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:53.318 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.315+0000 7f23e5cd4640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e00c3a60 0x7f23e014b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:53.318 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.315+0000 7f23e5cd4640 1 -- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e01525a0 msgr2=0x7f23e014d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:53.318 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.315+0000 7f23e5cd4640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e01525a0 0x7f23e014d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:53.318 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.315+0000 7f23e5cd4640 1 -- 172.21.15.110:0/99318206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e00c4d50 con 0x7f23e00c94f0 2024-04-21T22:52:53.320 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.319+0000 7f23e5cd4640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23e00c94f0 0x7f23e006cf10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c450 tx=0x7f23dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:53.455 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.451+0000 7f23d6ffd640 1 -- 172.21.15.110:0/99318206 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc017070 con 0x7f23e00c94f0 2024-04-21T22:52:53.455 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.451+0000 7f23d6ffd640 1 -- 172.21.15.110:0/99318206 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc005cf0 con 0x7f23e00c94f0 2024-04-21T22:52:53.455 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.451+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01f0db0 con 0x7f23e00c94f0 2024-04-21T22:52:53.455 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.451+0000 7f23d6ffd640 1 -- 172.21.15.110:0/99318206 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc007290 con 0x7f23e00c94f0 2024-04-21T22:52:53.455 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.451+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e006c710 con 0x7f23e00c94f0 2024-04-21T22:52:53.456 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.455+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e00689e0 con 0x7f23e00c94f0 2024-04-21T22:52:53.798 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.795+0000 7f23d6ffd640 1 -- 172.21.15.110:0/99318206 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f23dc01a070 con 0x7f23e00c94f0 2024-04-21T22:52:53.799 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.795+0000 7f23d6ffd640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f23c4067880 0x7f23c4069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:52:53.800 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.799+0000 7f23e64d5640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f23c4067880 0x7f23c4069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:52:53.800 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.799+0000 7f23e64d5640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f23c4067880 0x7f23c4069d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f23d00b2000 tx=0x7f23d00aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:52:53.844 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.843+0000 7f23d6ffd640 1 -- 172.21.15.110:0/99318206 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7f23dc0538b0 con 0x7f23e00c94f0 2024-04-21T22:52:53.844 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:53.843+0000 7f23d6ffd640 1 -- 172.21.15.110:0/99318206 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f23dc021020 con 0x7f23e00c94f0 2024-04-21T22:52:54.020 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.019+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23e0067c70 con 0x7f23e00c94f0 2024-04-21T22:52:54.058 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.055+0000 7f23d6ffd640 1 -- 172.21.15.110:0/99318206 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8041 (secure 0 0 0) 0x7f23dc055f10 con 0x7f23e00c94f0 2024-04-21T22:52:54.058 INFO:teuthology.misc.health.smithi110.stdout: 2024-04-21T22:52:54.058 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":14,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:52:52.153749+0000","last_up_change":"2024-04-21T22:52:52.153749+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:52:54.061 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f23c4067880 msgr2=0x7f23c4069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:54.061 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f23c4067880 0x7f23c4069d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f23d00b2000 tx=0x7f23d00aa070 comp rx=0 tx=0).stop 2024-04-21T22:52:54.061 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23e00c94f0 msgr2=0x7f23e006cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:52:54.061 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23e00c94f0 0x7f23e006cf10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c450 tx=0x7f23dc00c910 comp rx=0 tx=0).stop 2024-04-21T22:52:54.061 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 shutdown_connections 2024-04-21T22:52:54.061 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f23c4067880 0x7f23c4069d40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:54.062 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e01525a0 0x7f23e014d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:54.062 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23e00c94f0 0x7f23e006cf10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:54.062 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 --2- 172.21.15.110:0/99318206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23e00c3a60 0x7f23e014b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:52:54.062 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 >> 172.21.15.110:0/99318206 conn(0x7f23e006fb50 msgr2=0x7f23e00ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:52:54.062 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 shutdown_connections 2024-04-21T22:52:54.062 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:52:54.059+0000 7f23e8739640 1 -- 172.21.15.110:0/99318206 wait complete. 2024-04-21T22:52:54.078 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-04-21T22:53:00.885 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:01.000 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac8455640 1 Processor -- start 2024-04-21T22:53:01.000 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac8455640 1 -- start start 2024-04-21T22:53:01.000 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac8455640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac006b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:01.001 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac8455640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac015adc0 con 0x7f4ac006b450 2024-04-21T22:53:01.001 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac8455640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac0070090 con 0x7f4ac0072600 2024-04-21T22:53:01.001 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac8455640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00709c0 con 0x7f4ac0070e50 2024-04-21T22:53:01.001 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac61f1640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4ac006b450 0x7f4ac00c7240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:52042/0 (socket says 172.21.15.110:52042) 2024-04-21T22:53:01.001 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac61f1640 1 -- 172.21.15.110:0/3178636175 learned_addr learned my addr 172.21.15.110:0/3178636175 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:01.002 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:00.999+0000 7f4ac59f0640 1 --2- 172.21.15.110:0/3178636175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:01.007 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.003+0000 7f4ac59f0640 1 -- 172.21.15.110:0/3178636175 >> v1:172.21.15.154:6789/0 conn(0x7f4ac0072600 legacy=0x7f4ac0154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:01.007 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.003+0000 7f4ac59f0640 1 -- 172.21.15.110:0/3178636175 >> v1:172.21.15.110:6789/0 conn(0x7f4ac006b450 legacy=0x7f4ac00c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:01.007 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.003+0000 7f4ac59f0640 1 -- 172.21.15.110:0/3178636175 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac0070370 con 0x7f4ac0070e50 2024-04-21T22:53:01.011 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.007+0000 7f4ac59f0640 1 --2- 172.21.15.110:0/3178636175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac006b830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0097f0 tx=0x7f4abc01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52a1945891d3952 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:01.022 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac51ef640 1 -- 172.21.15.110:0/3178636175 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0b5070 con 0x7f4ac0070e50 2024-04-21T22:53:01.022 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac51ef640 1 -- 172.21.15.110:0/3178636175 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc0a89d0 con 0x7f4ac0070e50 2024-04-21T22:53:01.022 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac51ef640 1 -- 172.21.15.110:0/3178636175 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0a8da0 con 0x7f4ac0070e50 2024-04-21T22:53:01.023 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac8455640 1 -- 172.21.15.110:0/3178636175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 msgr2=0x7f4ac006b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:01.023 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac8455640 1 --2- 172.21.15.110:0/3178636175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac006b830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0097f0 tx=0x7f4abc01ecd0 comp rx=0 tx=0).stop 2024-04-21T22:53:01.023 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac8455640 1 -- 172.21.15.110:0/3178636175 shutdown_connections 2024-04-21T22:53:01.023 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac8455640 1 --2- 172.21.15.110:0/3178636175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac006b830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:01.023 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac8455640 1 -- 172.21.15.110:0/3178636175 >> 172.21.15.110:0/3178636175 conn(0x7f4ac00cc840 msgr2=0x7f4ac00ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:01.023 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac8455640 1 -- 172.21.15.110:0/3178636175 shutdown_connections 2024-04-21T22:53:01.023 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.019+0000 7f4ac8455640 1 -- 172.21.15.110:0/3178636175 wait complete. 2024-04-21T22:53:01.024 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 Processor -- start 2024-04-21T22:53:01.024 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 -- start start 2024-04-21T22:53:01.025 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac006b450 0x7f4ac0148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:01.025 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac0158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:01.025 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac0072600 0x7f4ac0147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:01.025 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac0154770 con 0x7f4ac0072600 2024-04-21T22:53:01.025 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac015b0a0 con 0x7f4ac006b450 2024-04-21T22:53:01.025 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac8455640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac01548f0 con 0x7f4ac0070e50 2024-04-21T22:53:01.026 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac69f2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac0072600 0x7f4ac0147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:01.026 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac61f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac006b450 0x7f4ac0148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:01.026 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac69f2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac0072600 0x7f4ac0147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47376/0 (socket says 172.21.15.110:47376) 2024-04-21T22:53:01.026 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.023+0000 7f4ac69f2640 1 -- 172.21.15.110:0/1852045236 learned_addr learned my addr 172.21.15.110:0/1852045236 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:01.028 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.027+0000 7f4ac59f0640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac0158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:01.031 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.027+0000 7f4ac69f2640 1 -- 172.21.15.110:0/1852045236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 msgr2=0x7f4ac0158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:01.031 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.027+0000 7f4ac69f2640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac0158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:01.031 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.027+0000 7f4ac69f2640 1 -- 172.21.15.110:0/1852045236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac006b450 msgr2=0x7f4ac0148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:01.031 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.027+0000 7f4ac69f2640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac006b450 0x7f4ac0148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:01.031 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.027+0000 7f4ac69f2640 1 -- 172.21.15.110:0/1852045236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac0159bd0 con 0x7f4ac0072600 2024-04-21T22:53:01.034 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:01.031+0000 7f4ac69f2640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac0072600 0x7f4ac0147830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c7a0 tx=0x7f4ab800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:05.793 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:05.791+0000 7f4ab2ffd640 1 -- 172.21.15.110:0/1852045236 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8003b80 con 0x7f4ac0072600 2024-04-21T22:53:05.794 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:05.791+0000 7f4ab2ffd640 1 -- 172.21.15.110:0/1852045236 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8003d60 con 0x7f4ac0072600 2024-04-21T22:53:05.794 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:05.791+0000 7f4ab2ffd640 1 -- 172.21.15.110:0/1852045236 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800aa90 con 0x7f4ac0072600 2024-04-21T22:53:05.794 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:05.791+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac0159eb0 con 0x7f4ac0072600 2024-04-21T22:53:05.794 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:05.791+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac01580b0 con 0x7f4ac0072600 2024-04-21T22:53:05.794 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:05.791+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac00689e0 con 0x7f4ac0072600 2024-04-21T22:53:06.278 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:06.275+0000 7f4ab2ffd640 1 -- 172.21.15.110:0/1852045236 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ab800ac30 con 0x7f4ac0072600 2024-04-21T22:53:06.279 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:06.275+0000 7f4ab2ffd640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4aa4067940 0x7f4aa4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:06.279 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:06.279+0000 7f4ac61f1640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4aa4067940 0x7f4aa4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:06.280 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:06.279+0000 7f4ac61f1640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4aa4067940 0x7f4aa4069e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4005890 tx=0x7f4ab4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:06.320 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:06.319+0000 7f4ab2ffd640 1 -- 172.21.15.110:0/1852045236 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f4ab8054a90 con 0x7f4ac0072600 2024-04-21T22:53:06.325 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:06.323+0000 7f4ab2ffd640 1 -- 172.21.15.110:0/1852045236 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f4ab8020070 con 0x7f4ac0072600 2024-04-21T22:53:06.498 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:06.495+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ac0072fb0 con 0x7f4ac0072600 2024-04-21T22:53:11.933 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ab2ffd640 1 -- 172.21.15.110:0/1852045236 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7f4ab80569f0 con 0x7f4ac0072600 2024-04-21T22:53:11.933 INFO:teuthology.misc.health.smithi110.stdout: 2024-04-21T22:53:11.933 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":19,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:52:59.102208+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:11.935 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4aa4067940 msgr2=0x7f4aa4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:11.935 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4aa4067940 0x7f4aa4069e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4005890 tx=0x7f4ab4009040 comp rx=0 tx=0).stop 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac0072600 msgr2=0x7f4ac0147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac0072600 0x7f4ac0147830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c7a0 tx=0x7f4ab800cc60 comp rx=0 tx=0).stop 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 shutdown_connections 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4aa4067940 0x7f4aa4069e00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac0072600 0x7f4ac0147830 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac0070e50 0x7f4ac0158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 --2- 172.21.15.110:0/1852045236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac006b450 0x7f4ac0148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 >> 172.21.15.110:0/1852045236 conn(0x7f4ac00cc840 msgr2=0x7f4ac00c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 shutdown_connections 2024-04-21T22:53:11.936 INFO:teuthology.misc.health.smithi110.stderr:2024-04-21T22:53:11.931+0000 7f4ac8455640 1 -- 172.21.15.110:0/1852045236 wait complete. 2024-04-21T22:53:11.956 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-21T22:53:11.956 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-21T22:53:11.956 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-21T22:53:11.956 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-21T22:53:11.956 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-04-21T22:53:11.958 INFO:tasks.ceph.mds.a:Started 2024-04-21T22:53:11.959 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-21T22:53:11.959 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-21T22:53:11.959 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-04-21T22:53:11.961 INFO:tasks.ceph.mds.c:Started 2024-04-21T22:53:11.961 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-21T22:53:11.961 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-21T22:53:11.961 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-04-21T22:53:11.963 INFO:tasks.ceph.mds.e:Started 2024-04-21T22:53:11.963 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-21T22:53:11.963 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-21T22:53:11.963 DEBUG:teuthology.orchestra.run.smithi154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-04-21T22:53:11.966 INFO:tasks.ceph.mds.b:Started 2024-04-21T22:53:11.966 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-21T22:53:11.966 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-21T22:53:11.967 DEBUG:teuthology.orchestra.run.smithi154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-04-21T22:53:11.969 INFO:tasks.ceph.mds.d:Started 2024-04-21T22:53:11.969 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-21T22:53:11.969 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-21T22:53:11.969 DEBUG:teuthology.orchestra.run.smithi154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-04-21T22:53:11.971 INFO:tasks.ceph.mds.f:Started 2024-04-21T22:53:11.972 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-21T22:53:11.972 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:12.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.107+0000 7f2dd4b0f640 1 Processor -- start 2024-04-21T22:53:12.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.107+0000 7f2dd4b0f640 1 -- start start 2024-04-21T22:53:12.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.111+0000 7f2dd4b0f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2dd00c75f0 0x7f2dd00c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:12.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.111+0000 7f2dd4b0f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd00c7a30 con 0x7f2dd00c58f0 2024-04-21T22:53:12.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.111+0000 7f2dd4b0f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd00c9820 con 0x7f2dd013dfe0 2024-04-21T22:53:12.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.111+0000 7f2dd4b0f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd01590e0 con 0x7f2dd00c75f0 2024-04-21T22:53:12.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.115+0000 7f2dce59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2dd013dfe0 0x7f2dd015b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:34312/0 (socket says 172.21.15.110:34312) 2024-04-21T22:53:12.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.115+0000 7f2dce59c640 1 -- 172.21.15.110:0/797223909 learned_addr learned my addr 172.21.15.110:0/797223909 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:12.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.115+0000 7f2dc7fff640 1 --2- 172.21.15.110:0/797223909 >> v2:172.21.15.154:3300/0 conn(0x7f2dd00c75f0 0x7f2dd00c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:12.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.123+0000 7f2dc7fff640 1 -- 172.21.15.110:0/797223909 >> v1:172.21.15.154:6789/0 conn(0x7f2dd013dfe0 legacy=0x7f2dd015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:12.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.123+0000 7f2dc7fff640 1 -- 172.21.15.110:0/797223909 >> v1:172.21.15.110:6789/0 conn(0x7f2dd00c58f0 legacy=0x7f2dd0162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:12.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.123+0000 7f2dc7fff640 1 -- 172.21.15.110:0/797223909 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd0158320 con 0x7f2dd00c75f0 2024-04-21T22:53:12.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:12.131+0000 7f2dc7fff640 1 --2- 172.21.15.110:0/797223909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 0x7f2dd00c90e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2db80097c0 tx=0x7f2db801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e655e344883d229 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:15.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:53:15.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:53:16.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dcdd9b640 1 -- 172.21.15.110:0/797223909 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80b5070 con 0x7f2dd00c75f0 2024-04-21T22:53:16.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dcdd9b640 1 -- 172.21.15.110:0/797223909 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db80a8970 con 0x7f2dd00c75f0 2024-04-21T22:53:16.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dcdd9b640 1 -- 172.21.15.110:0/797223909 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80a8da0 con 0x7f2dd00c75f0 2024-04-21T22:53:16.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/797223909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 msgr2=0x7f2dd00c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:16.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/797223909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 0x7f2dd00c90e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2db80097c0 tx=0x7f2db801ec50 comp rx=0 tx=0).stop 2024-04-21T22:53:16.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/797223909 shutdown_connections 2024-04-21T22:53:16.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/797223909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 0x7f2dd00c90e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:16.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/797223909 >> 172.21.15.110:0/797223909 conn(0x7f2dd006fe70 msgr2=0x7f2dd0070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:16.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/797223909 shutdown_connections 2024-04-21T22:53:16.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/797223909 wait complete. 2024-04-21T22:53:16.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 Processor -- start 2024-04-21T22:53:16.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.551+0000 7f2dd4b0f640 1 -- start start 2024-04-21T22:53:16.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dd4b0f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd00c58f0 0x7f2dd01542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:16.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dd4b0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 0x7f2dd0157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:16.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dd4b0f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dd013dfe0 0x7f2dd00c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:16.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dd4b0f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd01588e0 con 0x7f2dd00c58f0 2024-04-21T22:53:16.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dd4b0f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd0158c50 con 0x7f2dd00c75f0 2024-04-21T22:53:16.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dd4b0f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd006b2c0 con 0x7f2dd013dfe0 2024-04-21T22:53:16.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dced9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dd013dfe0 0x7f2dd00c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:16.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dced9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dd013dfe0 0x7f2dd00c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:37774/0 (socket says 172.21.15.110:37774) 2024-04-21T22:53:16.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.555+0000 7f2dced9d640 1 -- 172.21.15.110:0/2288091497 learned_addr learned my addr 172.21.15.110:0/2288091497 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:16.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.559+0000 7f2dced9d640 1 -- 172.21.15.110:0/2288091497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 msgr2=0x7f2dd0157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:16.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.559+0000 7f2dced9d640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 0x7f2dd0157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:16.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.559+0000 7f2dced9d640 1 -- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd00c58f0 msgr2=0x7f2dd01542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:16.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.559+0000 7f2dced9d640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd00c58f0 0x7f2dd01542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:16.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.559+0000 7f2dced9d640 1 -- 172.21.15.110:0/2288091497 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd01e17b0 con 0x7f2dd013dfe0 2024-04-21T22:53:16.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.563+0000 7f2dced9d640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dd013dfe0 0x7f2dd00c36e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b9c0 tx=0x7f2dc800be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:16.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.571+0000 7f2dc6ffd640 1 -- 172.21.15.110:0/2288091497 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8019070 con 0x7f2dd013dfe0 2024-04-21T22:53:16.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.571+0000 7f2dc6ffd640 1 -- 172.21.15.110:0/2288091497 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc800cba0 con 0x7f2dd013dfe0 2024-04-21T22:53:16.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.571+0000 7f2dc6ffd640 1 -- 172.21.15.110:0/2288091497 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8014440 con 0x7f2dd013dfe0 2024-04-21T22:53:16.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.571+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd01e1a90 con 0x7f2dd013dfe0 2024-04-21T22:53:16.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.571+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd0154830 con 0x7f2dd013dfe0 2024-04-21T22:53:16.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.571+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd004f510 con 0x7f2dd013dfe0 2024-04-21T22:53:16.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.603+0000 7f2dc6ffd640 1 -- 172.21.15.110:0/2288091497 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2dc8007370 con 0x7f2dd013dfe0 2024-04-21T22:53:16.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.603+0000 7f2dc6ffd640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2db0067940 0x7f2db0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:16.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.603+0000 7f2dce59c640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2db0067940 0x7f2db0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:16.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.603+0000 7f2dce59c640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2db0067940 0x7f2db0069e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001600 tx=0x7f2dc0007a50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:16.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:16.607+0000 7f2dc6ffd640 1 -- 172.21.15.110:0/2288091497 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f2dc805c930 con 0x7f2dd013dfe0 2024-04-21T22:53:17.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:17.015+0000 7f2dc6ffd640 1 -- 172.21.15.110:0/2288091497 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2dc8056790 con 0x7f2dd013dfe0 2024-04-21T22:53:17.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:17.219+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dd013b760 con 0x7f2dd013dfe0 2024-04-21T22:53:19.742 INFO:tasks.ceph.mds.f.smithi154.stdout:starting mds.f at 2024-04-21T22:53:19.800 INFO:tasks.ceph.mds.e.smithi110.stdout:starting mds.e at 2024-04-21T22:53:23.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dc6ffd640 1 -- 172.21.15.110:0/2288091497 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7f2dc8056090 con 0x7f2dd013dfe0 2024-04-21T22:53:23.520 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:23.520 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":19,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:52:59.102208+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:23.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2db0067940 msgr2=0x7f2db0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:23.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2db0067940 0x7f2db0069e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001600 tx=0x7f2dc0007a50 comp rx=0 tx=0).stop 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dd013dfe0 msgr2=0x7f2dd00c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dd013dfe0 0x7f2dd00c36e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b9c0 tx=0x7f2dc800be80 comp rx=0 tx=0).stop 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 shutdown_connections 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2db0067940 0x7f2db0069e00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dd013dfe0 0x7f2dd00c36e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00c75f0 0x7f2dd0157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 --2- 172.21.15.110:0/2288091497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd00c58f0 0x7f2dd01542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.519+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 >> 172.21.15.110:0/2288091497 conn(0x7f2dd006fe70 msgr2=0x7f2dd006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.523+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 shutdown_connections 2024-04-21T22:53:23.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.523+0000 7f2dd4b0f640 1 -- 172.21.15.110:0/2288091497 wait complete. 2024-04-21T22:53:23.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:52:54.296733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:53:23.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:53:23.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.687+0000 7f61ee32e640 1 Processor -- start 2024-04-21T22:53:23.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.687+0000 7f61ee32e640 1 -- start start 2024-04-21T22:53:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61ee32e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61e8154560 0x7f61e80c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61ee32e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61e80c4240 0x7f61e80c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61ee32e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e80ca0c0 con 0x7f61e806c700 2024-04-21T22:53:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61ee32e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f61e80c9e70 con 0x7f61e80c4240 2024-04-21T22:53:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61ee32e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f61e80cacd0 con 0x7f61e8154560 2024-04-21T22:53:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61e7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61e8154560 0x7f61e80c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61e7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61e8154560 0x7f61e80c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:39774/0 (socket says 172.21.15.110:39774) 2024-04-21T22:53:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.691+0000 7f61e7fff640 1 -- 172.21.15.110:0/2153457580 learned_addr learned my addr 172.21.15.110:0/2153457580 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:23.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.695+0000 7f61e7fff640 1 -- 172.21.15.110:0/2153457580 >> v2:172.21.15.110:3300/0 conn(0x7f61e80c4240 msgr2=0x7f61e80c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:23.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.695+0000 7f61e7fff640 1 --2- 172.21.15.110:0/2153457580 >> v2:172.21.15.110:3300/0 conn(0x7f61e80c4240 0x7f61e80c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.695+0000 7f61e7fff640 1 -- 172.21.15.110:0/2153457580 >> v1:172.21.15.154:6789/0 conn(0x7f61e806c700 legacy=0x7f61e815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:23.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.695+0000 7f61e7fff640 1 -- 172.21.15.110:0/2153457580 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e80ca3a0 con 0x7f61e8154560 2024-04-21T22:53:23.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.703+0000 7f61e7fff640 1 --2- 172.21.15.110:0/2153457580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e8154560 0x7f61e80c85b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61e8072340 tx=0x7f61d801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b62dbbe1105f3a19 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61e6ffd640 1 -- 172.21.15.110:0/2153457580 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d80b5070 con 0x7f61e8154560 2024-04-21T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61e6ffd640 1 -- 172.21.15.110:0/2153457580 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d80a8a10 con 0x7f61e8154560 2024-04-21T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61e6ffd640 1 -- 172.21.15.110:0/2153457580 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d80a8de0 con 0x7f61e8154560 2024-04-21T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 -- 172.21.15.110:0/2153457580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e8154560 msgr2=0x7f61e80c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2153457580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e8154560 0x7f61e80c85b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61e8072340 tx=0x7f61d801ed10 comp rx=0 tx=0).stop 2024-04-21T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 -- 172.21.15.110:0/2153457580 shutdown_connections 2024-04-21T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2153457580 >> v2:172.21.15.110:3300/0 conn(0x7f61e80c4240 0x7f61e80c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2153457580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e8154560 0x7f61e80c85b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 -- 172.21.15.110:0/2153457580 >> 172.21.15.110:0/2153457580 conn(0x7f61e8062670 msgr2=0x7f61e8071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 -- 172.21.15.110:0/2153457580 shutdown_connections 2024-04-21T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.707+0000 7f61ee32e640 1 -- 172.21.15.110:0/2153457580 wait complete. 2024-04-21T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 Processor -- start 2024-04-21T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 -- start start 2024-04-21T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61e806c700 0x7f61e8155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e80c4240 0x7f61e8155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e8154560 0x7f61e8156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f61e80c9b80 con 0x7f61e8154560 2024-04-21T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61e80ca960 con 0x7f61e80c4240 2024-04-21T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61ee32e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f61e815e000 con 0x7f61e806c700 2024-04-21T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61e77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e80c4240 0x7f61e8155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.711+0000 7f61e7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61e806c700 0x7f61e8155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.715+0000 7f61e77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e80c4240 0x7f61e8155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:39784/0 (socket says 172.21.15.110:39784) 2024-04-21T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.715+0000 7f61e77fe640 1 -- 172.21.15.110:0/2272093327 learned_addr learned my addr 172.21.15.110:0/2272093327 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.719+0000 7f61e7fff640 1 -- 172.21.15.110:0/2272093327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e80c4240 msgr2=0x7f61e8155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.719+0000 7f61e7fff640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e80c4240 0x7f61e8155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.719+0000 7f61e7fff640 1 -- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e8154560 msgr2=0x7f61e8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.719+0000 7f61e7fff640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e8154560 0x7f61e8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.719+0000 7f61e7fff640 1 -- 172.21.15.110:0/2272093327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e8156a80 con 0x7f61e806c700 2024-04-21T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:23.723+0000 7f61e7fff640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61e806c700 0x7f61e8155390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61d80af000 tx=0x7f61d801bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:23.844 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2024-04-21T22:53:23.845 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2024-04-21T22:53:23.855 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2024-04-21T22:53:23.856 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2024-04-21T22:53:27.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:27.943+0000 7f61e4ff9640 1 -- 172.21.15.110:0/2272093327 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d80c0070 con 0x7f61e806c700 2024-04-21T22:53:27.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:27.943+0000 7f61e4ff9640 1 -- 172.21.15.110:0/2272093327 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d80b1850 con 0x7f61e806c700 2024-04-21T22:53:27.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:27.943+0000 7f61e4ff9640 1 -- 172.21.15.110:0/2272093327 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d80b5040 con 0x7f61e806c700 2024-04-21T22:53:27.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:27.943+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e8156d60 con 0x7f61e806c700 2024-04-21T22:53:27.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:27.943+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e80b0cb0 con 0x7f61e806c700 2024-04-21T22:53:27.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:27.943+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e804f510 con 0x7f61e806c700 2024-04-21T22:53:28.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.303+0000 7f61e4ff9640 1 -- 172.21.15.110:0/2272093327 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61d80b1c40 con 0x7f61e806c700 2024-04-21T22:53:28.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.303+0000 7f61e4ff9640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f61d4067940 0x7f61d4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:28.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.303+0000 7f61e77fe640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f61d4067940 0x7f61d4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:28.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.303+0000 7f61e77fe640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f61d4067940 0x7f61d4069e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61e81f4300 tx=0x7f61dc0091c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:28.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.311+0000 7f61e4ff9640 1 -- 172.21.15.110:0/2272093327 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f61d80facc0 con 0x7f61e806c700 2024-04-21T22:53:28.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.339+0000 7f61e4ff9640 1 -- 172.21.15.110:0/2272093327 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f61d8018870 con 0x7f61e806c700 2024-04-21T22:53:28.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.515+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f61e80c9110 con 0x7f61e806c700 2024-04-21T22:53:28.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61e4ff9640 1 -- 172.21.15.110:0/2272093327 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f61d80f44d0 con 0x7f61e806c700 2024-04-21T22:53:28.865 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-04-21T22:53:28.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f61d4067940 msgr2=0x7f61d4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f61d4067940 0x7f61d4069e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61e81f4300 tx=0x7f61dc0091c0 comp rx=0 tx=0).stop 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61e806c700 msgr2=0x7f61e8155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61e806c700 0x7f61e8155390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61d80af000 tx=0x7f61d801bab0 comp rx=0 tx=0).stop 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 shutdown_connections 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f61d4067940 0x7f61d4069e00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e8154560 0x7f61e8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61e80c4240 0x7f61e8155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 --2- 172.21.15.110:0/2272093327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61e806c700 0x7f61e8155390 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 >> 172.21.15.110:0/2272093327 conn(0x7f61e8062670 msgr2=0x7f61e8151310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 shutdown_connections 2024-04-21T22:53:28.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:28.863+0000 7f61ee32e640 1 -- 172.21.15.110:0/2272093327 wait complete. 2024-04-21T22:53:28.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:53:29.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.007+0000 7f6e5b081640 1 Processor -- start 2024-04-21T22:53:29.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.007+0000 7f6e5b081640 1 -- start start 2024-04-21T22:53:29.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.011+0000 7f6e5b081640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6e54152180 0x7f6e540c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:29.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.011+0000 7f6e5b081640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e540c6110 con 0x7f6e54152560 2024-04-21T22:53:29.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.011+0000 7f6e5b081640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e540716c0 con 0x7f6e54072460 2024-04-21T22:53:29.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.011+0000 7f6e5b081640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f6e540c63d0 con 0x7f6e54152180 2024-04-21T22:53:29.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.011+0000 7f6e58e1d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6e54152180 0x7f6e540c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:29.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.011+0000 7f6e53fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6e54152560 0x7f6e5406fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60232/0 (socket says 172.21.15.110:60232) 2024-04-21T22:53:29.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.011+0000 7f6e53fff640 1 -- 172.21.15.110:0/3043028518 learned_addr learned my addr 172.21.15.110:0/3043028518 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:29.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.015+0000 7f6e58e1d640 1 -- 172.21.15.110:0/3043028518 >> v1:172.21.15.154:6789/0 conn(0x7f6e54072460 legacy=0x7f6e540c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:29.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.015+0000 7f6e58e1d640 1 -- 172.21.15.110:0/3043028518 >> v1:172.21.15.110:6789/0 conn(0x7f6e54152560 legacy=0x7f6e5406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:29.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.015+0000 7f6e58e1d640 1 -- 172.21.15.110:0/3043028518 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e540c66b0 con 0x7f6e54152180 2024-04-21T22:53:29.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.023+0000 7f6e58e1d640 1 --2- 172.21.15.110:0/3043028518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e540c7490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e480097c0 tx=0x7f6e4801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e2d02d9a1ae082 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:29.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e537fe640 1 -- 172.21.15.110:0/3043028518 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e480b5070 con 0x7f6e54152180 2024-04-21T22:53:29.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e537fe640 1 -- 172.21.15.110:0/3043028518 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e480a8950 con 0x7f6e54152180 2024-04-21T22:53:29.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e537fe640 1 -- 172.21.15.110:0/3043028518 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e480a8d20 con 0x7f6e54152180 2024-04-21T22:53:29.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- 172.21.15.110:0/3043028518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 msgr2=0x7f6e540c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:29.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 --2- 172.21.15.110:0/3043028518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e540c7490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e480097c0 tx=0x7f6e4801ec50 comp rx=0 tx=0).stop 2024-04-21T22:53:29.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- 172.21.15.110:0/3043028518 shutdown_connections 2024-04-21T22:53:29.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 --2- 172.21.15.110:0/3043028518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e540c7490 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:29.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- 172.21.15.110:0/3043028518 >> 172.21.15.110:0/3043028518 conn(0x7f6e540cb710 msgr2=0x7f6e540cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:29.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- 172.21.15.110:0/3043028518 shutdown_connections 2024-04-21T22:53:29.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- 172.21.15.110:0/3043028518 wait complete. 2024-04-21T22:53:29.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 Processor -- start 2024-04-21T22:53:29.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- start start 2024-04-21T22:53:29.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54072460 0x7f6e541f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:29.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e54157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:29.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54152560 0x7f6e541f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:29.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6e54071f40 con 0x7f6e54152180 2024-04-21T22:53:29.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e54071c60 con 0x7f6e54152560 2024-04-21T22:53:29.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e5b081640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6e540c5530 con 0x7f6e54072460 2024-04-21T22:53:29.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.027+0000 7f6e53fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e54157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:29.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.031+0000 7f6e53fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e54157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59564/0 (socket says 172.21.15.110:59564) 2024-04-21T22:53:29.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.031+0000 7f6e53fff640 1 -- 172.21.15.110:0/458680943 learned_addr learned my addr 172.21.15.110:0/458680943 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:29.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.031+0000 7f6e53fff640 1 -- 172.21.15.110:0/458680943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54072460 msgr2=0x7f6e541f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:29.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.031+0000 7f6e53fff640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54072460 0x7f6e541f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:29.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.031+0000 7f6e53fff640 1 -- 172.21.15.110:0/458680943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54152560 msgr2=0x7f6e541f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:29.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.031+0000 7f6e53fff640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54152560 0x7f6e541f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:29.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.031+0000 7f6e53fff640 1 -- 172.21.15.110:0/458680943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e54159850 con 0x7f6e54152180 2024-04-21T22:53:29.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.035+0000 7f6e53fff640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e54157ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400cad0 tx=0x7f6e4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:29.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.039+0000 7f6e517fa640 1 -- 172.21.15.110:0/458680943 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44017070 con 0x7f6e54152180 2024-04-21T22:53:29.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.039+0000 7f6e517fa640 1 -- 172.21.15.110:0/458680943 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4400abd0 con 0x7f6e54152180 2024-04-21T22:53:29.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.039+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e540c3be0 con 0x7f6e54152180 2024-04-21T22:53:29.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.039+0000 7f6e517fa640 1 -- 172.21.15.110:0/458680943 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44012400 con 0x7f6e54152180 2024-04-21T22:53:29.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.039+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e540c4160 con 0x7f6e54152180 2024-04-21T22:53:29.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.043+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5404f510 con 0x7f6e54152180 2024-04-21T22:53:29.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.059+0000 7f6e517fa640 1 -- 172.21.15.110:0/458680943 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e4401a070 con 0x7f6e54152180 2024-04-21T22:53:29.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.063+0000 7f6e517fa640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6e40067940 0x7f6e40069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:29.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.063+0000 7f6e58e1d640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6e40067940 0x7f6e40069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:29.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.063+0000 7f6e58e1d640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6e40067940 0x7f6e40069e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e480b2000 tx=0x7f6e48004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:29.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.063+0000 7f6e517fa640 1 -- 172.21.15.110:0/458680943 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6e4405cac0 con 0x7f6e54152180 2024-04-21T22:53:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.343+0000 7f6e517fa640 1 -- 172.21.15.110:0/458680943 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f6e44021020 con 0x7f6e54152180 2024-04-21T22:53:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.547+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e5406fa40 con 0x7f6e54152180 2024-04-21T22:53:29.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.571+0000 7f6e517fa640 1 -- 172.21.15.110:0/458680943 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f6e44056920 con 0x7f6e54152180 2024-04-21T22:53:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:29.576 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T22:53:29.576 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 2 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6e40067940 msgr2=0x7f6e40069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6e40067940 0x7f6e40069e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e480b2000 tx=0x7f6e48004740 comp rx=0 tx=0).stop 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 msgr2=0x7f6e54157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e54157ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400cad0 tx=0x7f6e4400cf90 comp rx=0 tx=0).stop 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 shutdown_connections 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6e40067940 0x7f6e40069e00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54152560 0x7f6e541f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e54152180 0x7f6e54157ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 --2- 172.21.15.110:0/458680943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54072460 0x7f6e541f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:29.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 >> 172.21.15.110:0/458680943 conn(0x7f6e540cb710 msgr2=0x7f6e540c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:29.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 shutdown_connections 2024-04-21T22:53:29.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:29.575+0000 7f6e5b081640 1 -- 172.21.15.110:0/458680943 wait complete. 2024-04-21T22:53:31.596 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:53:31.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5c816640 1 Processor -- start 2024-04-21T22:53:31.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5c816640 1 -- start start 2024-04-21T22:53:31.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5c816640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 0x7f7f580c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5c816640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f58073160 con 0x7f7f58154520 2024-04-21T22:53:31.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5c816640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f58154900 con 0x7f7f580c9430 2024-04-21T22:53:31.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5c816640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7f580733f0 con 0x7f7f58072d60 2024-04-21T22:53:31.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5659c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7f58154520 0x7f7f5815e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60194/0 (socket says 172.21.15.110:60194) 2024-04-21T22:53:31.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f5659c640 1 -- 172.21.15.110:0/1902026661 learned_addr learned my addr 172.21.15.110:0/1902026661 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:31.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.727+0000 7f7f55d9b640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 0x7f7f580c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.731+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911883170 0 0) 0x7f7f58073160 con 0x7f7f58154520 2024-04-21T22:53:31.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.731+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f40003530 con 0x7f7f58154520 2024-04-21T22:53:31.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2486502286 0 0) 0x7f7f40003530 con 0x7f7f58154520 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 msgr2=0x7f7f580c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 0x7f7f580c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 >> v1:172.21.15.154:6789/0 conn(0x7f7f580c9430 legacy=0x7f7f58164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5815a320 con 0x7f7f58154520 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f7f48001680 con 0x7f7f58154520 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 >> v1:172.21.15.110:6789/0 conn(0x7f7f58154520 legacy=0x7f7f5815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 0x7f7f400039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f40003fc0 0x7f7f40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f40004d50 0x7f7f400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580733f0 con 0x7f7f40004d50 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4000bba0 con 0x7f7f40003fc0 2024-04-21T22:53:31.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.735+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4000bda0 con 0x7f7f58072d60 2024-04-21T22:53:31.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.739+0000 7f7f55d9b640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f40003fc0 0x7f7f40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.739+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f40004d50 0x7f7f400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.743+0000 7f7f5659c640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 0x7f7f400039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.747+0000 7f7f56d9d640 1 -- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 msgr2=0x7f7f400039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:31.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.747+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f58072d60 0x7f7f400039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:31.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.747+0000 7f7f56d9d640 1 -- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f40003fc0 msgr2=0x7f7f40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:31.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.747+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f40003fc0 0x7f7f40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:31.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.747+0000 7f7f56d9d640 1 -- 172.21.15.110:0/1902026661 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f40003530 con 0x7f7f40004d50 2024-04-21T22:53:31.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.751+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f40004d50 0x7f7f400051d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7f50001e70 tx=0x7f7f5001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaefd58ea39f69d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:31.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50001a90 con 0x7f7f40004d50 2024-04-21T22:53:31.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f50003b80 con 0x7f7f40004d50 2024-04-21T22:53:31.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5559a640 1 -- 172.21.15.110:0/1902026661 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50005080 con 0x7f7f40004d50 2024-04-21T22:53:31.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- 172.21.15.110:0/1902026661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f40004d50 msgr2=0x7f7f400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:31.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 --2- 172.21.15.110:0/1902026661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f40004d50 0x7f7f400051d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7f50001e70 tx=0x7f7f5001c780 comp rx=0 tx=0).stop 2024-04-21T22:53:31.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f56d9d640 1 -- 172.21.15.110:0/1902026661 reap_dead start 2024-04-21T22:53:31.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- 172.21.15.110:0/1902026661 shutdown_connections 2024-04-21T22:53:31.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- 172.21.15.110:0/1902026661 >> 172.21.15.110:0/1902026661 conn(0x7f7f580cc9a0 msgr2=0x7f7f580ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:31.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- 172.21.15.110:0/1902026661 shutdown_connections 2024-04-21T22:53:31.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- 172.21.15.110:0/1902026661 wait complete. 2024-04-21T22:53:31.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 Processor -- start 2024-04-21T22:53:31.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- start start 2024-04-21T22:53:31.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f40004d50 0x7f7f581557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5815d700 0x7f7f5815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f58149f90 0x7f7f5814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5815abc0 con 0x7f7f58149f90 2024-04-21T22:53:31.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5815a8e0 con 0x7f7f5815d700 2024-04-21T22:53:31.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.755+0000 7f7f5c816640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7f58073690 con 0x7f7f40004d50 2024-04-21T22:53:31.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.759+0000 7f7f5659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f40004d50 0x7f7f581557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.759+0000 7f7f55d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5815d700 0x7f7f5815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.759+0000 7f7f5659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f40004d50 0x7f7f581557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:33428/0 (socket says 172.21.15.110:33428) 2024-04-21T22:53:31.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.759+0000 7f7f5659c640 1 -- 172.21.15.110:0/1067809620 learned_addr learned my addr 172.21.15.110:0/1067809620 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:31.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.759+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f58149f90 0x7f7f5814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.767+0000 7f7f56d9d640 1 -- 172.21.15.110:0/1067809620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f40004d50 msgr2=0x7f7f581557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:31.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.767+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f40004d50 0x7f7f581557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:31.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.767+0000 7f7f56d9d640 1 -- 172.21.15.110:0/1067809620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5815d700 msgr2=0x7f7f5815db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:31.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.767+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5815d700 0x7f7f5815db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:31.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.767+0000 7f7f56d9d640 1 -- 172.21.15.110:0/1067809620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f581f4180 con 0x7f7f58149f90 2024-04-21T22:53:31.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.767+0000 7f7f56d9d640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f58149f90 0x7f7f5814a410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009000 tx=0x7f7f40005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:31.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.771+0000 7f7f46ffd640 1 -- 172.21.15.110:0/1067809620 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f500bb070 con 0x7f7f58149f90 2024-04-21T22:53:31.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.771+0000 7f7f46ffd640 1 -- 172.21.15.110:0/1067809620 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f500012e0 con 0x7f7f58149f90 2024-04-21T22:53:31.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.771+0000 7f7f46ffd640 1 -- 172.21.15.110:0/1067809620 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50007dc0 con 0x7f7f58149f90 2024-04-21T22:53:31.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.771+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5806bcf0 con 0x7f7f58149f90 2024-04-21T22:53:31.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.771+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f58156070 con 0x7f7f58149f90 2024-04-21T22:53:31.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.771+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5804f510 con 0x7f7f58149f90 2024-04-21T22:53:31.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.791+0000 7f7f46ffd640 1 -- 172.21.15.110:0/1067809620 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f500b0040 con 0x7f7f58149f90 2024-04-21T22:53:31.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.791+0000 7f7f46ffd640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7f380678c0 0x7f7f38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.791+0000 7f7f5659c640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7f380678c0 0x7f7f38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:31.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.795+0000 7f7f5659c640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7f380678c0 0x7f7f38069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c10 tx=0x7f7f48001dc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:31.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:31.795+0000 7f7f46ffd640 1 -- 172.21.15.110:0/1067809620 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f7f500eda00 con 0x7f7f58149f90 2024-04-21T22:53:32.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.083+0000 7f7f46ffd640 1 -- 172.21.15.110:0/1067809620 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f7f500c5080 con 0x7f7f58149f90 2024-04-21T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.282+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f580706a0 con 0x7f7f58149f90 2024-04-21T22:53:32.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.342+0000 7f7f46ffd640 1 -- 172.21.15.110:0/1067809620 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5530 (secure 0 0 0) 0x7f7f500ac020 con 0x7f7f58149f90 2024-04-21T22:53:32.347 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:32.347 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3272126146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3272126146},{"type":"v1","addr":"172.21.15.154:6835","nonce":3272126146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1335792720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1335792720},{"type":"v1","addr":"172.21.15.110:6839","nonce":1335792720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1521497243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1521497243},{"type":"v1","addr":"172.21.15.154:6833","nonce":1521497243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1669982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1669982495},{"type":"v1","addr":"172.21.15.154:6837","nonce":1669982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1034856927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1034856927},{"type":"v1","addr":"172.21.15.110:6837","nonce":1034856927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-21T22:53:32.348 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 3 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7f380678c0 msgr2=0x7f7f38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7f380678c0 0x7f7f38069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c10 tx=0x7f7f48001dc0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f58149f90 msgr2=0x7f7f5814a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f58149f90 0x7f7f5814a410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009000 tx=0x7f7f40005840 comp rx=0 tx=0).stop 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 shutdown_connections 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7f380678c0 0x7f7f38069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f58149f90 0x7f7f5814a410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5815d700 0x7f7f5815db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 --2- 172.21.15.110:0/1067809620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f40004d50 0x7f7f581557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 >> 172.21.15.110:0/1067809620 conn(0x7f7f580cc9a0 msgr2=0x7f7f580c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 shutdown_connections 2024-04-21T22:53:32.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.346+0000 7f7f5c816640 1 -- 172.21.15.110:0/1067809620 wait complete. 2024-04-21T22:53:32.368 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:32.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 Processor -- start 2024-04-21T22:53:32.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 -- start start 2024-04-21T22:53:32.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784154940 0x7f3784072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:32.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3784071a60 0x7f378415b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:32.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f378415e4c0 0x7f37840c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:32.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f37840c8a70 con 0x7f378415e4c0 2024-04-21T22:53:32.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f37840c84b0 con 0x7f3784071a60 2024-04-21T22:53:32.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37897d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f37840c8790 con 0x7f3784154940 2024-04-21T22:53:32.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37837fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f378415e4c0 0x7f37840c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:32.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.490+0000 7f37837fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f378415e4c0 0x7f37840c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60018/0 (socket says 172.21.15.110:60018) 2024-04-21T22:53:32.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f37837fe640 1 -- 172.21.15.110:0/3979981998 learned_addr learned my addr 172.21.15.110:0/3979981998 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:32.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f3782ffd640 1 --2- 172.21.15.110:0/3979981998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784154940 0x7f3784072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:32.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f37827fc640 1 --2- 172.21.15.110:0/3979981998 >> v2:172.21.15.154:3300/0 conn(0x7f3784071a60 0x7f378415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:32.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f37837fe640 1 -- 172.21.15.110:0/3979981998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784154940 msgr2=0x7f3784072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:32.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f37837fe640 1 --2- 172.21.15.110:0/3979981998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784154940 0x7f3784072140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f37837fe640 1 -- 172.21.15.110:0/3979981998 >> v2:172.21.15.154:3300/0 conn(0x7f3784071a60 msgr2=0x7f378415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:32.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f37837fe640 1 --2- 172.21.15.110:0/3979981998 >> v2:172.21.15.154:3300/0 conn(0x7f3784071a60 0x7f378415b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.494+0000 7f37837fe640 1 -- 172.21.15.110:0/3979981998 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378415a620 con 0x7f378415e4c0 2024-04-21T22:53:32.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.498+0000 7f37837fe640 1 --2- 172.21.15.110:0/3979981998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f37840c68a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f378406ffb0 tx=0x7f377c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca60ec3e1914ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:32.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f3781ffb640 1 -- 172.21.15.110:0/3979981998 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0b0070 con 0x7f378415e4c0 2024-04-21T22:53:32.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f3781ffb640 1 -- 172.21.15.110:0/3979981998 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c0ab600 con 0x7f378415e4c0 2024-04-21T22:53:32.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f3781ffb640 1 -- 172.21.15.110:0/3979981998 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0ab9d0 con 0x7f378415e4c0 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 -- 172.21.15.110:0/3979981998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 msgr2=0x7f37840c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 --2- 172.21.15.110:0/3979981998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f37840c68a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f378406ffb0 tx=0x7f377c01c460 comp rx=0 tx=0).stop 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 -- 172.21.15.110:0/3979981998 shutdown_connections 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 --2- 172.21.15.110:0/3979981998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f37840c68a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 --2- 172.21.15.110:0/3979981998 >> v2:172.21.15.154:3300/0 conn(0x7f3784071a60 0x7f378415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 --2- 172.21.15.110:0/3979981998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784154940 0x7f3784072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 -- 172.21.15.110:0/3979981998 >> 172.21.15.110:0/3979981998 conn(0x7f37840cb710 msgr2=0x7f37840cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 -- 172.21.15.110:0/3979981998 shutdown_connections 2024-04-21T22:53:32.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 -- 172.21.15.110:0/3979981998 wait complete. 2024-04-21T22:53:32.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 Processor -- start 2024-04-21T22:53:32.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.506+0000 7f37897d1640 1 -- start start 2024-04-21T22:53:32.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37897d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784071a60 0x7f37841f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:32.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37897d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3784154940 0x7f37841f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:32.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37897d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f378414f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:32.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37897d1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f37840c81f0 con 0x7f378415e4c0 2024-04-21T22:53:32.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37897d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37840c8070 con 0x7f3784154940 2024-04-21T22:53:32.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37897d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f378406f6a0 con 0x7f3784071a60 2024-04-21T22:53:32.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37837fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f378414f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:32.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37837fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f378414f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60024/0 (socket says 172.21.15.110:60024) 2024-04-21T22:53:32.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37837fe640 1 -- 172.21.15.110:0/915523593 learned_addr learned my addr 172.21.15.110:0/915523593 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:32.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f3782ffd640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784071a60 0x7f37841f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:32.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.510+0000 7f37827fc640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3784154940 0x7f37841f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:32.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.514+0000 7f37837fe640 1 -- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784071a60 msgr2=0x7f37841f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:32.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.514+0000 7f37837fe640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784071a60 0x7f37841f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.514+0000 7f37837fe640 1 -- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3784154940 msgr2=0x7f37841f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:32.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.514+0000 7f37837fe640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3784154940 0x7f37841f7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:32.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.514+0000 7f37837fe640 1 -- 172.21.15.110:0/915523593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3784151570 con 0x7f378415e4c0 2024-04-21T22:53:32.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.514+0000 7f37837fe640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f378414f700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f377c01cd00 tx=0x7f377c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:32.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.518+0000 7f377b7fe640 1 -- 172.21.15.110:0/915523593 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0ba070 con 0x7f378415e4c0 2024-04-21T22:53:32.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.518+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3784151810 con 0x7f378415e4c0 2024-04-21T22:53:32.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.518+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378414e7a0 con 0x7f378415e4c0 2024-04-21T22:53:32.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.518+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378404f510 con 0x7f378415e4c0 2024-04-21T22:53:32.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.522+0000 7f377b7fe640 1 -- 172.21.15.110:0/915523593 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c0ab600 con 0x7f378415e4c0 2024-04-21T22:53:32.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.522+0000 7f377b7fe640 1 -- 172.21.15.110:0/915523593 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0b0040 con 0x7f378415e4c0 2024-04-21T22:53:32.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.794+0000 7f377b7fe640 1 -- 172.21.15.110:0/915523593 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f377c0bd070 con 0x7f378415e4c0 2024-04-21T22:53:32.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.794+0000 7f377b7fe640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37640678c0 0x7f3764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:32.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.794+0000 7f3782ffd640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37640678c0 0x7f3764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:32.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.794+0000 7f3782ffd640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37640678c0 0x7f3764069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3774006aa0 tx=0x7f3774008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:32.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.822+0000 7f377b7fe640 1 -- 172.21.15.110:0/915523593 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f377c0ed670 con 0x7f378415e4c0 2024-04-21T22:53:32.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.822+0000 7f377b7fe640 1 -- 172.21.15.110:0/915523593 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f377c0c5080 con 0x7f378415e4c0 2024-04-21T22:53:33.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:32.998+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37840c7400 con 0x7f378415e4c0 2024-04-21T22:53:33.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.066+0000 7f377b7fe640 1 -- 172.21.15.110:0/915523593 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7f377c016110 con 0x7f378415e4c0 2024-04-21T22:53:33.069 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:33.070 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":19,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:52:59.102208+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37640678c0 msgr2=0x7f3764069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37640678c0 0x7f3764069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3774006aa0 tx=0x7f3774008040 comp rx=0 tx=0).stop 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 msgr2=0x7f378414f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f378414f700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f377c01cd00 tx=0x7f377c019200 comp rx=0 tx=0).stop 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 shutdown_connections 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37640678c0 0x7f3764069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f378415e4c0 0x7f378414f700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3784154940 0x7f37841f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 --2- 172.21.15.110:0/915523593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3784071a60 0x7f37841f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 >> 172.21.15.110:0/915523593 conn(0x7f37840cb710 msgr2=0x7f3784072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:33.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 shutdown_connections 2024-04-21T22:53:33.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.070+0000 7f37897d1640 1 -- 172.21.15.110:0/915523593 wait complete. 2024-04-21T22:53:33.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:52:54.296733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:53:33.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:53:33.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.214+0000 7ffa58cb6640 1 Processor -- start 2024-04-21T22:53:33.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.214+0000 7ffa58cb6640 1 -- start start 2024-04-21T22:53:33.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.214+0000 7ffa58cb6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa5406c380 0x7ffa5406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:33.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.214+0000 7ffa58cb6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa540cde60 0x7ffa540ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:33.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.214+0000 7ffa58cb6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa540cd9b0 con 0x7ffa540ceb40 2024-04-21T22:53:33.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.214+0000 7ffa58cb6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ffa540ce7d0 con 0x7ffa5406c380 2024-04-21T22:53:33.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.214+0000 7ffa58cb6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ffa5415a5d0 con 0x7ffa540cde60 2024-04-21T22:53:33.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.218+0000 7ffa5259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa5406c380 0x7ffa5406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:33.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.218+0000 7ffa51d9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ffa540ceb40 0x7ffa540cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60200/0 (socket says 172.21.15.110:60200) 2024-04-21T22:53:33.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.218+0000 7ffa51d9b640 1 -- 172.21.15.110:0/595876235 learned_addr learned my addr 172.21.15.110:0/595876235 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:33.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.222+0000 7ffa5259c640 1 -- 172.21.15.110:0/595876235 >> v2:172.21.15.154:3300/0 conn(0x7ffa540cde60 msgr2=0x7ffa540ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:33.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.222+0000 7ffa5259c640 1 --2- 172.21.15.110:0/595876235 >> v2:172.21.15.154:3300/0 conn(0x7ffa540cde60 0x7ffa540ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.222+0000 7ffa5259c640 1 -- 172.21.15.110:0/595876235 >> v1:172.21.15.110:6789/0 conn(0x7ffa540ceb40 legacy=0x7ffa540cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.222+0000 7ffa5259c640 1 -- 172.21.15.110:0/595876235 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5415a8b0 con 0x7ffa5406c380 2024-04-21T22:53:33.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.226+0000 7ffa5259c640 1 --2- 172.21.15.110:0/595876235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5406c380 0x7ffa5406c760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa540cf980 tx=0x7ffa4401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a90a5e712b67cdb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:33.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa5159a640 1 -- 172.21.15.110:0/595876235 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa440b5070 con 0x7ffa5406c380 2024-04-21T22:53:33.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa5159a640 1 -- 172.21.15.110:0/595876235 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa440a8970 con 0x7ffa5406c380 2024-04-21T22:53:33.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa5159a640 1 -- 172.21.15.110:0/595876235 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa440a8d40 con 0x7ffa5406c380 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 -- 172.21.15.110:0/595876235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5406c380 msgr2=0x7ffa5406c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/595876235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5406c380 0x7ffa5406c760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa540cf980 tx=0x7ffa4401ec70 comp rx=0 tx=0).stop 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 -- 172.21.15.110:0/595876235 shutdown_connections 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/595876235 >> v2:172.21.15.154:3300/0 conn(0x7ffa540cde60 0x7ffa540ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/595876235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5406c380 0x7ffa5406c760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 -- 172.21.15.110:0/595876235 >> 172.21.15.110:0/595876235 conn(0x7ffa540b1640 msgr2=0x7ffa540b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 -- 172.21.15.110:0/595876235 shutdown_connections 2024-04-21T22:53:33.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.234+0000 7ffa58cb6640 1 -- 172.21.15.110:0/595876235 wait complete. 2024-04-21T22:53:33.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 Processor -- start 2024-04-21T22:53:33.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 -- start start 2024-04-21T22:53:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5406c380 0x7ffa541e5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa540cde60 0x7ffa541592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa540ceb40 0x7ffa540c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffa540cb130 con 0x7ffa540cde60 2024-04-21T22:53:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5415ae70 con 0x7ffa5406c380 2024-04-21T22:53:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.238+0000 7ffa58cb6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5415a2a0 con 0x7ffa540ceb40 2024-04-21T22:53:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.242+0000 7ffa5259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5406c380 0x7ffa541e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.242+0000 7ffa5259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5406c380 0x7ffa541e5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:39040/0 (socket says 172.21.15.110:39040) 2024-04-21T22:53:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.242+0000 7ffa5259c640 1 -- 172.21.15.110:0/2724560555 learned_addr learned my addr 172.21.15.110:0/2724560555 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.242+0000 7ffa52d9d640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa540ceb40 0x7ffa540c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:33.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.250+0000 7ffa5259c640 1 -- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa540ceb40 msgr2=0x7ffa540c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.250+0000 7ffa5259c640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa540ceb40 0x7ffa540c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.250+0000 7ffa5259c640 1 -- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa540cde60 msgr2=0x7ffa541592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.250+0000 7ffa5259c640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa540cde60 0x7ffa541592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.250+0000 7ffa5259c640 1 -- 172.21.15.110:0/2724560555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa541e3610 con 0x7ffa5406c380 2024-04-21T22:53:33.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.258+0000 7ffa5259c640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5406c380 0x7ffa541e5620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa440b3040 tx=0x7ffa4401ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:33.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.266+0000 7ffa4affd640 1 -- 172.21.15.110:0/2724560555 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa440b5040 con 0x7ffa5406c380 2024-04-21T22:53:33.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.266+0000 7ffa4affd640 1 -- 172.21.15.110:0/2724560555 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa440bf070 con 0x7ffa5406c380 2024-04-21T22:53:33.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.266+0000 7ffa4affd640 1 -- 172.21.15.110:0/2724560555 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa440b0a40 con 0x7ffa5406c380 2024-04-21T22:53:33.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.266+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa541e5b60 con 0x7ffa5406c380 2024-04-21T22:53:33.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.266+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa541e3bb0 con 0x7ffa5406c380 2024-04-21T22:53:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.270+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5404f510 con 0x7ffa5406c380 2024-04-21T22:53:33.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.654+0000 7ffa4affd640 1 -- 172.21.15.110:0/2724560555 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa440b0be0 con 0x7ffa5406c380 2024-04-21T22:53:33.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.658+0000 7ffa4affd640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ffa340678f0 0x7ffa34069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:33.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.658+0000 7ffa51d9b640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ffa340678f0 0x7ffa34069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:33.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.658+0000 7ffa51d9b640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ffa340678f0 0x7ffa34069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c000f70 tx=0x7ffa3c007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:33.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.662+0000 7ffa4affd640 1 -- 172.21.15.110:0/2724560555 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ffa440faa30 con 0x7ffa5406c380 2024-04-21T22:53:33.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.694+0000 7ffa4affd640 1 -- 172.21.15.110:0/2724560555 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7ffa440187d0 con 0x7ffa5406c380 2024-04-21T22:53:33.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.870+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffa540c6950 con 0x7ffa5406c380 2024-04-21T22:53:33.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa4affd640 1 -- 172.21.15.110:0/2724560555 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7ffa440f4890 con 0x7ffa5406c380 2024-04-21T22:53:33.943 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ffa340678f0 msgr2=0x7ffa34069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ffa340678f0 0x7ffa34069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c000f70 tx=0x7ffa3c007a90 comp rx=0 tx=0).stop 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5406c380 msgr2=0x7ffa541e5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5406c380 0x7ffa541e5620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa440b3040 tx=0x7ffa4401ba10 comp rx=0 tx=0).stop 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 shutdown_connections 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ffa340678f0 0x7ffa34069db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa540ceb40 0x7ffa540c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa540cde60 0x7ffa541592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 --2- 172.21.15.110:0/2724560555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5406c380 0x7ffa541e5620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 >> 172.21.15.110:0/2724560555 conn(0x7ffa540b1640 msgr2=0x7ffa540b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:33.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 shutdown_connections 2024-04-21T22:53:33.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:33.942+0000 7ffa58cb6640 1 -- 172.21.15.110:0/2724560555 wait complete. 2024-04-21T22:53:33.965 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-21T22:53:34.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.082+0000 7f582bc05640 1 Processor -- start 2024-04-21T22:53:34.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.082+0000 7f582bc05640 1 -- start start 2024-04-21T22:53:34.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f582bc05640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5824152180 0x7f58240c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f582bc05640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824152560 0x7f5824158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f582bc05640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58240c6110 con 0x7f5824072460 2024-04-21T22:53:34.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f582bc05640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f58241592e0 con 0x7f5824152180 2024-04-21T22:53:34.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f582bc05640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f58240716c0 con 0x7f5824152560 2024-04-21T22:53:34.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f58291a0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824152560 0x7f5824158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f58299a1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5824152180 0x7f58240c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f58291a0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824152560 0x7f5824158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:33476/0 (socket says 172.21.15.110:33476) 2024-04-21T22:53:34.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.086+0000 7f58291a0640 1 -- 172.21.15.110:0/3843780033 learned_addr learned my addr 172.21.15.110:0/3843780033 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:34.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.094+0000 7f58291a0640 1 -- 172.21.15.110:0/3843780033 >> v2:172.21.15.154:3300/0 conn(0x7f5824152180 msgr2=0x7f58240c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:34.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.094+0000 7f58291a0640 1 --2- 172.21.15.110:0/3843780033 >> v2:172.21.15.154:3300/0 conn(0x7f5824152180 0x7f58240c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.094+0000 7f58291a0640 1 -- 172.21.15.110:0/3843780033 >> v1:172.21.15.154:6789/0 conn(0x7f5824072460 legacy=0x7f582406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:34.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.094+0000 7f58291a0640 1 -- 172.21.15.110:0/3843780033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58240c63d0 con 0x7f5824152560 2024-04-21T22:53:34.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.098+0000 7f58291a0640 1 --2- 172.21.15.110:0/3843780033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824152560 0x7f5824158da0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f582001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d5fd0c8858b606d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:34.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582899f640 1 -- 172.21.15.110:0/3843780033 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200b5070 con 0x7f5824152560 2024-04-21T22:53:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582899f640 1 -- 172.21.15.110:0/3843780033 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58200a89d0 con 0x7f5824152560 2024-04-21T22:53:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582899f640 1 -- 172.21.15.110:0/3843780033 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200a8da0 con 0x7f5824152560 2024-04-21T22:53:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- 172.21.15.110:0/3843780033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824152560 msgr2=0x7f5824158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 --2- 172.21.15.110:0/3843780033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824152560 0x7f5824158da0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f582001ed10 comp rx=0 tx=0).stop 2024-04-21T22:53:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- 172.21.15.110:0/3843780033 shutdown_connections 2024-04-21T22:53:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 --2- 172.21.15.110:0/3843780033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824152560 0x7f5824158da0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 --2- 172.21.15.110:0/3843780033 >> v2:172.21.15.154:3300/0 conn(0x7f5824152180 0x7f58240c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- 172.21.15.110:0/3843780033 >> 172.21.15.110:0/3843780033 conn(0x7f58240cb710 msgr2=0x7f58240cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- 172.21.15.110:0/3843780033 shutdown_connections 2024-04-21T22:53:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- 172.21.15.110:0/3843780033 wait complete. 2024-04-21T22:53:34.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 Processor -- start 2024-04-21T22:53:34.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- start start 2024-04-21T22:53:34.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824072460 0x7f5824148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5824152180 0x7f58240c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5824152560 0x7f58240c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5824071c60 con 0x7f5824152180 2024-04-21T22:53:34.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5824071980 con 0x7f5824152560 2024-04-21T22:53:34.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.110+0000 7f582bc05640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5824071f40 con 0x7f5824072460 2024-04-21T22:53:34.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.114+0000 7f58291a0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5824152180 0x7f58240c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.114+0000 7f58291a0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5824152180 0x7f58240c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60046/0 (socket says 172.21.15.110:60046) 2024-04-21T22:53:34.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.114+0000 7f58291a0640 1 -- 172.21.15.110:0/2035214530 learned_addr learned my addr 172.21.15.110:0/2035214530 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:34.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.114+0000 7f582a1a2640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5824152560 0x7f58240c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.114+0000 7f58299a1640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824072460 0x7f5824148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.118+0000 7f58291a0640 1 -- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824072460 msgr2=0x7f5824148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.118+0000 7f58291a0640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824072460 0x7f5824148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.118+0000 7f58291a0640 1 -- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5824152560 msgr2=0x7f58240c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.118+0000 7f58291a0640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5824152560 0x7f58240c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.118+0000 7f58291a0640 1 -- 172.21.15.110:0/2035214530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58241eff90 con 0x7f5824152180 2024-04-21T22:53:34.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.122+0000 7f58291a0640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5824152180 0x7f58240c3ec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58200b3040 tx=0x7f582001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:34.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.126+0000 7f581a7fc640 1 -- 172.21.15.110:0/2035214530 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200c0070 con 0x7f5824152180 2024-04-21T22:53:34.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.130+0000 7f581a7fc640 1 -- 172.21.15.110:0/2035214530 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58200b0840 con 0x7f5824152180 2024-04-21T22:53:34.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.130+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58241f0250 con 0x7f5824152180 2024-04-21T22:53:34.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.130+0000 7f581a7fc640 1 -- 172.21.15.110:0/2035214530 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200b5040 con 0x7f5824152180 2024-04-21T22:53:34.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.130+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58241f0810 con 0x7f5824152180 2024-04-21T22:53:34.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.130+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582404f510 con 0x7f5824152180 2024-04-21T22:53:34.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.418+0000 7f581a7fc640 1 -- 172.21.15.110:0/2035214530 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58200c3070 con 0x7f5824152180 2024-04-21T22:53:34.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.422+0000 7f581a7fc640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5808067910 0x7f5808069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.422+0000 7f58299a1640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5808067910 0x7f5808069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.422+0000 7f58299a1640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5808067910 0x7f5808069dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5824157a20 tx=0x7f5814009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:34.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.462+0000 7f581a7fc640 1 -- 172.21.15.110:0/2035214530 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f58200f9a90 con 0x7f5824152180 2024-04-21T22:53:34.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.462+0000 7f581a7fc640 1 -- 172.21.15.110:0/2035214530 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f58200cb080 con 0x7f5824152180 2024-04-21T22:53:34.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.642+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f582415c4e0 con 0x7f5824152180 2024-04-21T22:53:34.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f581a7fc640 1 -- 172.21.15.110:0/2035214530 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f5820018870 con 0x7f5824152180 2024-04-21T22:53:34.659 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:34.660 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2024-04-21T22:53:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-21T22:53:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2024-04-21T22:53:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": ".mgr" 2024-04-21T22:53:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-21T22:53:34.660 INFO:teuthology.orchestra.run.smithi110.stdout:] 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5808067910 msgr2=0x7f5808069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5808067910 0x7f5808069dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5824157a20 tx=0x7f5814009190 comp rx=0 tx=0).stop 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5824152180 msgr2=0x7f58240c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5824152180 0x7f58240c3ec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58200b3040 tx=0x7f582001bab0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 shutdown_connections 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5808067910 0x7f5808069dd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5824152560 0x7f58240c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5824152180 0x7f58240c3ec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 --2- 172.21.15.110:0/2035214530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5824072460 0x7f5824148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 >> 172.21.15.110:0/2035214530 conn(0x7f58240cb710 msgr2=0x7f58241504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 shutdown_connections 2024-04-21T22:53:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.658+0000 7f582bc05640 1 -- 172.21.15.110:0/2035214530 wait complete. 2024-04-21T22:53:34.681 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-21T22:53:34.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-21T22:53:34.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.798+0000 7f6801456640 1 Processor -- start 2024-04-21T22:53:34.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.798+0000 7f6801456640 1 -- start start 2024-04-21T22:53:34.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.798+0000 7f6801456640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67fc0c6990 0x7f67fc15a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.798+0000 7f6801456640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67fc1580a0 con 0x7f67fc157c60 2024-04-21T22:53:34.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.798+0000 7f6801456640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67fc0c45c0 con 0x7f67fc0c3e30 2024-04-21T22:53:34.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.798+0000 7f6801456640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f67fc0c48a0 con 0x7f67fc0c6990 2024-04-21T22:53:34.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.802+0000 7f67fa7fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f67fc157c60 0x7f67fc0c7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60216/0 (socket says 172.21.15.110:60216) 2024-04-21T22:53:34.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.802+0000 7f67fa7fc640 1 -- 172.21.15.110:0/783114106 learned_addr learned my addr 172.21.15.110:0/783114106 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:34.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.802+0000 7f67faffd640 1 --2- 172.21.15.110:0/783114106 >> v2:172.21.15.154:3300/0 conn(0x7f67fc0c6990 0x7f67fc15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.802+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360510104 0 0) 0x7f67f0001120 con 0x7f67fc157c60 2024-04-21T22:53:34.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.802+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e4003530 con 0x7f67fc157c60 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2332123221 0 0) 0x7f67e4003530 con 0x7f67fc157c60 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 >> v2:172.21.15.154:3300/0 conn(0x7f67fc0c6990 msgr2=0x7f67fc15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 --2- 172.21.15.110:0/783114106 >> v2:172.21.15.154:3300/0 conn(0x7f67fc0c6990 0x7f67fc15a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 >> v1:172.21.15.154:6789/0 conn(0x7f67fc0c3e30 legacy=0x7f67fc072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0c4b80 con 0x7f67fc157c60 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f67f0001850 con 0x7f67fc157c60 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 >> v1:172.21.15.110:6789/0 conn(0x7f67fc157c60 legacy=0x7f67fc0c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e4003a10 0x7f67e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e4004810 0x7f67e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e40051d0 0x7f67e400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0c48a0 con 0x7f67e4004810 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67e400e290 con 0x7f67e40051d0 2024-04-21T22:53:34.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.806+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f67e400e490 con 0x7f67e4003a10 2024-04-21T22:53:34.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.810+0000 7f67faffd640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e4003a10 0x7f67e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.810+0000 7f67fa7fc640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e4004810 0x7f67e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.814+0000 7f67fa7fc640 1 -- 172.21.15.110:0/783114106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e4003a10 msgr2=0x7f67e4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:34.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.814+0000 7f67fa7fc640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e4003a10 0x7f67e4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.814+0000 7f67fa7fc640 1 -- 172.21.15.110:0/783114106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e40051d0 msgr2=0x7f67e400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:34.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.814+0000 7f67fa7fc640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e40051d0 0x7f67e400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.814+0000 7f67fa7fc640 1 -- 172.21.15.110:0/783114106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e4003530 con 0x7f67e4004810 2024-04-21T22:53:34.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.814+0000 7f67fb7fe640 1 -- 172.21.15.110:0/783114106 reap_dead start 2024-04-21T22:53:34.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.818+0000 7f67fa7fc640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e4004810 0x7f67e4004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c320 tx=0x7f67f001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ace3035a246a34b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:34.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.822+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0007e60 con 0x7f67e4004810 2024-04-21T22:53:34.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.822+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f00a9070 con 0x7f67e4004810 2024-04-21T22:53:34.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.822+0000 7f67f9ffb640 1 -- 172.21.15.110:0/783114106 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0005da0 con 0x7f67e4004810 2024-04-21T22:53:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- 172.21.15.110:0/783114106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e4004810 msgr2=0x7f67e4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e4004810 0x7f67e4004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c320 tx=0x7f67f001cbc0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- 172.21.15.110:0/783114106 shutdown_connections 2024-04-21T22:53:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 --2- 172.21.15.110:0/783114106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e4004810 0x7f67e4004c90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- 172.21.15.110:0/783114106 >> 172.21.15.110:0/783114106 conn(0x7f67fc0cc930 msgr2=0x7f67fc0ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- 172.21.15.110:0/783114106 shutdown_connections 2024-04-21T22:53:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- 172.21.15.110:0/783114106 wait complete. 2024-04-21T22:53:34.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 Processor -- start 2024-04-21T22:53:34.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- start start 2024-04-21T22:53:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4004810 0x7f67fc1e0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc1e5ed0 0x7f67fc153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc154240 0x7f67fc1f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0c42c0 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc157740 con 0x7f67e4004810 2024-04-21T22:53:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f6801456640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc0c6d70 con 0x7f67fc154240 2024-04-21T22:53:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f67fa7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc1e5ed0 0x7f67fc153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f67fa7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc1e5ed0 0x7f67fc153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60074/0 (socket says 172.21.15.110:60074) 2024-04-21T22:53:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.826+0000 7f67fa7fc640 1 -- 172.21.15.110:0/1195581922 learned_addr learned my addr 172.21.15.110:0/1195581922 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.830+0000 7f67fb7fe640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc154240 0x7f67fc1f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.830+0000 7f67faffd640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4004810 0x7f67fc1e0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.830+0000 7f67fa7fc640 1 -- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc154240 msgr2=0x7f67fc1f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.830+0000 7f67fa7fc640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc154240 0x7f67fc1f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.830+0000 7f67fa7fc640 1 -- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4004810 msgr2=0x7f67fc1e0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:34.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.830+0000 7f67fa7fc640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4004810 0x7f67fc1e0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:34.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.830+0000 7f67fa7fc640 1 -- 172.21.15.110:0/1195581922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc1546c0 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.834+0000 7f67fa7fc640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc1e5ed0 0x7f67fc153d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c320 tx=0x7f67e4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:34.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.838+0000 7f67e37fe640 1 -- 172.21.15.110:0/1195581922 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00a5cd0 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.838+0000 7f67e37fe640 1 -- 172.21.15.110:0/1195581922 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0001120 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.838+0000 7f67e37fe640 1 -- 172.21.15.110:0/1195581922 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00073d0 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.838+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc1f1330 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.838+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc1f4710 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.838+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67fc0cd140 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.858+0000 7f67e37fe640 1 -- 172.21.15.110:0/1195581922 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67f0007570 con 0x7f67fc1e5ed0 2024-04-21T22:53:34.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.858+0000 7f67e37fe640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67e8067910 0x7f67e8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:34.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.858+0000 7f67faffd640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67e8067910 0x7f67e8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:34.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:34.858+0000 7f67faffd640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67e8067910 0x7f67e8069dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009c60 tx=0x7f67ec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:35.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.138+0000 7f67e37fe640 1 -- 172.21.15.110:0/1195581922 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f67f00f6950 con 0x7f67fc1e5ed0 2024-04-21T22:53:35.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.138+0000 7f67e37fe640 1 -- 172.21.15.110:0/1195581922 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f67fc1546c0 con 0x7f67fc1e5ed0 2024-04-21T22:53:35.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.314+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f67fc04f5f0 con 0x7f67fc1e5ed0 2024-04-21T22:53:35.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.930+0000 7f67e37fe640 1 -- 172.21.15.110:0/1195581922 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f67fc1580a0 con 0x7f67fc1e5ed0 2024-04-21T22:53:35.932 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67e8067910 msgr2=0x7f67e8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67e8067910 0x7f67e8069dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009c60 tx=0x7f67ec009190 comp rx=0 tx=0).stop 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc1e5ed0 msgr2=0x7f67fc153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc1e5ed0 0x7f67fc153d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c320 tx=0x7f67e4005840 comp rx=0 tx=0).stop 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 shutdown_connections 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67e8067910 0x7f67e8069dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc154240 0x7f67fc1f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67fc1e5ed0 0x7f67fc153d00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 --2- 172.21.15.110:0/1195581922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4004810 0x7f67fc1e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 >> 172.21.15.110:0/1195581922 conn(0x7f67fc0cc930 msgr2=0x7f67fc06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 shutdown_connections 2024-04-21T22:53:35.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:35.934+0000 7f6801456640 1 -- 172.21.15.110:0/1195581922 wait complete. 2024-04-21T22:53:35.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-21T22:53:36.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.094+0000 7f0a4dd46640 1 Processor -- start 2024-04-21T22:53:36.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.094+0000 7f0a4dd46640 1 -- start start 2024-04-21T22:53:36.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.098+0000 7f0a4dd46640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a480c75e0 0x7f0a480c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.098+0000 7f0a4dd46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a480c3410 0x7f0a480c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.098+0000 7f0a4dd46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a48157e50 con 0x7f0a4814dad0 2024-04-21T22:53:36.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.098+0000 7f0a4dd46640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0a480727a0 con 0x7f0a480c75e0 2024-04-21T22:53:36.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.098+0000 7f0a4dd46640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0a48156f60 con 0x7f0a480c3410 2024-04-21T22:53:36.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.098+0000 7f0a477fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0a4814dad0 0x7f0a48157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60222/0 (socket says 172.21.15.110:60222) 2024-04-21T22:53:36.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.098+0000 7f0a477fe640 1 -- 172.21.15.110:0/6696344 learned_addr learned my addr 172.21.15.110:0/6696344 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:36.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.106+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662556617 0 0) 0x7f0a48157e50 con 0x7f0a4814dad0 2024-04-21T22:53:36.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.106+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a34003530 con 0x7f0a4814dad0 2024-04-21T22:53:36.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.106+0000 7f0a47fff640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a480c3410 0x7f0a480c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:36.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1540198956 0 0) 0x7f0a34003530 con 0x7f0a4814dad0 2024-04-21T22:53:36.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a480c3410 msgr2=0x7f0a480c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a480c3410 0x7f0a480c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 >> v2:172.21.15.154:3300/0 conn(0x7f0a480c75e0 msgr2=0x7f0a480c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 --2- 172.21.15.110:0/6696344 >> v2:172.21.15.154:3300/0 conn(0x7f0a480c75e0 0x7f0a480c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a48073700 con 0x7f0a4814dad0 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f0a380016a0 con 0x7f0a4814dad0 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 >> v1:172.21.15.110:6789/0 conn(0x7f0a4814dad0 legacy=0x7f0a48157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a340039c0 0x7f0a34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a34004810 0x7f0a34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a480c3410 0x7f0a3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0a480727a0 con 0x7f0a34004810 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a48156f60 con 0x7f0a340039c0 2024-04-21T22:53:36.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0a34005590 con 0x7f0a480c3410 2024-04-21T22:53:36.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.110+0000 7f0a46ffd640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a34004810 0x7f0a34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:36.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.114+0000 7f0a46ffd640 1 -- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a480c3410 msgr2=0x7f0a3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:36.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.114+0000 7f0a46ffd640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a480c3410 0x7f0a3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:36.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.114+0000 7f0a46ffd640 1 -- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a340039c0 msgr2=0x7f0a34003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:36.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.114+0000 7f0a46ffd640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a340039c0 0x7f0a34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:36.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.114+0000 7f0a46ffd640 1 -- 172.21.15.110:0/6696344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a34003530 con 0x7f0a34004810 2024-04-21T22:53:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.118+0000 7f0a46ffd640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a34004810 0x7f0a34004c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009890 tx=0x7f0a3001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8465c059d6d9b9b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:36.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a300b0070 con 0x7f0a34004810 2024-04-21T22:53:36.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a300ab620 con 0x7f0a34004810 2024-04-21T22:53:36.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a467fc640 1 -- 172.21.15.110:0/6696344 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30009460 con 0x7f0a34004810 2024-04-21T22:53:36.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a4dd46640 1 -- 172.21.15.110:0/6696344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a34004810 msgr2=0x7f0a34004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:36.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a4dd46640 1 --2- 172.21.15.110:0/6696344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a34004810 0x7f0a34004c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009890 tx=0x7f0a3001c3c0 comp rx=0 tx=0).stop 2024-04-21T22:53:36.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a47fff640 1 -- 172.21.15.110:0/6696344 reap_dead start 2024-04-21T22:53:36.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a4dd46640 1 -- 172.21.15.110:0/6696344 shutdown_connections 2024-04-21T22:53:36.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a4dd46640 1 -- 172.21.15.110:0/6696344 >> 172.21.15.110:0/6696344 conn(0x7f0a4806e5c0 msgr2=0x7f0a4806e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:36.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a4dd46640 1 -- 172.21.15.110:0/6696344 shutdown_connections 2024-04-21T22:53:36.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.122+0000 7f0a4dd46640 1 -- 172.21.15.110:0/6696344 wait complete. 2024-04-21T22:53:36.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 Processor -- start 2024-04-21T22:53:36.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 -- start start 2024-04-21T22:53:36.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a34004810 0x7f0a48158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a481594c0 0x7f0a4806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a48151ca0 0x7f0a48152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0a480ccb50 con 0x7f0a481594c0 2024-04-21T22:53:36.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a48072cd0 con 0x7f0a48151ca0 2024-04-21T22:53:36.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.126+0000 7f0a4dd46640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0a480ca4e0 con 0x7f0a34004810 2024-04-21T22:53:36.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.134+0000 7f0a46ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a481594c0 0x7f0a4806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:36.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.134+0000 7f0a46ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a481594c0 0x7f0a4806c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60086/0 (socket says 172.21.15.110:60086) 2024-04-21T22:53:36.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.134+0000 7f0a46ffd640 1 -- 172.21.15.110:0/1405395198 learned_addr learned my addr 172.21.15.110:0/1405395198 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:36.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.138+0000 7f0a46ffd640 1 -- 172.21.15.110:0/1405395198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a34004810 msgr2=0x7f0a48158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:36.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.138+0000 7f0a46ffd640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a34004810 0x7f0a48158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:36.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.138+0000 7f0a46ffd640 1 -- 172.21.15.110:0/1405395198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a48151ca0 msgr2=0x7f0a48152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:36.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.138+0000 7f0a46ffd640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a48151ca0 0x7f0a48152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:36.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.138+0000 7f0a46ffd640 1 -- 172.21.15.110:0/1405395198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a48152660 con 0x7f0a481594c0 2024-04-21T22:53:36.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.138+0000 7f0a46ffd640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a481594c0 0x7f0a4806c5c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a3001c1f0 tx=0x7f0a34005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.146+0000 7f0a3ffff640 1 -- 172.21.15.110:0/1405395198 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a300b0040 con 0x7f0a481594c0 2024-04-21T22:53:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.146+0000 7f0a3ffff640 1 -- 172.21.15.110:0/1405395198 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a300bd070 con 0x7f0a481594c0 2024-04-21T22:53:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.146+0000 7f0a3ffff640 1 -- 172.21.15.110:0/1405395198 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a300ab9d0 con 0x7f0a481594c0 2024-04-21T22:53:36.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.146+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a48158120 con 0x7f0a481594c0 2024-04-21T22:53:36.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.146+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4813e4c0 con 0x7f0a481594c0 2024-04-21T22:53:36.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.150+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a4804f510 con 0x7f0a481594c0 2024-04-21T22:53:36.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.174+0000 7f0a3ffff640 1 -- 172.21.15.110:0/1405395198 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a300abb70 con 0x7f0a481594c0 2024-04-21T22:53:36.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.174+0000 7f0a3ffff640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0a28067910 0x7f0a28069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:36.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.174+0000 7f0a477fe640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0a28067910 0x7f0a28069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:36.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.174+0000 7f0a477fe640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0a28067910 0x7f0a28069dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a38004880 tx=0x7f0a380014f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:36.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.466+0000 7f0a3ffff640 1 -- 172.21.15.110:0/1405395198 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f0a300ef020 con 0x7f0a481594c0 2024-04-21T22:53:36.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.466+0000 7f0a3ffff640 1 -- 172.21.15.110:0/1405395198 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f0a48152660 con 0x7f0a481594c0 2024-04-21T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:36.646+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0a480730a0 con 0x7f0a481594c0 2024-04-21T22:53:37.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.126+0000 7f0a3ffff640 1 -- 172.21.15.110:0/1405395198 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f0a300160d0 con 0x7f0a481594c0 2024-04-21T22:53:37.129 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2024-04-21T22:53:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0a28067910 msgr2=0x7f0a28069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0a28067910 0x7f0a28069dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a38004880 tx=0x7f0a380014f0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a481594c0 msgr2=0x7f0a4806c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a481594c0 0x7f0a4806c5c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a3001c1f0 tx=0x7f0a34005840 comp rx=0 tx=0).stop 2024-04-21T22:53:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 shutdown_connections 2024-04-21T22:53:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0a28067910 0x7f0a28069dd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a48151ca0 0x7f0a48152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a481594c0 0x7f0a4806c5c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 --2- 172.21.15.110:0/1405395198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a34004810 0x7f0a48158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 >> 172.21.15.110:0/1405395198 conn(0x7f0a4806e5c0 msgr2=0x7f0a48070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 shutdown_connections 2024-04-21T22:53:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.130+0000 7f0a4dd46640 1 -- 172.21.15.110:0/1405395198 wait complete. 2024-04-21T22:53:37.152 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-21T22:53:37.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.294+0000 7f780fd41640 1 Processor -- start 2024-04-21T22:53:37.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.294+0000 7f780fd41640 1 -- start start 2024-04-21T22:53:37.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.294+0000 7f780fd41640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78080c98d0 0x7f78080c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:37.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.294+0000 7f780fd41640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7808154980 0x7f780815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:37.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.294+0000 7f780fd41640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78080c8410 con 0x7f78080c9cb0 2024-04-21T22:53:37.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.294+0000 7f780fd41640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f78080c81e0 con 0x7f7808154980 2024-04-21T22:53:37.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.294+0000 7f780fd41640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f78080c86b0 con 0x7f78080c98d0 2024-04-21T22:53:37.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.310+0000 7f780dadd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78080c98d0 0x7f78080c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:37.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.318+0000 7f780dadd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78080c98d0 0x7f78080c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:39124/0 (socket says 172.21.15.110:39124) 2024-04-21T22:53:37.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.318+0000 7f780dadd640 1 -- 172.21.15.110:0/2427736398 learned_addr learned my addr 172.21.15.110:0/2427736398 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.322+0000 7f780dadd640 1 -- 172.21.15.110:0/2427736398 >> v2:172.21.15.110:3300/0 conn(0x7f7808154980 msgr2=0x7f780815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:37.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.322+0000 7f780dadd640 1 --2- 172.21.15.110:0/2427736398 >> v2:172.21.15.110:3300/0 conn(0x7f7808154980 0x7f780815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.322+0000 7f780dadd640 1 -- 172.21.15.110:0/2427736398 >> v1:172.21.15.154:6789/0 conn(0x7f78080c9cb0 legacy=0x7f7808154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:37.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.322+0000 7f780dadd640 1 -- 172.21.15.110:0/2427736398 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7808072d30 con 0x7f78080c98d0 2024-04-21T22:53:37.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.334+0000 7f780dadd640 1 --2- 172.21.15.110:0/2427736398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c98d0 0x7f78080c1bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78080c7280 tx=0x7f780401ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c74b1b008a8a6c8f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:37.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780cadb640 1 -- 172.21.15.110:0/2427736398 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78040b5070 con 0x7f78080c98d0 2024-04-21T22:53:37.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780cadb640 1 -- 172.21.15.110:0/2427736398 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78040a89d0 con 0x7f78080c98d0 2024-04-21T22:53:37.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780cadb640 1 -- 172.21.15.110:0/2427736398 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78040a8da0 con 0x7f78080c98d0 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- 172.21.15.110:0/2427736398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c98d0 msgr2=0x7f78080c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 --2- 172.21.15.110:0/2427736398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c98d0 0x7f78080c1bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78080c7280 tx=0x7f780401ecd0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- 172.21.15.110:0/2427736398 shutdown_connections 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 --2- 172.21.15.110:0/2427736398 >> v2:172.21.15.110:3300/0 conn(0x7f7808154980 0x7f780815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 --2- 172.21.15.110:0/2427736398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c98d0 0x7f78080c1bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- 172.21.15.110:0/2427736398 >> 172.21.15.110:0/2427736398 conn(0x7f780806ca80 msgr2=0x7f7808070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- 172.21.15.110:0/2427736398 shutdown_connections 2024-04-21T22:53:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- 172.21.15.110:0/2427736398 wait complete. 2024-04-21T22:53:37.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 Processor -- start 2024-04-21T22:53:37.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- start start 2024-04-21T22:53:37.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78080c98d0 0x7f780814f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:37.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c9cb0 0x7f78080c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:37.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7808154980 0x7f7808150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:37.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f780806efe0 con 0x7f78080c98d0 2024-04-21T22:53:37.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7808072ae0 con 0x7f78080c9cb0 2024-04-21T22:53:37.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.358+0000 7f780fd41640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f780806f160 con 0x7f7808154980 2024-04-21T22:53:37.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.366+0000 7f780d2dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c9cb0 0x7f78080c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:37.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.366+0000 7f780d2dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c9cb0 0x7f78080c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:39136/0 (socket says 172.21.15.110:39136) 2024-04-21T22:53:37.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.366+0000 7f780d2dc640 1 -- 172.21.15.110:0/1940768763 learned_addr learned my addr 172.21.15.110:0/1940768763 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:37.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.370+0000 7f780d2dc640 1 -- 172.21.15.110:0/1940768763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7808154980 msgr2=0x7f7808150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:37.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.370+0000 7f780d2dc640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7808154980 0x7f7808150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.370+0000 7f780d2dc640 1 -- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78080c98d0 msgr2=0x7f780814f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:37.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.370+0000 7f780d2dc640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78080c98d0 0x7f780814f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:37.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.370+0000 7f780d2dc640 1 -- 172.21.15.110:0/1940768763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780814fda0 con 0x7f78080c9cb0 2024-04-21T22:53:37.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.378+0000 7f780d2dc640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c9cb0 0x7f78080c4240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c4c0 tx=0x7f77f8001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:37.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.386+0000 7f77fe7fc640 1 -- 172.21.15.110:0/1940768763 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8017070 con 0x7f78080c9cb0 2024-04-21T22:53:37.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.386+0000 7f77fe7fc640 1 -- 172.21.15.110:0/1940768763 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f8003600 con 0x7f78080c9cb0 2024-04-21T22:53:37.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.386+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78080c5870 con 0x7f78080c9cb0 2024-04-21T22:53:37.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.386+0000 7f77fe7fc640 1 -- 172.21.15.110:0/1940768763 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f80039f0 con 0x7f78080c9cb0 2024-04-21T22:53:37.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.386+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78080c5e30 con 0x7f78080c9cb0 2024-04-21T22:53:37.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.386+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78081500b0 con 0x7f78080c9cb0 2024-04-21T22:53:37.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.702+0000 7f77fe7fc640 1 -- 172.21.15.110:0/1940768763 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77f801a070 con 0x7f78080c9cb0 2024-04-21T22:53:37.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.702+0000 7f77fe7fc640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f77ec067910 0x7f77ec069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:37.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.702+0000 7f780dadd640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f77ec067910 0x7f77ec069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:37.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.702+0000 7f780dadd640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f77ec067910 0x7f77ec069dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78040b2000 tx=0x7f7804004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:37.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.714+0000 7f77fe7fc640 1 -- 172.21.15.110:0/1940768763 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f77f80539f0 con 0x7f78080c9cb0 2024-04-21T22:53:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.738+0000 7f77fe7fc640 1 -- 172.21.15.110:0/1940768763 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f77f8021020 con 0x7f78080c9cb0 2024-04-21T22:53:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:37.946+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f780804f510 con 0x7f78080c9cb0 2024-04-21T22:53:38.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.926+0000 7f77fe7fc640 1 -- 172.21.15.110:0/1940768763 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f77f8056050 con 0x7f78080c9cb0 2024-04-21T22:53:38.929 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 2 and data pool 3 2024-04-21T22:53:38.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f77ec067910 msgr2=0x7f77ec069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:38.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f77ec067910 0x7f77ec069dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78040b2000 tx=0x7f7804004740 comp rx=0 tx=0).stop 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c9cb0 msgr2=0x7f78080c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c9cb0 0x7f78080c4240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c4c0 tx=0x7f77f8001e80 comp rx=0 tx=0).stop 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 shutdown_connections 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f77ec067910 0x7f77ec069dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7808154980 0x7f7808150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080c9cb0 0x7f78080c4240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 --2- 172.21.15.110:0/1940768763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78080c98d0 0x7f780814f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 >> 172.21.15.110:0/1940768763 conn(0x7f780806ca80 msgr2=0x7f78080cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 shutdown_connections 2024-04-21T22:53:38.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:38.930+0000 7f780fd41640 1 -- 172.21.15.110:0/1940768763 wait complete. 2024-04-21T22:53:38.954 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.070+0000 7fdc2fa7e640 1 Processor -- start 2024-04-21T22:53:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.070+0000 7fdc2fa7e640 1 -- start start 2024-04-21T22:53:39.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.070+0000 7fdc2fa7e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc281521d0 0x7fdc2815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:39.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.070+0000 7fdc2fa7e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc280728d0 con 0x7fdc2806ef30 2024-04-21T22:53:39.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.074+0000 7fdc2fa7e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc28158c40 con 0x7fdc280c9a80 2024-04-21T22:53:39.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.074+0000 7fdc2fa7e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2815b7d0 con 0x7fdc281521d0 2024-04-21T22:53:39.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.074+0000 7fdc2d81a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc281521d0 0x7fdc2815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:39.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.074+0000 7fdc2d81a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc281521d0 0x7fdc2815bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:58876/0 (socket says 172.21.15.110:58876) 2024-04-21T22:53:39.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.074+0000 7fdc2d81a640 1 -- 172.21.15.110:0/4017611833 learned_addr learned my addr 172.21.15.110:0/4017611833 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.082+0000 7fdc2d81a640 1 -- 172.21.15.110:0/4017611833 >> v1:172.21.15.154:6789/0 conn(0x7fdc280c9a80 legacy=0x7fdc28162a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.082+0000 7fdc2d81a640 1 -- 172.21.15.110:0/4017611833 >> v1:172.21.15.110:6789/0 conn(0x7fdc2806ef30 legacy=0x7fdc280c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.082+0000 7fdc2d81a640 1 -- 172.21.15.110:0/4017611833 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc28158ee0 con 0x7fdc281521d0 2024-04-21T22:53:39.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.086+0000 7fdc2d81a640 1 --2- 172.21.15.110:0/4017611833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc281521d0 0x7fdc2815bc60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009870 tx=0x7fdc2401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb2be2e58fd1298 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:39.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2c818640 1 -- 172.21.15.110:0/4017611833 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc240b5070 con 0x7fdc281521d0 2024-04-21T22:53:39.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2c818640 1 -- 172.21.15.110:0/4017611833 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc240a89b0 con 0x7fdc281521d0 2024-04-21T22:53:39.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2c818640 1 -- 172.21.15.110:0/4017611833 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc240a8d80 con 0x7fdc281521d0 2024-04-21T22:53:39.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/4017611833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc281521d0 msgr2=0x7fdc2815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:39.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/4017611833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc281521d0 0x7fdc2815bc60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009870 tx=0x7fdc2401ecb0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/4017611833 shutdown_connections 2024-04-21T22:53:39.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/4017611833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc281521d0 0x7fdc2815bc60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/4017611833 >> 172.21.15.110:0/4017611833 conn(0x7fdc2806ca80 msgr2=0x7fdc28070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:39.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/4017611833 shutdown_connections 2024-04-21T22:53:39.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.102+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/4017611833 wait complete. 2024-04-21T22:53:39.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 Processor -- start 2024-04-21T22:53:39.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 -- start start 2024-04-21T22:53:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc2806ef30 0x7fdc2815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280c9a80 0x7fdc281469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:39.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc281521d0 0x7fdc281f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:39.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2806e2e0 con 0x7fdc280c9a80 2024-04-21T22:53:39.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281525b0 con 0x7fdc2806ef30 2024-04-21T22:53:39.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.106+0000 7fdc2fa7e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc28072cf0 con 0x7fdc281521d0 2024-04-21T22:53:39.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.110+0000 7fdc2e01b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc281521d0 0x7fdc281f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:39.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.110+0000 7fdc2e01b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc281521d0 0x7fdc281f0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:59344/0 (socket says 172.21.15.110:59344) 2024-04-21T22:53:39.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.110+0000 7fdc2e01b640 1 -- 172.21.15.110:0/990589458 learned_addr learned my addr 172.21.15.110:0/990589458 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:39.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.110+0000 7fdc2d81a640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc2806ef30 0x7fdc2815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:39.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.118+0000 7fdc2e01b640 1 -- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc2806ef30 msgr2=0x7fdc2815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:39.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.118+0000 7fdc2e01b640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc2806ef30 0x7fdc2815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.118+0000 7fdc2e01b640 1 -- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280c9a80 msgr2=0x7fdc281469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:39.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.118+0000 7fdc2e01b640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280c9a80 0x7fdc281469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.118+0000 7fdc2e01b640 1 -- 172.21.15.110:0/990589458 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc280c3870 con 0x7fdc281521d0 2024-04-21T22:53:39.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.214+0000 7fdc2e01b640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc281521d0 0x7fdc281f0400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c780 tx=0x7fdc2000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:39.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.226+0000 7fdc1e7fc640 1 -- 172.21.15.110:0/990589458 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20017070 con 0x7fdc281521d0 2024-04-21T22:53:39.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.226+0000 7fdc1e7fc640 1 -- 172.21.15.110:0/990589458 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc20003db0 con 0x7fdc281521d0 2024-04-21T22:53:39.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.226+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc281f39d0 con 0x7fdc281521d0 2024-04-21T22:53:39.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.226+0000 7fdc1e7fc640 1 -- 172.21.15.110:0/990589458 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc200052b0 con 0x7fdc281521d0 2024-04-21T22:53:39.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.226+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc280cc890 con 0x7fdc281521d0 2024-04-21T22:53:39.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.226+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2804f510 con 0x7fdc281521d0 2024-04-21T22:53:39.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.542+0000 7fdc1e7fc640 1 -- 172.21.15.110:0/990589458 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc2001a070 con 0x7fdc281521d0 2024-04-21T22:53:39.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.546+0000 7fdc1e7fc640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdc0c067910 0x7fdc0c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:39.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.546+0000 7fdc2d81a640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdc0c067910 0x7fdc0c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:39.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.546+0000 7fdc2d81a640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdc0c067910 0x7fdc0c069dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc240b2000 tx=0x7fdc240aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:39.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.550+0000 7fdc1e7fc640 1 -- 172.21.15.110:0/990589458 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdc20053c30 con 0x7fdc281521d0 2024-04-21T22:53:39.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.578+0000 7fdc1e7fc640 1 -- 172.21.15.110:0/990589458 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fdc20021020 con 0x7fdc281521d0 2024-04-21T22:53:39.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.778+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc28072ad0 con 0x7fdc281521d0 2024-04-21T22:53:39.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.874+0000 7fdc1e7fc640 1 -- 172.21.15.110:0/990589458 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7fdc281f39d0 con 0x7fdc281521d0 2024-04-21T22:53:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:39.878 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:39.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdc0c067910 msgr2=0x7fdc0c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdc0c067910 0x7fdc0c069dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc240b2000 tx=0x7fdc240aa070 comp rx=0 tx=0).stop 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc281521d0 msgr2=0x7fdc281f0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc281521d0 0x7fdc281f0400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c780 tx=0x7fdc2000cc40 comp rx=0 tx=0).stop 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 shutdown_connections 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdc0c067910 0x7fdc0c069dd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc281521d0 0x7fdc281f0400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280c9a80 0x7fdc281469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 --2- 172.21.15.110:0/990589458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc2806ef30 0x7fdc2815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 >> 172.21.15.110:0/990589458 conn(0x7fdc2806ca80 msgr2=0x7fdc28156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 shutdown_connections 2024-04-21T22:53:39.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:39.878+0000 7fdc2fa7e640 1 -- 172.21.15.110:0/990589458 wait complete. 2024-04-21T22:53:39.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:40.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.030+0000 7fc4705d7640 1 Processor -- start 2024-04-21T22:53:40.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.030+0000 7fc4705d7640 1 -- start start 2024-04-21T22:53:40.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.030+0000 7fc4705d7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4681521d0 0x7fc46806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.030+0000 7fc4705d7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4680727a0 0x7fc46815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.030+0000 7fc4705d7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc468158b90 con 0x7fc4680ca2a0 2024-04-21T22:53:40.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.030+0000 7fc4705d7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc4681525b0 con 0x7fc4680727a0 2024-04-21T22:53:40.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.030+0000 7fc4705d7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc46806ba10 con 0x7fc4681521d0 2024-04-21T22:53:40.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.034+0000 7fc46eb74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4680727a0 0x7fc46815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.034+0000 7fc46db72640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc4680ca2a0 0x7fc4680704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49464/0 (socket says 172.21.15.110:49464) 2024-04-21T22:53:40.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.034+0000 7fc46db72640 1 -- 172.21.15.110:0/4019225832 learned_addr learned my addr 172.21.15.110:0/4019225832 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:40.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.034+0000 7fc46e373640 1 --2- 172.21.15.110:0/4019225832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4681521d0 0x7fc46806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.042+0000 7fc46eb74640 1 -- 172.21.15.110:0/4019225832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4681521d0 msgr2=0x7fc46806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:40.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.042+0000 7fc46eb74640 1 --2- 172.21.15.110:0/4019225832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4681521d0 0x7fc46806b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.042+0000 7fc46eb74640 1 -- 172.21.15.110:0/4019225832 >> v1:172.21.15.110:6789/0 conn(0x7fc4680ca2a0 legacy=0x7fc4680704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.042+0000 7fc46eb74640 1 -- 172.21.15.110:0/4019225832 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc468158e70 con 0x7fc4680727a0 2024-04-21T22:53:40.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.046+0000 7fc46eb74640 1 --2- 172.21.15.110:0/4019225832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4680727a0 0x7fc46815bab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc458009d90 tx=0x7fc45801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df484aa08925ba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:40.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc46d371640 1 -- 172.21.15.110:0/4019225832 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580b2070 con 0x7fc4680727a0 2024-04-21T22:53:40.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc46d371640 1 -- 172.21.15.110:0/4019225832 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4580a5920 con 0x7fc4680727a0 2024-04-21T22:53:40.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc46d371640 1 -- 172.21.15.110:0/4019225832 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580a5cf0 con 0x7fc4680727a0 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 -- 172.21.15.110:0/4019225832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4680727a0 msgr2=0x7fc46815bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 --2- 172.21.15.110:0/4019225832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4680727a0 0x7fc46815bab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc458009d90 tx=0x7fc45801c970 comp rx=0 tx=0).stop 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 -- 172.21.15.110:0/4019225832 shutdown_connections 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 --2- 172.21.15.110:0/4019225832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4680727a0 0x7fc46815bab0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 --2- 172.21.15.110:0/4019225832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4681521d0 0x7fc46806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 -- 172.21.15.110:0/4019225832 >> 172.21.15.110:0/4019225832 conn(0x7fc46806e590 msgr2=0x7fc46806e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 -- 172.21.15.110:0/4019225832 shutdown_connections 2024-04-21T22:53:40.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.050+0000 7fc4705d7640 1 -- 172.21.15.110:0/4019225832 wait complete. 2024-04-21T22:53:40.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 Processor -- start 2024-04-21T22:53:40.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 -- start start 2024-04-21T22:53:40.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4680727a0 0x7fc468148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4680ca2a0 0x7fc468159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4681521d0 0x7fc468146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc468070d70 con 0x7fc4681521d0 2024-04-21T22:53:40.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc468070bf0 con 0x7fc4680ca2a0 2024-04-21T22:53:40.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc4705d7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc468165210 con 0x7fc4680727a0 2024-04-21T22:53:40.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc46eb74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4681521d0 0x7fc468146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc46eb74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4681521d0 0x7fc468146670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35512/0 (socket says 172.21.15.110:35512) 2024-04-21T22:53:40.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc46eb74640 1 -- 172.21.15.110:0/3737779472 learned_addr learned my addr 172.21.15.110:0/3737779472 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:40.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.054+0000 7fc46e373640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4680727a0 0x7fc468148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.058+0000 7fc46eb74640 1 -- 172.21.15.110:0/3737779472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4680727a0 msgr2=0x7fc468148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.058+0000 7fc46eb74640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4680727a0 0x7fc468148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.058+0000 7fc46eb74640 1 -- 172.21.15.110:0/3737779472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4680ca2a0 msgr2=0x7fc468159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.058+0000 7fc46eb74640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4680ca2a0 0x7fc468159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.058+0000 7fc46eb74640 1 -- 172.21.15.110:0/3737779472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4680c38d0 con 0x7fc4681521d0 2024-04-21T22:53:40.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.062+0000 7fc46eb74640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4681521d0 0x7fc468146670 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc458009d90 tx=0x7fc458019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:40.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.134+0000 7fc466ffd640 1 -- 172.21.15.110:0/3737779472 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580b2040 con 0x7fc4681521d0 2024-04-21T22:53:40.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.134+0000 7fc466ffd640 1 -- 172.21.15.110:0/3737779472 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4580bd070 con 0x7fc4681521d0 2024-04-21T22:53:40.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.134+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46815b210 con 0x7fc4681521d0 2024-04-21T22:53:40.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.134+0000 7fc466ffd640 1 -- 172.21.15.110:0/3737779472 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580ad860 con 0x7fc4681521d0 2024-04-21T22:53:40.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.134+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc468147b50 con 0x7fc4681521d0 2024-04-21T22:53:40.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.134+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc46804f510 con 0x7fc4681521d0 2024-04-21T22:53:40.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.154+0000 7fc466ffd640 1 -- 172.21.15.110:0/3737779472 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4580ada00 con 0x7fc4681521d0 2024-04-21T22:53:40.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.158+0000 7fc466ffd640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc454067910 0x7fc454069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.158+0000 7fc46e373640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc454067910 0x7fc454069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.158+0000 7fc46e373640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc454067910 0x7fc454069dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc460006fd0 tx=0x7fc460008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:40.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.162+0000 7fc466ffd640 1 -- 172.21.15.110:0/3737779472 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc458002020 con 0x7fc4681521d0 2024-04-21T22:53:40.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.486+0000 7fc466ffd640 1 -- 172.21.15.110:0/3737779472 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fc4580c7020 con 0x7fc4681521d0 2024-04-21T22:53:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.670+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc46806b7f0 con 0x7fc4681521d0 2024-04-21T22:53:40.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.774+0000 7fc466ffd640 1 -- 172.21.15.110:0/3737779472 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7fc45811e110 con 0x7fc4681521d0 2024-04-21T22:53:40.774 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:40.774 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:40.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc454067910 msgr2=0x7fc454069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc454067910 0x7fc454069dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc460006fd0 tx=0x7fc460008040 comp rx=0 tx=0).stop 2024-04-21T22:53:40.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4681521d0 msgr2=0x7fc468146670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4681521d0 0x7fc468146670 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc458009d90 tx=0x7fc458019710 comp rx=0 tx=0).stop 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 shutdown_connections 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc454067910 0x7fc454069dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4681521d0 0x7fc468146670 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4680ca2a0 0x7fc468159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 --2- 172.21.15.110:0/3737779472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4680727a0 0x7fc468148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 >> 172.21.15.110:0/3737779472 conn(0x7fc46806e590 msgr2=0x7fc4680c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 shutdown_connections 2024-04-21T22:53:40.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.778+0000 7fc4705d7640 1 -- 172.21.15.110:0/3737779472 wait complete. 2024-04-21T22:53:40.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-21T22:53:40.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02bae44640 1 Processor -- start 2024-04-21T22:53:40.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02bae44640 1 -- start start 2024-04-21T22:53:40.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02bae44640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02bae44640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b40cb490 con 0x7f02b406cf90 2024-04-21T22:53:40.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02bae44640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b415dd30 con 0x7f02b4143920 2024-04-21T22:53:40.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02bae44640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f02b415e8b0 con 0x7f02b415aa30 2024-04-21T22:53:40.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02b8be0640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f02b4143920 0x7f02b40cad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:58044/0 (socket says 172.21.15.110:58044) 2024-04-21T22:53:40.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02b8be0640 1 -- 172.21.15.110:0/3940173644 learned_addr learned my addr 172.21.15.110:0/3940173644 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:40.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.926+0000 7f02b93e1640 1 --2- 172.21.15.110:0/3940173644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.930+0000 7f02b37fe640 1 -- 172.21.15.110:0/3940173644 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492562579 0 0) 0x7f02b40cb490 con 0x7f02b406cf90 2024-04-21T22:53:40.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.930+0000 7f02b37fe640 1 -- 172.21.15.110:0/3940173644 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a4003530 con 0x7f02b406cf90 2024-04-21T22:53:40.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.934+0000 7f02b93e1640 1 -- 172.21.15.110:0/3940173644 >> v1:172.21.15.154:6789/0 conn(0x7f02b4143920 legacy=0x7f02b40cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.934+0000 7f02b93e1640 1 -- 172.21.15.110:0/3940173644 >> v1:172.21.15.110:6789/0 conn(0x7f02b406cf90 legacy=0x7f02b406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.934+0000 7f02b93e1640 1 -- 172.21.15.110:0/3940173644 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b415e010 con 0x7f02b415aa30 2024-04-21T22:53:40.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.950+0000 7f02b93e1640 1 --2- 172.21.15.110:0/3940173644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415ae40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009dc0 tx=0x7f02ac01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eea4e6df5deafd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:40.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.958+0000 7f02b37fe640 1 -- 172.21.15.110:0/3940173644 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0b4070 con 0x7f02b415aa30 2024-04-21T22:53:40.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.958+0000 7f02b37fe640 1 -- 172.21.15.110:0/3940173644 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac0af600 con 0x7f02b415aa30 2024-04-21T22:53:40.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.958+0000 7f02b37fe640 1 -- 172.21.15.110:0/3940173644 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0af9d0 con 0x7f02b415aa30 2024-04-21T22:53:40.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- 172.21.15.110:0/3940173644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 msgr2=0x7f02b415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 --2- 172.21.15.110:0/3940173644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415ae40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009dc0 tx=0x7f02ac01f170 comp rx=0 tx=0).stop 2024-04-21T22:53:40.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- 172.21.15.110:0/3940173644 shutdown_connections 2024-04-21T22:53:40.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 --2- 172.21.15.110:0/3940173644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415ae40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- 172.21.15.110:0/3940173644 >> 172.21.15.110:0/3940173644 conn(0x7f02b4070b30 msgr2=0x7f02b4061c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:40.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- 172.21.15.110:0/3940173644 shutdown_connections 2024-04-21T22:53:40.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- 172.21.15.110:0/3940173644 wait complete. 2024-04-21T22:53:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 Processor -- start 2024-04-21T22:53:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- start start 2024-04-21T22:53:40.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b406cf90 0x7f02b40b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b4143920 0x7f02b41f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:40.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f02b415a510 con 0x7f02b4143920 2024-04-21T22:53:40.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02b415e5d0 con 0x7f02b406cf90 2024-04-21T22:53:40.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.962+0000 7f02bae44640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f02b415d960 con 0x7f02b415aa30 2024-04-21T22:53:40.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.966+0000 7f02b3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b4143920 0x7f02b41f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.966+0000 7f02b3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b4143920 0x7f02b41f4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35514/0 (socket says 172.21.15.110:35514) 2024-04-21T22:53:40.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.966+0000 7f02b3fff640 1 -- 172.21.15.110:0/3675921388 learned_addr learned my addr 172.21.15.110:0/3675921388 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:40.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.966+0000 7f02b8be0640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b406cf90 0x7f02b40b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.982+0000 7f02b93e1640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:40.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.998+0000 7f02b8be0640 1 -- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 msgr2=0x7f02b415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.998+0000 7f02b8be0640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.998+0000 7f02b8be0640 1 -- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b4143920 msgr2=0x7f02b41f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:40.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.998+0000 7f02b8be0640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b4143920 0x7f02b41f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:40.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:40.998+0000 7f02b8be0640 1 -- 172.21.15.110:0/3675921388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b41f08c0 con 0x7f02b406cf90 2024-04-21T22:53:41.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.006+0000 7f02b8be0640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b406cf90 0x7f02b40b2610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c430 tx=0x7f02a800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:41.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.102+0000 7f02b17fa640 1 -- 172.21.15.110:0/3675921388 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8017070 con 0x7f02b406cf90 2024-04-21T22:53:41.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.102+0000 7f02b17fa640 1 -- 172.21.15.110:0/3675921388 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a8005cf0 con 0x7f02b406cf90 2024-04-21T22:53:41.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.102+0000 7f02b17fa640 1 -- 172.21.15.110:0/3675921388 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a80072d0 con 0x7f02b406cf90 2024-04-21T22:53:41.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.102+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b41f0b60 con 0x7f02b406cf90 2024-04-21T22:53:41.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.102+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b41f1100 con 0x7f02b406cf90 2024-04-21T22:53:41.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.102+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b404f510 con 0x7f02b406cf90 2024-04-21T22:53:41.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.442+0000 7f02b17fa640 1 -- 172.21.15.110:0/3675921388 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02a801a070 con 0x7f02b406cf90 2024-04-21T22:53:41.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.442+0000 7f02b17fa640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0298067940 0x7f0298069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:41.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.442+0000 7f02b3fff640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0298067940 0x7f0298069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:41.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.442+0000 7f02b3fff640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0298067940 0x7f0298069e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f02a0007fd0 tx=0x7f02a0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:41.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.450+0000 7f02b17fa640 1 -- 172.21.15.110:0/3675921388 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f02a8053950 con 0x7f02b406cf90 2024-04-21T22:53:41.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.486+0000 7f02b17fa640 1 -- 172.21.15.110:0/3675921388 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f02a80558b0 con 0x7f02b406cf90 2024-04-21T22:53:41.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:41.698+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f02b40b12d0 con 0x7f02b406cf90 2024-04-21T22:53:42.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.934+0000 7f02b17fa640 1 -- 172.21.15.110:0/3675921388 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f02a8059bb0 con 0x7f02b406cf90 2024-04-21T22:53:42.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0298067940 msgr2=0x7f0298069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:42.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0298067940 0x7f0298069e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f02a0007fd0 tx=0x7f02a0009040 comp rx=0 tx=0).stop 2024-04-21T22:53:42.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b406cf90 msgr2=0x7f02b40b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:42.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b406cf90 0x7f02b40b2610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c430 tx=0x7f02a800c8f0 comp rx=0 tx=0).stop 2024-04-21T22:53:42.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 shutdown_connections 2024-04-21T22:53:42.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0298067940 0x7f0298069e00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:42.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b415aa30 0x7f02b415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:42.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b4143920 0x7f02b41f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:42.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 --2- 172.21.15.110:0/3675921388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b406cf90 0x7f02b40b2610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:42.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 >> 172.21.15.110:0/3675921388 conn(0x7f02b4070b30 msgr2=0x7f02b40ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:42.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 shutdown_connections 2024-04-21T22:53:42.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:42.938+0000 7f02bae44640 1 -- 172.21.15.110:0/3675921388 wait complete. 2024-04-21T22:53:42.957 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-21T22:53:42.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-21T22:53:43.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.082+0000 7f511ecbc640 1 Processor -- start 2024-04-21T22:53:43.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.082+0000 7f511ecbc640 1 -- start start 2024-04-21T22:53:43.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.082+0000 7f511ecbc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f511806cac0 0x7f51180ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.082+0000 7f511ecbc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51180cae90 con 0x7f51180ca9e0 2024-04-21T22:53:43.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.082+0000 7f511ecbc640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51180cb150 con 0x7f51180cb540 2024-04-21T22:53:43.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.082+0000 7f511ecbc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f511815af30 con 0x7f511806cac0 2024-04-21T22:53:43.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.086+0000 7f511d259640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f51180ca9e0 0x7f51180cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49480/0 (socket says 172.21.15.110:49480) 2024-04-21T22:53:43.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.086+0000 7f511d259640 1 -- 172.21.15.110:0/205667246 learned_addr learned my addr 172.21.15.110:0/205667246 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:43.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.086+0000 7f511ca58640 1 --2- 172.21.15.110:0/205667246 >> v2:172.21.15.154:3300/0 conn(0x7f511806cac0 0x7f51180ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:43.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.086+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028643472 0 0) 0x7f51180cae90 con 0x7f51180ca9e0 2024-04-21T22:53:43.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.086+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5100003530 con 0x7f51180ca9e0 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 943671930 0 0) 0x7f5100003530 con 0x7f51180ca9e0 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 >> v2:172.21.15.154:3300/0 conn(0x7f511806cac0 msgr2=0x7f51180ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 --2- 172.21.15.110:0/205667246 >> v2:172.21.15.154:3300/0 conn(0x7f511806cac0 0x7f51180ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 >> v1:172.21.15.154:6789/0 conn(0x7f51180cb540 legacy=0x7f51180ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511815a600 con 0x7f51180ca9e0 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f5110001a00 con 0x7f51180ca9e0 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 >> v1:172.21.15.110:6789/0 conn(0x7f51180ca9e0 legacy=0x7f51180cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5100003a10 0x7f5100003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100004810 0x7f5100004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51000051d0 0x7f510000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f511815af30 con 0x7f5100003a10 2024-04-21T22:53:43.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f510000c080 con 0x7f5100004810 2024-04-21T22:53:43.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.090+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f510000c280 con 0x7f51000051d0 2024-04-21T22:53:43.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.094+0000 7f511d259640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51000051d0 0x7f510000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:43.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.094+0000 7f511ca58640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5100003a10 0x7f5100003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:43.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.098+0000 7f511ca58640 1 -- 172.21.15.110:0/205667246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51000051d0 msgr2=0x7f510000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:43.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.098+0000 7f511ca58640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51000051d0 0x7f510000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:43.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.098+0000 7f511ca58640 1 -- 172.21.15.110:0/205667246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100004810 msgr2=0x7f5100004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:43.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.098+0000 7f511ca58640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100004810 0x7f5100004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:43.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.098+0000 7f511ca58640 1 -- 172.21.15.110:0/205667246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5100003530 con 0x7f5100003a10 2024-04-21T22:53:43.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.098+0000 7f511d259640 1 -- 172.21.15.110:0/205667246 reap_dead start 2024-04-21T22:53:43.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.102+0000 7f511ca58640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5100003a10 0x7f5100003e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5108009ae0 tx=0x7f510801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d3bb1149ee5c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:43.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080b2070 con 0x7f5100003a10 2024-04-21T22:53:43.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51080a5550 con 0x7f5100003a10 2024-04-21T22:53:43.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f51177fe640 1 -- 172.21.15.110:0/205667246 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080096b0 con 0x7f5100003a10 2024-04-21T22:53:43.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f511ecbc640 1 -- 172.21.15.110:0/205667246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5100003a10 msgr2=0x7f5100003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:43.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f511ecbc640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5100003a10 0x7f5100003e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5108009ae0 tx=0x7f510801ca70 comp rx=0 tx=0).stop 2024-04-21T22:53:43.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f511ecbc640 1 -- 172.21.15.110:0/205667246 shutdown_connections 2024-04-21T22:53:43.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f511ecbc640 1 --2- 172.21.15.110:0/205667246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5100003a10 0x7f5100003e10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:43.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f511ecbc640 1 -- 172.21.15.110:0/205667246 >> 172.21.15.110:0/205667246 conn(0x7f51180b16b0 msgr2=0x7f51180b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:43.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f511ecbc640 1 -- 172.21.15.110:0/205667246 shutdown_connections 2024-04-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.106+0000 7f511ecbc640 1 -- 172.21.15.110:0/205667246 wait complete. 2024-04-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 Processor -- start 2024-04-21T22:53:43.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 -- start start 2024-04-21T22:53:43.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100003a10 0x7f511814b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51181521f0 0x7f5118154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f511814fe10 0x7f5118154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f511815a2b0 con 0x7f51181521f0 2024-04-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f511815abc0 con 0x7f5100003a10 2024-04-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ecbc640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f51180ca4a0 con 0x7f511814fe10 2024-04-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f5117fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51181521f0 0x7f5118154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:43.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f5117fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51181521f0 0x7f5118154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35522/0 (socket says 172.21.15.110:35522) 2024-04-21T22:53:43.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f5117fff640 1 -- 172.21.15.110:0/2362920605 learned_addr learned my addr 172.21.15.110:0/2362920605 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:43.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511d259640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f511814fe10 0x7f5118154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:43.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.110+0000 7f511ca58640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100003a10 0x7f511814b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:43.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.114+0000 7f5117fff640 1 -- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f511814fe10 msgr2=0x7f5118154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:43.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.114+0000 7f5117fff640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f511814fe10 0x7f5118154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.114+0000 7f5117fff640 1 -- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100003a10 msgr2=0x7f511814b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.114+0000 7f5117fff640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100003a10 0x7f511814b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:43.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.114+0000 7f5117fff640 1 -- 172.21.15.110:0/2362920605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51181559c0 con 0x7f51181521f0 2024-04-21T22:53:43.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.118+0000 7f5117fff640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51181521f0 0x7f5118154a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c3c0 tx=0x7f510c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:43.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.122+0000 7f51157fa640 1 -- 172.21.15.110:0/2362920605 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c017070 con 0x7f51181521f0 2024-04-21T22:53:43.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.122+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51181effd0 con 0x7f51181521f0 2024-04-21T22:53:43.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.122+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51181f0590 con 0x7f51181521f0 2024-04-21T22:53:43.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.122+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511804f510 con 0x7f51181521f0 2024-04-21T22:53:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.334+0000 7f51157fa640 1 -- 172.21.15.110:0/2362920605 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c007030 con 0x7f51181521f0 2024-04-21T22:53:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.334+0000 7f51157fa640 1 -- 172.21.15.110:0/2362920605 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c021060 con 0x7f51181521f0 2024-04-21T22:53:43.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.382+0000 7f51157fa640 1 -- 172.21.15.110:0/2362920605 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f510c01a070 con 0x7f51181521f0 2024-04-21T22:53:43.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.382+0000 7f51157fa640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f51040678c0 0x7f5104069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:43.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.382+0000 7f511ca58640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f51040678c0 0x7f5104069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:43.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.386+0000 7f511ca58640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f51040678c0 0x7f5104069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51080af000 tx=0x7f51080046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:43.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.414+0000 7f51157fa640 1 -- 172.21.15.110:0/2362920605 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f510c053a80 con 0x7f51181521f0 2024-04-21T22:53:43.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.414+0000 7f51157fa640 1 -- 172.21.15.110:0/2362920605 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f510c007480 con 0x7f51181521f0 2024-04-21T22:53:43.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:43.634+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f51180c6e20 con 0x7f51181521f0 2024-04-21T22:53:44.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f51157fa640 1 -- 172.21.15.110:0/2362920605 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f510c0559e0 con 0x7f51181521f0 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f51040678c0 msgr2=0x7f5104069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f51040678c0 0x7f5104069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51080af000 tx=0x7f51080046d0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51181521f0 msgr2=0x7f5118154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51181521f0 0x7f5118154a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c3c0 tx=0x7f510c00c7c0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 shutdown_connections 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f51040678c0 0x7f5104069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f511814fe10 0x7f5118154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51181521f0 0x7f5118154a30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 --2- 172.21.15.110:0/2362920605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5100003a10 0x7f511814b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 >> 172.21.15.110:0/2362920605 conn(0x7f51180b16b0 msgr2=0x7f5118157340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:44.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.006+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 shutdown_connections 2024-04-21T22:53:44.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.010+0000 7f511ecbc640 1 -- 172.21.15.110:0/2362920605 wait complete. 2024-04-21T22:53:44.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-21T22:53:44.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e9467640 1 Processor -- start 2024-04-21T22:53:44.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e9467640 1 -- start start 2024-04-21T22:53:44.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e9467640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85e40c98d0 0x7f85e40c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:44.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e9467640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e4154980 0x7f85e415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:44.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e9467640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e40c8410 con 0x7f85e40c9cb0 2024-04-21T22:53:44.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e9467640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f85e40c81e0 con 0x7f85e40c98d0 2024-04-21T22:53:44.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e9467640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f85e40c86b0 con 0x7f85e4154980 2024-04-21T22:53:44.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e27fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f85e40c9cb0 0x7f85e4154270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49482/0 (socket says 172.21.15.110:49482) 2024-04-21T22:53:44.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e27fc640 1 -- 172.21.15.110:0/3614192868 learned_addr learned my addr 172.21.15.110:0/3614192868 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:44.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e37fe640 1 --2- 172.21.15.110:0/3614192868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e4154980 0x7f85e415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:44.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.158+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/3614192868 >> v2:172.21.15.154:3300/0 conn(0x7f85e40c98d0 0x7f85e40c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:44.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.162+0000 7f85e1ffb640 1 -- 172.21.15.110:0/3614192868 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350536521 0 0) 0x7f85e40c8410 con 0x7f85e40c9cb0 2024-04-21T22:53:44.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.162+0000 7f85e1ffb640 1 -- 172.21.15.110:0/3614192868 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85cc003530 con 0x7f85e40c9cb0 2024-04-21T22:53:44.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.162+0000 7f85e37fe640 1 -- 172.21.15.110:0/3614192868 >> v2:172.21.15.154:3300/0 conn(0x7f85e40c98d0 msgr2=0x7f85e40c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:44.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.162+0000 7f85e37fe640 1 --2- 172.21.15.110:0/3614192868 >> v2:172.21.15.154:3300/0 conn(0x7f85e40c98d0 0x7f85e40c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.162+0000 7f85e37fe640 1 -- 172.21.15.110:0/3614192868 >> v1:172.21.15.110:6789/0 conn(0x7f85e40c9cb0 legacy=0x7f85e4154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:44.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.162+0000 7f85e37fe640 1 -- 172.21.15.110:0/3614192868 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e4072d30 con 0x7f85e4154980 2024-04-21T22:53:44.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.166+0000 7f85e37fe640 1 --2- 172.21.15.110:0/3614192868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e4154980 0x7f85e415a8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866682524e53f71b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:44.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.178+0000 7f85e1ffb640 1 -- 172.21.15.110:0/3614192868 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b4070 con 0x7f85e4154980 2024-04-21T22:53:44.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.178+0000 7f85e1ffb640 1 -- 172.21.15.110:0/3614192868 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc0af600 con 0x7f85e4154980 2024-04-21T22:53:44.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.178+0000 7f85e1ffb640 1 -- 172.21.15.110:0/3614192868 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0af9d0 con 0x7f85e4154980 2024-04-21T22:53:44.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- 172.21.15.110:0/3614192868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e4154980 msgr2=0x7f85e415a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:44.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 --2- 172.21.15.110:0/3614192868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e4154980 0x7f85e415a8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc01f150 comp rx=0 tx=0).stop 2024-04-21T22:53:44.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- 172.21.15.110:0/3614192868 shutdown_connections 2024-04-21T22:53:44.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 --2- 172.21.15.110:0/3614192868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e4154980 0x7f85e415a8a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 --2- 172.21.15.110:0/3614192868 >> v2:172.21.15.154:3300/0 conn(0x7f85e40c98d0 0x7f85e40c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- 172.21.15.110:0/3614192868 >> 172.21.15.110:0/3614192868 conn(0x7f85e406ca80 msgr2=0x7f85e4070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- 172.21.15.110:0/3614192868 shutdown_connections 2024-04-21T22:53:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- 172.21.15.110:0/3614192868 wait complete. 2024-04-21T22:53:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 Processor -- start 2024-04-21T22:53:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- start start 2024-04-21T22:53:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e40c98d0 0x7f85e415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e40c9cb0 0x7f85e41f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e4154980 0x7f85e41f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f85e406efe0 con 0x7f85e4154980 2024-04-21T22:53:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85e4072ae0 con 0x7f85e40c98d0 2024-04-21T22:53:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e9467640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f85e406f160 con 0x7f85e40c9cb0 2024-04-21T22:53:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e4154980 0x7f85e41f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e4154980 0x7f85e41f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35530/0 (socket says 172.21.15.110:35530) 2024-04-21T22:53:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.182+0000 7f85e37fe640 1 -- 172.21.15.110:0/929575515 learned_addr learned my addr 172.21.15.110:0/929575515 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.186+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e40c98d0 0x7f85e415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.186+0000 7f85e37fe640 1 -- 172.21.15.110:0/929575515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e40c9cb0 msgr2=0x7f85e41f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.186+0000 7f85e37fe640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e40c9cb0 0x7f85e41f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.186+0000 7f85e37fe640 1 -- 172.21.15.110:0/929575515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e40c98d0 msgr2=0x7f85e415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:44.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.186+0000 7f85e37fe640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e40c98d0 0x7f85e415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:44.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.186+0000 7f85e37fe640 1 -- 172.21.15.110:0/929575515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e40c6fa0 con 0x7f85e4154980 2024-04-21T22:53:44.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.190+0000 7f85e37fe640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e4154980 0x7f85e41f3f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:44.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.194+0000 7f85cb7fe640 1 -- 172.21.15.110:0/929575515 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b4040 con 0x7f85e4154980 2024-04-21T22:53:44.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.194+0000 7f85cb7fe640 1 -- 172.21.15.110:0/929575515 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc0c1070 con 0x7f85e4154980 2024-04-21T22:53:44.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.194+0000 7f85cb7fe640 1 -- 172.21.15.110:0/929575515 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc009450 con 0x7f85e4154980 2024-04-21T22:53:44.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.194+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e40ccf00 con 0x7f85e4154980 2024-04-21T22:53:44.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.194+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e414fa70 con 0x7f85e4154980 2024-04-21T22:53:44.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.194+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e404f510 con 0x7f85e4154980 2024-04-21T22:53:44.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.214+0000 7f85cb7fe640 1 -- 172.21.15.110:0/929575515 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85dc0ba6b0 con 0x7f85e4154980 2024-04-21T22:53:44.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.214+0000 7f85cb7fe640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067910 0x7f85d0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.214+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067910 0x7f85d0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.214+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067910 0x7f85d0069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009ac0 tx=0x7f85d8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.490+0000 7f85cb7fe640 1 -- 172.21.15.110:0/929575515 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f85dc0f3440 con 0x7f85e4154980 2024-04-21T22:53:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.490+0000 7f85cb7fe640 1 -- 172.21.15.110:0/929575515 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f85dc018cb0 con 0x7f85e4154980 2024-04-21T22:53:44.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:44.702+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f85e4073400 con 0x7f85e4154980 2024-04-21T22:53:45.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.270+0000 7f85cb7fe640 1 -- 172.21.15.110:0/929575515 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f85dc0f5aa0 con 0x7f85e4154980 2024-04-21T22:53:45.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067910 msgr2=0x7f85d0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:45.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067910 0x7f85d0069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009ac0 tx=0x7f85d8009190 comp rx=0 tx=0).stop 2024-04-21T22:53:45.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e4154980 msgr2=0x7f85e41f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:45.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e4154980 0x7f85e41f3f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc01bef0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 shutdown_connections 2024-04-21T22:53:45.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067910 0x7f85d0069dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e4154980 0x7f85e41f3f60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e40c9cb0 0x7f85e41f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 --2- 172.21.15.110:0/929575515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e40c98d0 0x7f85e415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 >> 172.21.15.110:0/929575515 conn(0x7f85e406ca80 msgr2=0x7f85e41598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:45.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 shutdown_connections 2024-04-21T22:53:45.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.274+0000 7f85e9467640 1 -- 172.21.15.110:0/929575515 wait complete. 2024-04-21T22:53:45.290 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:53:45.292 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-21T22:53:45.292 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:53:45.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15ce80a640 1 Processor -- start 2024-04-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15ce80a640 1 -- start start 2024-04-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15ce80a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c80705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:45.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15ce80a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15c8154940 0x7f15c8070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:45.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15ce80a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c815e5b0 con 0x7f15c806bcb0 2024-04-21T22:53:45.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15ce80a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f15c806b8d0 con 0x7f15c8154940 2024-04-21T22:53:45.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15ce80a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f15c815e890 con 0x7f15c8154560 2024-04-21T22:53:45.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15c77fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15c8154940 0x7f15c8070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:45.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15c77fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15c8154940 0x7f15c8070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35542/0 (socket says 172.21.15.110:35542) 2024-04-21T22:53:45.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15c77fe640 1 -- 172.21.15.110:0/3035417127 learned_addr learned my addr 172.21.15.110:0/3035417127 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:45.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.462+0000 7f15c7fff640 1 --2- 172.21.15.110:0/3035417127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c80705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.466+0000 7f15c77fe640 1 -- 172.21.15.110:0/3035417127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 msgr2=0x7f15c80705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.466+0000 7f15c77fe640 1 --2- 172.21.15.110:0/3035417127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c80705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.466+0000 7f15c77fe640 1 -- 172.21.15.110:0/3035417127 >> v1:172.21.15.154:6789/0 conn(0x7f15c806bcb0 legacy=0x7f15c815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.466+0000 7f15c77fe640 1 -- 172.21.15.110:0/3035417127 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c806b280 con 0x7f15c8154940 2024-04-21T22:53:45.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.470+0000 7f15c77fe640 1 --2- 172.21.15.110:0/3035417127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c8070b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009870 tx=0x7f15bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca19251749565ac server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:45.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15c6ffd640 1 -- 172.21.15.110:0/3035417127 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0b1070 con 0x7f15c8154940 2024-04-21T22:53:45.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15c6ffd640 1 -- 172.21.15.110:0/3035417127 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc0a8050 con 0x7f15c8154940 2024-04-21T22:53:45.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15c6ffd640 1 -- 172.21.15.110:0/3035417127 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0ac860 con 0x7f15c8154940 2024-04-21T22:53:45.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 -- 172.21.15.110:0/3035417127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 msgr2=0x7f15c8070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 --2- 172.21.15.110:0/3035417127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c8070b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009870 tx=0x7f15bc01c4d0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 -- 172.21.15.110:0/3035417127 shutdown_connections 2024-04-21T22:53:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 --2- 172.21.15.110:0/3035417127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c8070b00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 --2- 172.21.15.110:0/3035417127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c80705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 -- 172.21.15.110:0/3035417127 >> 172.21.15.110:0/3035417127 conn(0x7f15c806e5c0 msgr2=0x7f15c806e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 -- 172.21.15.110:0/3035417127 shutdown_connections 2024-04-21T22:53:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.474+0000 7f15ce80a640 1 -- 172.21.15.110:0/3035417127 wait complete. 2024-04-21T22:53:45.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 Processor -- start 2024-04-21T22:53:45.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 -- start start 2024-04-21T22:53:45.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c806bcb0 0x7f15c81f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:45.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c8156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c80c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f15c80b2350 con 0x7f15c8154940 2024-04-21T22:53:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15c80b21d0 con 0x7f15c806bcb0 2024-04-21T22:53:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ce80a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f15c81675b0 con 0x7f15c8154560 2024-04-21T22:53:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ccda7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c80c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ccda7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c80c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35550/0 (socket says 172.21.15.110:35550) 2024-04-21T22:53:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15ccda7640 1 -- 172.21.15.110:0/611891118 learned_addr learned my addr 172.21.15.110:0/611891118 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:45.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15c77fe640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c8156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:45.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.478+0000 7f15c7fff640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c806bcb0 0x7f15c81f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:45.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.482+0000 7f15ccda7640 1 -- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 msgr2=0x7f15c8156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:45.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.482+0000 7f15ccda7640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c8156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.482+0000 7f15ccda7640 1 -- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c806bcb0 msgr2=0x7f15c81f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:45.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.482+0000 7f15ccda7640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c806bcb0 0x7f15c81f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:45.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.482+0000 7f15ccda7640 1 -- 172.21.15.110:0/611891118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c815c600 con 0x7f15c8154940 2024-04-21T22:53:45.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.486+0000 7f15ccda7640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c80c2490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c770 tx=0x7f15c000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:45.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.490+0000 7f15c4ff9640 1 -- 172.21.15.110:0/611891118 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0003b80 con 0x7f15c8154940 2024-04-21T22:53:45.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.490+0000 7f15c4ff9640 1 -- 172.21.15.110:0/611891118 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c0003d20 con 0x7f15c8154940 2024-04-21T22:53:45.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.490+0000 7f15c4ff9640 1 -- 172.21.15.110:0/611891118 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c000aa90 con 0x7f15c8154940 2024-04-21T22:53:45.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.490+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c80cabf0 con 0x7f15c8154940 2024-04-21T22:53:45.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.490+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c81564d0 con 0x7f15c8154940 2024-04-21T22:53:45.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.490+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c804f510 con 0x7f15c8154940 2024-04-21T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.782+0000 7f15c4ff9640 1 -- 172.21.15.110:0/611891118 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15c000ac30 con 0x7f15c8154940 2024-04-21T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.782+0000 7f15c4ff9640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f15b4067940 0x7f15b4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.782+0000 7f15c7fff640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f15b4067940 0x7f15b4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.786+0000 7f15c7fff640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f15b4067940 0x7f15b4069e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15b8007a60 tx=0x7f15b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:45.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.822+0000 7f15c4ff9640 1 -- 172.21.15.110:0/611891118 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f15c0054ab0 con 0x7f15c8154940 2024-04-21T22:53:45.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:45.822+0000 7f15c4ff9640 1 -- 172.21.15.110:0/611891118 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f15c0056a10 con 0x7f15c8154940 2024-04-21T22:53:46.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.022+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15c806ba90 con 0x7f15c8154940 2024-04-21T22:53:46.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.082+0000 7f15c4ff9640 1 -- 172.21.15.110:0/611891118 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6842 (secure 0 0 0) 0x7f15c005ad10 con 0x7f15c8154940 2024-04-21T22:53:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:46.084 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3272126146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3272126146},{"type":"v1","addr":"172.21.15.154:6835","nonce":3272126146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1335792720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1335792720},{"type":"v1","addr":"172.21.15.110:6839","nonce":1335792720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1521497243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1521497243},{"type":"v1","addr":"172.21.15.154:6833","nonce":1521497243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1669982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1669982495},{"type":"v1","addr":"172.21.15.154:6837","nonce":1669982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T22:53:38.095934+0000","modified":"2024-04-21T22:53:44.722732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/1034856927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1034856927},{"type":"v1","addr":"172.21.15.110:6837","nonce":1034856927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-21T22:53:46.084 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f15b4067940 msgr2=0x7f15b4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f15b4067940 0x7f15b4069e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15b8007a60 tx=0x7f15b8008040 comp rx=0 tx=0).stop 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 msgr2=0x7f15c80c2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c80c2490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c770 tx=0x7f15c000cc30 comp rx=0 tx=0).stop 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 shutdown_connections 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f15b4067940 0x7f15b4069e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15c8154940 0x7f15c80c2490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c8154560 0x7f15c8156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 --2- 172.21.15.110:0/611891118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c806bcb0 0x7f15c81f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 >> 172.21.15.110:0/611891118 conn(0x7f15c806e5c0 msgr2=0x7f15c8153230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:46.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 shutdown_connections 2024-04-21T22:53:46.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.086+0000 7f15ce80a640 1 -- 172.21.15.110:0/611891118 wait complete. 2024-04-21T22:53:46.106 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:46.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.230+0000 7f6d890d3640 1 Processor -- start 2024-04-21T22:53:46.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.230+0000 7f6d890d3640 1 -- start start 2024-04-21T22:53:46.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.234+0000 7f6d890d3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d840c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:46.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.234+0000 7f6d890d3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d840c8410 con 0x7f6d840c9cb0 2024-04-21T22:53:46.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.234+0000 7f6d890d3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d84072d30 con 0x7f6d840c98d0 2024-04-21T22:53:46.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.234+0000 7f6d890d3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6d840c81e0 con 0x7f6d84154980 2024-04-21T22:53:46.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.234+0000 7f6d8259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d840c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:46.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.234+0000 7f6d82d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6d840c98d0 0x7f6d84154270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:58072/0 (socket says 172.21.15.110:58072) 2024-04-21T22:53:46.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.234+0000 7f6d82d9d640 1 -- 172.21.15.110:0/1974570497 learned_addr learned my addr 172.21.15.110:0/1974570497 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:46.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.242+0000 7f6d8259c640 1 -- 172.21.15.110:0/1974570497 >> v1:172.21.15.154:6789/0 conn(0x7f6d840c98d0 legacy=0x7f6d84154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:46.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.242+0000 7f6d8259c640 1 -- 172.21.15.110:0/1974570497 >> v1:172.21.15.110:6789/0 conn(0x7f6d840c9cb0 legacy=0x7f6d8415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:46.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.242+0000 7f6d8259c640 1 -- 172.21.15.110:0/1974570497 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d84073010 con 0x7f6d84154980 2024-04-21T22:53:46.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.246+0000 7f6d8259c640 1 --2- 172.21.15.110:0/1974570497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d840c1bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c7700 tx=0x7f6d7401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=313a440d8bab4a32 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:46.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d81d9b640 1 -- 172.21.15.110:0/1974570497 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d740b5070 con 0x7f6d84154980 2024-04-21T22:53:46.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d81d9b640 1 -- 172.21.15.110:0/1974570497 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d740a8970 con 0x7f6d84154980 2024-04-21T22:53:46.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d81d9b640 1 -- 172.21.15.110:0/1974570497 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d740a8d40 con 0x7f6d84154980 2024-04-21T22:53:46.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d890d3640 1 -- 172.21.15.110:0/1974570497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 msgr2=0x7f6d840c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:46.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d890d3640 1 --2- 172.21.15.110:0/1974570497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d840c1bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c7700 tx=0x7f6d7401ec70 comp rx=0 tx=0).stop 2024-04-21T22:53:46.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d890d3640 1 -- 172.21.15.110:0/1974570497 shutdown_connections 2024-04-21T22:53:46.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d890d3640 1 --2- 172.21.15.110:0/1974570497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d840c1bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:46.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d890d3640 1 -- 172.21.15.110:0/1974570497 >> 172.21.15.110:0/1974570497 conn(0x7f6d8406ca80 msgr2=0x7f6d84070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:46.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d890d3640 1 -- 172.21.15.110:0/1974570497 shutdown_connections 2024-04-21T22:53:46.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.258+0000 7f6d890d3640 1 -- 172.21.15.110:0/1974570497 wait complete. 2024-04-21T22:53:46.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 Processor -- start 2024-04-21T22:53:46.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 -- start start 2024-04-21T22:53:46.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840c98d0 0x7f6d841e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:46.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840c9cb0 0x7f6d8415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:46.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d8415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:46.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84072ae0 con 0x7f6d840c9cb0 2024-04-21T22:53:46.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84073620 con 0x7f6d840c98d0 2024-04-21T22:53:46.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d890d3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6d840737a0 con 0x7f6d84154980 2024-04-21T22:53:46.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d82d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840c98d0 0x7f6d841e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:46.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.262+0000 7f6d8359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d8415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:46.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.266+0000 7f6d82d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840c98d0 0x7f6d841e5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:58974/0 (socket says 172.21.15.110:58974) 2024-04-21T22:53:46.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.266+0000 7f6d82d9d640 1 -- 172.21.15.110:0/2799293574 learned_addr learned my addr 172.21.15.110:0/2799293574 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:46.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.278+0000 7f6d82d9d640 1 -- 172.21.15.110:0/2799293574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 msgr2=0x7f6d8415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:46.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.278+0000 7f6d82d9d640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d8415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:46.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.278+0000 7f6d82d9d640 1 -- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840c9cb0 msgr2=0x7f6d8415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:46.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.278+0000 7f6d82d9d640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840c9cb0 0x7f6d8415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:46.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.278+0000 7f6d82d9d640 1 -- 172.21.15.110:0/2799293574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d84154fb0 con 0x7f6d840c98d0 2024-04-21T22:53:46.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.286+0000 7f6d82d9d640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840c98d0 0x7f6d841e5af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c560 tx=0x7f6d7800ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.294+0000 7f6d6b7fe640 1 -- 172.21.15.110:0/2799293574 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d78017070 con 0x7f6d840c98d0 2024-04-21T22:53:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.294+0000 7f6d6b7fe640 1 -- 172.21.15.110:0/2799293574 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d78005cf0 con 0x7f6d840c98d0 2024-04-21T22:53:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.294+0000 7f6d6b7fe640 1 -- 172.21.15.110:0/2799293574 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d78007270 con 0x7f6d840c98d0 2024-04-21T22:53:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.294+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d84155290 con 0x7f6d840c98d0 2024-04-21T22:53:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.294+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d84155850 con 0x7f6d840c98d0 2024-04-21T22:53:46.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.298+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8404f510 con 0x7f6d840c98d0 2024-04-21T22:53:46.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.722+0000 7f6d6b7fe640 1 -- 172.21.15.110:0/2799293574 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6d7801a070 con 0x7f6d840c98d0 2024-04-21T22:53:46.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.722+0000 7f6d6b7fe640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6d70067910 0x7f6d70069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:46.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.722+0000 7f6d8259c640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6d70067910 0x7f6d70069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:46.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.726+0000 7f6d8259c640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6d70067910 0x7f6d70069dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d740b2000 tx=0x7f6d74004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:46.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.738+0000 7f6d6b7fe640 1 -- 172.21.15.110:0/2799293574 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6d78053b40 con 0x7f6d840c98d0 2024-04-21T22:53:46.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.766+0000 7f6d6b7fe640 1 -- 172.21.15.110:0/2799293574 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f6d78055aa0 con 0x7f6d840c98d0 2024-04-21T22:53:46.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:46.946+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d84073400 con 0x7f6d840c98d0 2024-04-21T22:53:47.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.114+0000 7f6d6b7fe640 1 -- 172.21.15.110:0/2799293574 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f6d78059da0 con 0x7f6d840c98d0 2024-04-21T22:53:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:47.114 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:47.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6d70067910 msgr2=0x7f6d70069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:47.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6d70067910 0x7f6d70069dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d740b2000 tx=0x7f6d74004740 comp rx=0 tx=0).stop 2024-04-21T22:53:47.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840c98d0 msgr2=0x7f6d841e5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:47.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840c98d0 0x7f6d841e5af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c560 tx=0x7f6d7800ca20 comp rx=0 tx=0).stop 2024-04-21T22:53:47.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 shutdown_connections 2024-04-21T22:53:47.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6d70067910 0x7f6d70069dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d84154980 0x7f6d8415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840c9cb0 0x7f6d8415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 --2- 172.21.15.110:0/2799293574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840c98d0 0x7f6d841e5af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 >> 172.21.15.110:0/2799293574 conn(0x7f6d8406ca80 msgr2=0x7f6d84158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:47.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 shutdown_connections 2024-04-21T22:53:47.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.118+0000 7f6d890d3640 1 -- 172.21.15.110:0/2799293574 wait complete. 2024-04-21T22:53:47.136 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-21T22:53:47.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:53:47.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f1881f640 1 Processor -- start 2024-04-21T22:53:47.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f1881f640 1 -- start start 2024-04-21T22:53:47.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f1881f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f140c2d50 0x7f6f140c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:47.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f1881f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f14158b60 0x7f6f140c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:47.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f1881f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f140ca590 con 0x7f6f141523e0 2024-04-21T22:53:47.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f1881f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6f140c9720 con 0x7f6f140c2d50 2024-04-21T22:53:47.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f1881f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6f14158ff0 con 0x7f6f14158b60 2024-04-21T22:53:47.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f11d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f140c2d50 0x7f6f140c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:47.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f12d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f14158b60 0x7f6f140c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:47.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f11d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f140c2d50 0x7f6f140c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:58990/0 (socket says 172.21.15.110:58990) 2024-04-21T22:53:47.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.262+0000 7f6f11d9b640 1 -- 172.21.15.110:0/2881841043 learned_addr learned my addr 172.21.15.110:0/2881841043 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.270+0000 7f6f12d9d640 1 -- 172.21.15.110:0/2881841043 >> v2:172.21.15.154:3300/0 conn(0x7f6f140c2d50 msgr2=0x7f6f140c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.270+0000 7f6f12d9d640 1 --2- 172.21.15.110:0/2881841043 >> v2:172.21.15.154:3300/0 conn(0x7f6f140c2d50 0x7f6f140c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.270+0000 7f6f12d9d640 1 -- 172.21.15.110:0/2881841043 >> v1:172.21.15.154:6789/0 conn(0x7f6f141523e0 legacy=0x7f6f14070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.270+0000 7f6f12d9d640 1 -- 172.21.15.110:0/2881841043 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140ca830 con 0x7f6f14158b60 2024-04-21T22:53:47.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.278+0000 7f6f12d9d640 1 --2- 172.21.15.110:0/2881841043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f14158b60 0x7f6f140c8690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009d90 tx=0x7f6f0c01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=288dabcb37dd3693 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:47.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1159a640 1 -- 172.21.15.110:0/2881841043 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0b2070 con 0x7f6f14158b60 2024-04-21T22:53:47.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1159a640 1 -- 172.21.15.110:0/2881841043 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c0a57b0 con 0x7f6f14158b60 2024-04-21T22:53:47.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1159a640 1 -- 172.21.15.110:0/2881841043 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0a5b80 con 0x7f6f14158b60 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 -- 172.21.15.110:0/2881841043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f14158b60 msgr2=0x7f6f140c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 --2- 172.21.15.110:0/2881841043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f14158b60 0x7f6f140c8690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009d90 tx=0x7f6f0c01c930 comp rx=0 tx=0).stop 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 -- 172.21.15.110:0/2881841043 shutdown_connections 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 --2- 172.21.15.110:0/2881841043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f14158b60 0x7f6f140c8690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 --2- 172.21.15.110:0/2881841043 >> v2:172.21.15.154:3300/0 conn(0x7f6f140c2d50 0x7f6f140c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 -- 172.21.15.110:0/2881841043 >> 172.21.15.110:0/2881841043 conn(0x7f6f140714f0 msgr2=0x7f6f14071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 -- 172.21.15.110:0/2881841043 shutdown_connections 2024-04-21T22:53:47.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 -- 172.21.15.110:0/2881841043 wait complete. 2024-04-21T22:53:47.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 Processor -- start 2024-04-21T22:53:47.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.286+0000 7f6f1881f640 1 -- start start 2024-04-21T22:53:47.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f1881f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f140c2d50 0x7f6f14150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:47.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f1881f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f141523e0 0x7f6f14157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:47.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f1881f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f14158b60 0x7f6f140cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:47.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f1881f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1406fe10 con 0x7f6f14158b60 2024-04-21T22:53:47.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f1881f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1406fb30 con 0x7f6f141523e0 2024-04-21T22:53:47.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f1881f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6f141651a0 con 0x7f6f140c2d50 2024-04-21T22:53:47.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f12d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f14158b60 0x7f6f140cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:47.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f12d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f14158b60 0x7f6f140cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35578/0 (socket says 172.21.15.110:35578) 2024-04-21T22:53:47.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f12d9d640 1 -- 172.21.15.110:0/595397731 learned_addr learned my addr 172.21.15.110:0/595397731 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:47.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f1259c640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f140c2d50 0x7f6f14150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:47.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.290+0000 7f6f11d9b640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f141523e0 0x7f6f14157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:47.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.294+0000 7f6f12d9d640 1 -- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f140c2d50 msgr2=0x7f6f14150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:47.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.294+0000 7f6f12d9d640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f140c2d50 0x7f6f14150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.294+0000 7f6f12d9d640 1 -- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f141523e0 msgr2=0x7f6f14157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:47.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.294+0000 7f6f12d9d640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f141523e0 0x7f6f14157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.294+0000 7f6f12d9d640 1 -- 172.21.15.110:0/595397731 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f141f45b0 con 0x7f6f14158b60 2024-04-21T22:53:47.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.294+0000 7f6f12d9d640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f14158b60 0x7f6f140cb990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c01afe0 tx=0x7f6f0c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:47.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.302+0000 7f6f02ffd640 1 -- 172.21.15.110:0/595397731 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0bb020 con 0x7f6f14158b60 2024-04-21T22:53:47.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.302+0000 7f6f02ffd640 1 -- 172.21.15.110:0/595397731 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c0ad440 con 0x7f6f14158b60 2024-04-21T22:53:47.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.302+0000 7f6f02ffd640 1 -- 172.21.15.110:0/595397731 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0b2040 con 0x7f6f14158b60 2024-04-21T22:53:47.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.302+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f140cdc60 con 0x7f6f14158b60 2024-04-21T22:53:47.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.302+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f141f37f0 con 0x7f6f14158b60 2024-04-21T22:53:47.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.302+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1404f510 con 0x7f6f14158b60 2024-04-21T22:53:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.618+0000 7f6f02ffd640 1 -- 172.21.15.110:0/595397731 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f0c0be020 con 0x7f6f14158b60 2024-04-21T22:53:47.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.618+0000 7f6f02ffd640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ef40678f0 0x7f6ef4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:47.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.618+0000 7f6f1259c640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ef40678f0 0x7f6ef4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.618+0000 7f6f1259c640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ef40678f0 0x7f6ef4069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f080098e0 tx=0x7f6f08009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.658+0000 7f6f02ffd640 1 -- 172.21.15.110:0/595397731 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f0c002030 con 0x7f6f14158b60 2024-04-21T22:53:47.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.658+0000 7f6f02ffd640 1 -- 172.21.15.110:0/595397731 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f6f0c0c5020 con 0x7f6f14158b60 2024-04-21T22:53:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.846+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f140b0b60 con 0x7f6ef40678f0 2024-04-21T22:53:47.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.862+0000 7f6f02ffd640 1 -- 172.21.15.110:0/595397731 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7f6f140b0b60 con 0x7f6ef40678f0 2024-04-21T22:53:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:47.867 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-21T22:53:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ef40678f0 msgr2=0x7f6ef4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ef40678f0 0x7f6ef4069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f080098e0 tx=0x7f6f08009060 comp rx=0 tx=0).stop 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f14158b60 msgr2=0x7f6f140cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f14158b60 0x7f6f140cb990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c01afe0 tx=0x7f6f0c0196d0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 shutdown_connections 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ef40678f0 0x7f6ef4069db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f14158b60 0x7f6f140cb990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f141523e0 0x7f6f14157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 --2- 172.21.15.110:0/595397731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f140c2d50 0x7f6f14150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 >> 172.21.15.110:0/595397731 conn(0x7f6f140714f0 msgr2=0x7f6f140c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 shutdown_connections 2024-04-21T22:53:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:47.866+0000 7f6f1881f640 1 -- 172.21.15.110:0/595397731 wait complete. 2024-04-21T22:53:47.885 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-04-21T22:53:47.356378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234804,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739916,"statfs":{"total":773094113280,"available":772853673984,"internally_reserved":0,"allocated":2064384,"data_stored":1839116,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.923039"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757459+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-21T22:53:39.757459+0000","last_peered":"2024-04-21T22:53:39.757459+0000","last_clean":"2024-04-21T22:53:39.757459+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-21T22:53:39.757459+0000","last_undegraded":"2024-04-21T22:53:39.757459+0000","last_fullsized":"2024-04-21T22:53:39.757459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757842+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-21T22:53:39.757842+0000","last_peered":"2024-04-21T22:53:39.757842+0000","last_clean":"2024-04-21T22:53:39.757842+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-21T22:53:39.757842+0000","last_undegraded":"2024-04-21T22:53:39.757842+0000","last_fullsized":"2024-04-21T22:53:39.757842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:25:19.748728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:27:16.978980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704596+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-21T22:53:39.704596+0000","last_peered":"2024-04-21T22:53:39.704596+0000","last_clean":"2024-04-21T22:53:39.704596+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-21T22:53:39.704596+0000","last_undegraded":"2024-04-21T22:53:39.704596+0000","last_fullsized":"2024-04-21T22:53:39.704596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756734+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-21T22:53:39.756734+0000","last_peered":"2024-04-21T22:53:39.756734+0000","last_clean":"2024-04-21T22:53:39.756734+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-21T22:53:39.756734+0000","last_undegraded":"2024-04-21T22:53:39.756734+0000","last_fullsized":"2024-04-21T22:53:39.756734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:26:22.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704812+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-21T22:53:39.704812+0000","last_peered":"2024-04-21T22:53:39.704812+0000","last_clean":"2024-04-21T22:53:39.704812+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-21T22:53:39.704812+0000","last_undegraded":"2024-04-21T22:53:39.704812+0000","last_fullsized":"2024-04-21T22:53:39.704812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756017+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-21T22:53:39.756017+0000","last_peered":"2024-04-21T22:53:39.756017+0000","last_clean":"2024-04-21T22:53:39.756017+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-21T22:53:39.756017+0000","last_undegraded":"2024-04-21T22:53:39.756017+0000","last_fullsized":"2024-04-21T22:53:39.756017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761187+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-21T22:53:39.761187+0000","last_peered":"2024-04-21T22:53:39.761187+0000","last_clean":"2024-04-21T22:53:39.761187+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-21T22:53:39.761187+0000","last_undegraded":"2024-04-21T22:53:39.761187+0000","last_fullsized":"2024-04-21T22:53:39.761187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:40:03.621192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755669+0000","last_change":"2024-04-21T22:53:38.576571+0000","last_active":"2024-04-21T22:53:39.755669+0000","last_peered":"2024-04-21T22:53:39.755669+0000","last_clean":"2024-04-21T22:53:39.755669+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-21T22:53:39.755669+0000","last_undegraded":"2024-04-21T22:53:39.755669+0000","last_fullsized":"2024-04-21T22:53:39.755669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757319+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-21T22:53:39.757319+0000","last_peered":"2024-04-21T22:53:39.757319+0000","last_clean":"2024-04-21T22:53:39.757319+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-21T22:53:39.757319+0000","last_undegraded":"2024-04-21T22:53:39.757319+0000","last_fullsized":"2024-04-21T22:53:39.757319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:26.176484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757851+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-21T22:53:39.757851+0000","last_peered":"2024-04-21T22:53:39.757851+0000","last_clean":"2024-04-21T22:53:39.757851+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-21T22:53:39.757851+0000","last_undegraded":"2024-04-21T22:53:39.757851+0000","last_fullsized":"2024-04-21T22:53:39.757851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757122+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-21T22:53:39.757122+0000","last_peered":"2024-04-21T22:53:39.757122+0000","last_clean":"2024-04-21T22:53:39.757122+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-21T22:53:39.757122+0000","last_undegraded":"2024-04-21T22:53:39.757122+0000","last_fullsized":"2024-04-21T22:53:39.757122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:51:01.311466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757254+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-21T22:53:39.757254+0000","last_peered":"2024-04-21T22:53:39.757254+0000","last_clean":"2024-04-21T22:53:39.757254+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-21T22:53:39.757254+0000","last_undegraded":"2024-04-21T22:53:39.757254+0000","last_fullsized":"2024-04-21T22:53:39.757254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757697+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-21T22:53:39.757697+0000","last_peered":"2024-04-21T22:53:39.757697+0000","last_clean":"2024-04-21T22:53:39.757697+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-21T22:53:39.757697+0000","last_undegraded":"2024-04-21T22:53:39.757697+0000","last_fullsized":"2024-04-21T22:53:39.757697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759126+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-21T22:53:39.759126+0000","last_peered":"2024-04-21T22:53:39.759126+0000","last_clean":"2024-04-21T22:53:39.759126+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-21T22:53:39.759126+0000","last_undegraded":"2024-04-21T22:53:39.759126+0000","last_fullsized":"2024-04-21T22:53:39.759126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:52:43.706899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721436+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-21T22:53:39.721436+0000","last_peered":"2024-04-21T22:53:39.721436+0000","last_clean":"2024-04-21T22:53:39.721436+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-21T22:53:39.721436+0000","last_undegraded":"2024-04-21T22:53:39.721436+0000","last_fullsized":"2024-04-21T22:53:39.721436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723468+0000","last_change":"2024-04-21T22:53:38.601841+0000","last_active":"2024-04-21T22:53:39.723468+0000","last_peered":"2024-04-21T22:53:39.723468+0000","last_clean":"2024-04-21T22:53:39.723468+0000","last_became_active":"2024-04-21T22:53:38.601086+0000","last_became_peered":"2024-04-21T22:53:38.601086+0000","last_unstale":"2024-04-21T22:53:39.723468+0000","last_undegraded":"2024-04-21T22:53:39.723468+0000","last_fullsized":"2024-04-21T22:53:39.723468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:45:23.058986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.762282+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-21T22:53:39.762282+0000","last_peered":"2024-04-21T22:53:39.762282+0000","last_clean":"2024-04-21T22:53:39.762282+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-21T22:53:39.762282+0000","last_undegraded":"2024-04-21T22:53:39.762282+0000","last_fullsized":"2024-04-21T22:53:39.762282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723205+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-21T22:53:39.723205+0000","last_peered":"2024-04-21T22:53:39.723205+0000","last_clean":"2024-04-21T22:53:39.723205+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-21T22:53:39.723205+0000","last_undegraded":"2024-04-21T22:53:39.723205+0000","last_fullsized":"2024-04-21T22:53:39.723205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:37:06.081826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757282+0000","last_change":"2024-04-21T22:53:38.610862+0000","last_active":"2024-04-21T22:53:39.757282+0000","last_peered":"2024-04-21T22:53:39.757282+0000","last_clean":"2024-04-21T22:53:39.757282+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-21T22:53:39.757282+0000","last_undegraded":"2024-04-21T22:53:39.757282+0000","last_fullsized":"2024-04-21T22:53:39.757282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:51.748240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745760+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-21T22:53:39.745760+0000","last_peered":"2024-04-21T22:53:39.745760+0000","last_clean":"2024-04-21T22:53:39.745760+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-21T22:53:39.745760+0000","last_undegraded":"2024-04-21T22:53:39.745760+0000","last_fullsized":"2024-04-21T22:53:39.745760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755353+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-21T22:53:39.755353+0000","last_peered":"2024-04-21T22:53:39.755353+0000","last_clean":"2024-04-21T22:53:39.755353+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-21T22:53:39.755353+0000","last_undegraded":"2024-04-21T22:53:39.755353+0000","last_fullsized":"2024-04-21T22:53:39.755353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759590+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-21T22:53:39.759590+0000","last_peered":"2024-04-21T22:53:39.759590+0000","last_clean":"2024-04-21T22:53:39.759590+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-21T22:53:39.759590+0000","last_undegraded":"2024-04-21T22:53:39.759590+0000","last_fullsized":"2024-04-21T22:53:39.759590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:47:54.239652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721864+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-21T22:53:39.721864+0000","last_peered":"2024-04-21T22:53:39.721864+0000","last_clean":"2024-04-21T22:53:39.721864+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-21T22:53:39.721864+0000","last_undegraded":"2024-04-21T22:53:39.721864+0000","last_fullsized":"2024-04-21T22:53:39.721864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758853+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-21T22:53:39.758853+0000","last_peered":"2024-04-21T22:53:39.758853+0000","last_clean":"2024-04-21T22:53:39.758853+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-21T22:53:39.758853+0000","last_undegraded":"2024-04-21T22:53:39.758853+0000","last_fullsized":"2024-04-21T22:53:39.758853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:25:42.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705131+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-21T22:53:39.705131+0000","last_peered":"2024-04-21T22:53:39.705131+0000","last_clean":"2024-04-21T22:53:39.705131+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-21T22:53:39.705131+0000","last_undegraded":"2024-04-21T22:53:39.705131+0000","last_fullsized":"2024-04-21T22:53:39.705131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757428+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-21T22:53:39.757428+0000","last_peered":"2024-04-21T22:53:39.757428+0000","last_clean":"2024-04-21T22:53:39.757428+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-21T22:53:39.757428+0000","last_undegraded":"2024-04-21T22:53:39.757428+0000","last_fullsized":"2024-04-21T22:53:39.757428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757859+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-21T22:53:39.757859+0000","last_peered":"2024-04-21T22:53:39.757859+0000","last_clean":"2024-04-21T22:53:39.757859+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-21T22:53:39.757859+0000","last_undegraded":"2024-04-21T22:53:39.757859+0000","last_fullsized":"2024-04-21T22:53:39.757859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759786+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-21T22:53:39.759786+0000","last_peered":"2024-04-21T22:53:39.759786+0000","last_clean":"2024-04-21T22:53:39.759786+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-21T22:53:39.759786+0000","last_undegraded":"2024-04-21T22:53:39.759786+0000","last_fullsized":"2024-04-21T22:53:39.759786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:43:35.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722003+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-21T22:53:39.722003+0000","last_peered":"2024-04-21T22:53:39.722003+0000","last_clean":"2024-04-21T22:53:39.722003+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-21T22:53:39.722003+0000","last_undegraded":"2024-04-21T22:53:39.722003+0000","last_fullsized":"2024-04-21T22:53:39.722003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761458+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-21T22:53:39.761458+0000","last_peered":"2024-04-21T22:53:39.761458+0000","last_clean":"2024-04-21T22:53:39.761458+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-21T22:53:39.761458+0000","last_undegraded":"2024-04-21T22:53:39.761458+0000","last_fullsized":"2024-04-21T22:53:39.761458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704355+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-21T22:53:39.704355+0000","last_peered":"2024-04-21T22:53:39.704355+0000","last_clean":"2024-04-21T22:53:39.704355+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-21T22:53:39.704355+0000","last_undegraded":"2024-04-21T22:53:39.704355+0000","last_fullsized":"2024-04-21T22:53:39.704355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755367+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-21T22:53:39.755367+0000","last_peered":"2024-04-21T22:53:39.755367+0000","last_clean":"2024-04-21T22:53:39.755367+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-21T22:53:39.755367+0000","last_undegraded":"2024-04-21T22:53:39.755367+0000","last_fullsized":"2024-04-21T22:53:39.755367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746430+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-21T22:53:39.746430+0000","last_peered":"2024-04-21T22:53:39.746430+0000","last_clean":"2024-04-21T22:53:39.746430+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-21T22:53:39.746430+0000","last_undegraded":"2024-04-21T22:53:39.746430+0000","last_fullsized":"2024-04-21T22:53:39.746430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050038+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-21T22:53:40.050038+0000","last_peered":"2024-04-21T22:53:40.050038+0000","last_clean":"2024-04-21T22:53:40.050038+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-21T22:53:40.050038+0000","last_undegraded":"2024-04-21T22:53:40.050038+0000","last_fullsized":"2024-04-21T22:53:40.050038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:31.566421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757473+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-21T22:53:39.757473+0000","last_peered":"2024-04-21T22:53:39.757473+0000","last_clean":"2024-04-21T22:53:39.757473+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-21T22:53:39.757473+0000","last_undegraded":"2024-04-21T22:53:39.757473+0000","last_fullsized":"2024-04-21T22:53:39.757473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758930+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-21T22:53:39.758930+0000","last_peered":"2024-04-21T22:53:39.758930+0000","last_clean":"2024-04-21T22:53:39.758930+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-21T22:53:39.758930+0000","last_undegraded":"2024-04-21T22:53:39.758930+0000","last_fullsized":"2024-04-21T22:53:39.758930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:38:02.541775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721605+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-21T22:53:39.721605+0000","last_peered":"2024-04-21T22:53:39.721605+0000","last_clean":"2024-04-21T22:53:39.721605+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-21T22:53:39.721605+0000","last_undegraded":"2024-04-21T22:53:39.721605+0000","last_fullsized":"2024-04-21T22:53:39.721605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746093+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-21T22:53:39.746093+0000","last_peered":"2024-04-21T22:53:39.746093+0000","last_clean":"2024-04-21T22:53:39.746093+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-21T22:53:39.746093+0000","last_undegraded":"2024-04-21T22:53:39.746093+0000","last_fullsized":"2024-04-21T22:53:39.746093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755825+0000","last_change":"2024-04-21T22:53:37.185089+0000","last_active":"2024-04-21T22:53:39.755825+0000","last_peered":"2024-04-21T22:53:39.755825+0000","last_clean":"2024-04-21T22:53:39.755825+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-21T22:53:39.755825+0000","last_undegraded":"2024-04-21T22:53:39.755825+0000","last_fullsized":"2024-04-21T22:53:39.755825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705229+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-21T22:53:39.705229+0000","last_peered":"2024-04-21T22:53:39.705229+0000","last_clean":"2024-04-21T22:53:39.705229+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-21T22:53:39.705229+0000","last_undegraded":"2024-04-21T22:53:39.705229+0000","last_fullsized":"2024-04-21T22:53:39.705229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:09.983320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757753+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-21T22:53:39.757753+0000","last_peered":"2024-04-21T22:53:39.757753+0000","last_clean":"2024-04-21T22:53:39.757753+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-21T22:53:39.757753+0000","last_undegraded":"2024-04-21T22:53:39.757753+0000","last_fullsized":"2024-04-21T22:53:39.757753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759728+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-21T22:53:39.759728+0000","last_peered":"2024-04-21T22:53:39.759728+0000","last_clean":"2024-04-21T22:53:39.759728+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-21T22:53:39.759728+0000","last_undegraded":"2024-04-21T22:53:39.759728+0000","last_fullsized":"2024-04-21T22:53:39.759728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:13.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047461+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-21T22:53:40.047461+0000","last_peered":"2024-04-21T22:53:40.047461+0000","last_clean":"2024-04-21T22:53:40.047461+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-21T22:53:40.047461+0000","last_undegraded":"2024-04-21T22:53:40.047461+0000","last_fullsized":"2024-04-21T22:53:40.047461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722381+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-21T22:53:39.722381+0000","last_peered":"2024-04-21T22:53:39.722381+0000","last_clean":"2024-04-21T22:53:39.722381+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-21T22:53:39.722381+0000","last_undegraded":"2024-04-21T22:53:39.722381+0000","last_fullsized":"2024-04-21T22:53:39.722381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:50.140041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.280055+0000","last_change":"2024-04-21T22:53:37.134021+0000","last_active":"2024-04-21T22:53:40.280055+0000","last_peered":"2024-04-21T22:53:40.280055+0000","last_clean":"2024-04-21T22:53:40.280055+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-21T22:53:40.280055+0000","last_undegraded":"2024-04-21T22:53:40.280055+0000","last_fullsized":"2024-04-21T22:53:40.280055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:57.000042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757466+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-21T22:53:39.757466+0000","last_peered":"2024-04-21T22:53:39.757466+0000","last_clean":"2024-04-21T22:53:39.757466+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-21T22:53:39.757466+0000","last_undegraded":"2024-04-21T22:53:39.757466+0000","last_fullsized":"2024-04-21T22:53:39.757466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.045806+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-21T22:53:40.045806+0000","last_peered":"2024-04-21T22:53:40.045806+0000","last_clean":"2024-04-21T22:53:40.045806+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-21T22:53:40.045806+0000","last_undegraded":"2024-04-21T22:53:40.045806+0000","last_fullsized":"2024-04-21T22:53:40.045806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757940+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-21T22:53:39.757940+0000","last_peered":"2024-04-21T22:53:39.757940+0000","last_clean":"2024-04-21T22:53:39.757940+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-21T22:53:39.757940+0000","last_undegraded":"2024-04-21T22:53:39.757940+0000","last_fullsized":"2024-04-21T22:53:39.757940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722866+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-21T22:53:39.722866+0000","last_peered":"2024-04-21T22:53:39.722866+0000","last_clean":"2024-04-21T22:53:39.722866+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-21T22:53:39.722866+0000","last_undegraded":"2024-04-21T22:53:39.722866+0000","last_fullsized":"2024-04-21T22:53:39.722866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:52.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722199+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-21T22:53:39.722199+0000","last_peered":"2024-04-21T22:53:39.722199+0000","last_clean":"2024-04-21T22:53:39.722199+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-21T22:53:39.722199+0000","last_undegraded":"2024-04-21T22:53:39.722199+0000","last_fullsized":"2024-04-21T22:53:39.722199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:27.631111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756116+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-21T22:53:39.756116+0000","last_peered":"2024-04-21T22:53:39.756116+0000","last_clean":"2024-04-21T22:53:39.756116+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-21T22:53:39.756116+0000","last_undegraded":"2024-04-21T22:53:39.756116+0000","last_fullsized":"2024-04-21T22:53:39.756116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754875+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-21T22:53:39.754875+0000","last_peered":"2024-04-21T22:53:39.754875+0000","last_clean":"2024-04-21T22:53:39.754875+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-21T22:53:39.754875+0000","last_undegraded":"2024-04-21T22:53:39.754875+0000","last_fullsized":"2024-04-21T22:53:39.754875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.228676+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-21T22:53:40.228676+0000","last_peered":"2024-04-21T22:53:40.228676+0000","last_clean":"2024-04-21T22:53:40.228676+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-21T22:53:40.228676+0000","last_undegraded":"2024-04-21T22:53:40.228676+0000","last_fullsized":"2024-04-21T22:53:40.228676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721602+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-21T22:53:39.721602+0000","last_peered":"2024-04-21T22:53:39.721602+0000","last_clean":"2024-04-21T22:53:39.721602+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-21T22:53:39.721602+0000","last_undegraded":"2024-04-21T22:53:39.721602+0000","last_fullsized":"2024-04-21T22:53:39.721602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758292+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-21T22:53:39.758292+0000","last_peered":"2024-04-21T22:53:39.758292+0000","last_clean":"2024-04-21T22:53:39.758292+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-21T22:53:39.758292+0000","last_undegraded":"2024-04-21T22:53:39.758292+0000","last_fullsized":"2024-04-21T22:53:39.758292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705317+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-21T22:53:39.705317+0000","last_peered":"2024-04-21T22:53:39.705317+0000","last_clean":"2024-04-21T22:53:39.705317+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-21T22:53:39.705317+0000","last_undegraded":"2024-04-21T22:53:39.705317+0000","last_fullsized":"2024-04-21T22:53:39.705317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.164673+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-21T22:53:40.164673+0000","last_peered":"2024-04-21T22:53:40.164673+0000","last_clean":"2024-04-21T22:53:40.164673+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-21T22:53:40.164673+0000","last_undegraded":"2024-04-21T22:53:40.164673+0000","last_fullsized":"2024-04-21T22:53:40.164673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757835+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-21T22:53:39.757835+0000","last_peered":"2024-04-21T22:53:39.757835+0000","last_clean":"2024-04-21T22:53:39.757835+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-21T22:53:39.757835+0000","last_undegraded":"2024-04-21T22:53:39.757835+0000","last_fullsized":"2024-04-21T22:53:39.757835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760485+0000","last_change":"2024-04-21T22:53:37.253316+0000","last_active":"2024-04-21T22:53:39.760485+0000","last_peered":"2024-04-21T22:53:39.760485+0000","last_clean":"2024-04-21T22:53:39.760485+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-21T22:53:39.760485+0000","last_undegraded":"2024-04-21T22:53:39.760485+0000","last_fullsized":"2024-04-21T22:53:39.760485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:45:21.383363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757430+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-21T22:53:39.757430+0000","last_peered":"2024-04-21T22:53:39.757430+0000","last_clean":"2024-04-21T22:53:39.757430+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-21T22:53:39.757430+0000","last_undegraded":"2024-04-21T22:53:39.757430+0000","last_fullsized":"2024-04-21T22:53:39.757430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758514+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-21T22:53:39.758514+0000","last_peered":"2024-04-21T22:53:39.758514+0000","last_clean":"2024-04-21T22:53:39.758514+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-21T22:53:39.758514+0000","last_undegraded":"2024-04-21T22:53:39.758514+0000","last_fullsized":"2024-04-21T22:53:39.758514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722910+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-21T22:53:39.722910+0000","last_peered":"2024-04-21T22:53:39.722910+0000","last_clean":"2024-04-21T22:53:39.722910+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-21T22:53:39.722910+0000","last_undegraded":"2024-04-21T22:53:39.722910+0000","last_fullsized":"2024-04-21T22:53:39.722910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:03.405030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754772+0000","last_change":"2024-04-21T22:52:58.454152+0000","last_active":"2024-04-21T22:53:39.754772+0000","last_peered":"2024-04-21T22:53:39.754772+0000","last_clean":"2024-04-21T22:53:39.754772+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-21T22:53:39.754772+0000","last_undegraded":"2024-04-21T22:53:39.754772+0000","last_fullsized":"2024-04-21T22:53:39.754772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_clean_scrub_stamp":"2024-04-21T22:52:55.145387+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:11:10.808812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722531+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-21T22:53:39.722531+0000","last_peered":"2024-04-21T22:53:39.722531+0000","last_clean":"2024-04-21T22:53:39.722531+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-21T22:53:39.722531+0000","last_undegraded":"2024-04-21T22:53:39.722531+0000","last_fullsized":"2024-04-21T22:53:39.722531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:29.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746081+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-21T22:53:39.746081+0000","last_peered":"2024-04-21T22:53:39.746081+0000","last_clean":"2024-04-21T22:53:39.746081+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-21T22:53:39.746081+0000","last_undegraded":"2024-04-21T22:53:39.746081+0000","last_fullsized":"2024-04-21T22:53:39.746081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721802+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-21T22:53:39.721802+0000","last_peered":"2024-04-21T22:53:39.721802+0000","last_clean":"2024-04-21T22:53:39.721802+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-21T22:53:39.721802+0000","last_undegraded":"2024-04-21T22:53:39.721802+0000","last_fullsized":"2024-04-21T22:53:39.721802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757228+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-21T22:53:39.757228+0000","last_peered":"2024-04-21T22:53:39.757228+0000","last_clean":"2024-04-21T22:53:39.757228+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-21T22:53:39.757228+0000","last_undegraded":"2024-04-21T22:53:39.757228+0000","last_fullsized":"2024-04-21T22:53:39.757228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761321+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-21T22:53:39.761321+0000","last_peered":"2024-04-21T22:53:39.761321+0000","last_clean":"2024-04-21T22:53:39.761321+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-21T22:53:39.761321+0000","last_undegraded":"2024-04-21T22:53:39.761321+0000","last_fullsized":"2024-04-21T22:53:39.761321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758128+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-21T22:53:39.758128+0000","last_peered":"2024-04-21T22:53:39.758128+0000","last_clean":"2024-04-21T22:53:39.758128+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-21T22:53:39.758128+0000","last_undegraded":"2024-04-21T22:53:39.758128+0000","last_fullsized":"2024-04-21T22:53:39.758128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:23.439754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722969+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-21T22:53:39.722969+0000","last_peered":"2024-04-21T22:53:39.722969+0000","last_clean":"2024-04-21T22:53:39.722969+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-21T22:53:39.722969+0000","last_undegraded":"2024-04-21T22:53:39.722969+0000","last_fullsized":"2024-04-21T22:53:39.722969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756576+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-21T22:53:39.756576+0000","last_peered":"2024-04-21T22:53:39.756576+0000","last_clean":"2024-04-21T22:53:39.756576+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-21T22:53:39.756576+0000","last_undegraded":"2024-04-21T22:53:39.756576+0000","last_fullsized":"2024-04-21T22:53:39.756576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760419+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-21T22:53:39.760419+0000","last_peered":"2024-04-21T22:53:39.760419+0000","last_clean":"2024-04-21T22:53:39.760419+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-21T22:53:39.760419+0000","last_undegraded":"2024-04-21T22:53:39.760419+0000","last_fullsized":"2024-04-21T22:53:39.760419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704674+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-21T22:53:39.704674+0000","last_peered":"2024-04-21T22:53:39.704674+0000","last_clean":"2024-04-21T22:53:39.704674+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-21T22:53:39.704674+0000","last_undegraded":"2024-04-21T22:53:39.704674+0000","last_fullsized":"2024-04-21T22:53:39.704674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723164+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-21T22:53:39.723164+0000","last_peered":"2024-04-21T22:53:39.723164+0000","last_clean":"2024-04-21T22:53:39.723164+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-21T22:53:39.723164+0000","last_undegraded":"2024-04-21T22:53:39.723164+0000","last_fullsized":"2024-04-21T22:53:39.723164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:56.447185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758199+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-21T22:53:39.758199+0000","last_peered":"2024-04-21T22:53:39.758199+0000","last_clean":"2024-04-21T22:53:39.758199+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-21T22:53:39.758199+0000","last_undegraded":"2024-04-21T22:53:39.758199+0000","last_fullsized":"2024-04-21T22:53:39.758199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746156+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-21T22:53:39.746156+0000","last_peered":"2024-04-21T22:53:39.746156+0000","last_clean":"2024-04-21T22:53:39.746156+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-21T22:53:39.746156+0000","last_undegraded":"2024-04-21T22:53:39.746156+0000","last_fullsized":"2024-04-21T22:53:39.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745957+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-21T22:53:39.745957+0000","last_peered":"2024-04-21T22:53:39.745957+0000","last_clean":"2024-04-21T22:53:39.745957+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-21T22:53:39.745957+0000","last_undegraded":"2024-04-21T22:53:39.745957+0000","last_fullsized":"2024-04-21T22:53:39.745957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050396+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-21T22:53:40.050396+0000","last_peered":"2024-04-21T22:53:40.050396+0000","last_clean":"2024-04-21T22:53:40.050396+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-21T22:53:40.050396+0000","last_undegraded":"2024-04-21T22:53:40.050396+0000","last_fullsized":"2024-04-21T22:53:40.050396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745835+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-21T22:53:39.745835+0000","last_peered":"2024-04-21T22:53:39.745835+0000","last_clean":"2024-04-21T22:53:39.745835+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-21T22:53:39.745835+0000","last_undegraded":"2024-04-21T22:53:39.745835+0000","last_fullsized":"2024-04-21T22:53:39.745835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755887+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-21T22:53:39.755887+0000","last_peered":"2024-04-21T22:53:39.755887+0000","last_clean":"2024-04-21T22:53:39.755887+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-21T22:53:39.755887+0000","last_undegraded":"2024-04-21T22:53:39.755887+0000","last_fullsized":"2024-04-21T22:53:39.755887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721729+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-21T22:53:39.721729+0000","last_peered":"2024-04-21T22:53:39.721729+0000","last_clean":"2024-04-21T22:53:39.721729+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-21T22:53:39.721729+0000","last_undegraded":"2024-04-21T22:53:39.721729+0000","last_fullsized":"2024-04-21T22:53:39.721729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746329+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-21T22:53:39.746329+0000","last_peered":"2024-04-21T22:53:39.746329+0000","last_clean":"2024-04-21T22:53:39.746329+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-21T22:53:39.746329+0000","last_undegraded":"2024-04-21T22:53:39.746329+0000","last_fullsized":"2024-04-21T22:53:39.746329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745442+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-21T22:53:39.745442+0000","last_peered":"2024-04-21T22:53:39.745442+0000","last_clean":"2024-04-21T22:53:39.745442+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-21T22:53:39.745442+0000","last_undegraded":"2024-04-21T22:53:39.745442+0000","last_fullsized":"2024-04-21T22:53:39.745442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758163+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-21T22:53:39.758163+0000","last_peered":"2024-04-21T22:53:39.758163+0000","last_clean":"2024-04-21T22:53:39.758163+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-21T22:53:39.758163+0000","last_undegraded":"2024-04-21T22:53:39.758163+0000","last_fullsized":"2024-04-21T22:53:39.758163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761803+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-21T22:53:39.761803+0000","last_peered":"2024-04-21T22:53:39.761803+0000","last_clean":"2024-04-21T22:53:39.761803+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-21T22:53:39.761803+0000","last_undegraded":"2024-04-21T22:53:39.761803+0000","last_fullsized":"2024-04-21T22:53:39.761803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050273+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-21T22:53:40.050273+0000","last_peered":"2024-04-21T22:53:40.050273+0000","last_clean":"2024-04-21T22:53:40.050273+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-21T22:53:40.050273+0000","last_undegraded":"2024-04-21T22:53:40.050273+0000","last_fullsized":"2024-04-21T22:53:40.050273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722321+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-21T22:53:39.722321+0000","last_peered":"2024-04-21T22:53:39.722321+0000","last_clean":"2024-04-21T22:53:39.722321+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-21T22:53:39.722321+0000","last_undegraded":"2024-04-21T22:53:39.722321+0000","last_fullsized":"2024-04-21T22:53:39.722321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:24:31.689158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722538+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-21T22:53:39.722538+0000","last_peered":"2024-04-21T22:53:39.722538+0000","last_clean":"2024-04-21T22:53:39.722538+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-21T22:53:39.722538+0000","last_undegraded":"2024-04-21T22:53:39.722538+0000","last_fullsized":"2024-04-21T22:53:39.722538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:05.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047053+0000","last_change":"2024-04-21T22:53:37.189530+0000","last_active":"2024-04-21T22:53:40.047053+0000","last_peered":"2024-04-21T22:53:40.047053+0000","last_clean":"2024-04-21T22:53:40.047053+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-21T22:53:40.047053+0000","last_undegraded":"2024-04-21T22:53:40.047053+0000","last_fullsized":"2024-04-21T22:53:40.047053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:16.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755277+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-21T22:53:39.755277+0000","last_peered":"2024-04-21T22:53:39.755277+0000","last_clean":"2024-04-21T22:53:39.755277+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-21T22:53:39.755277+0000","last_undegraded":"2024-04-21T22:53:39.755277+0000","last_fullsized":"2024-04-21T22:53:39.755277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047082+0000","last_change":"2024-04-21T22:53:37.187992+0000","last_active":"2024-04-21T22:53:40.047082+0000","last_peered":"2024-04-21T22:53:40.047082+0000","last_clean":"2024-04-21T22:53:40.047082+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-21T22:53:40.047082+0000","last_undegraded":"2024-04-21T22:53:40.047082+0000","last_fullsized":"2024-04-21T22:53:40.047082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:24.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759204+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-21T22:53:39.759204+0000","last_peered":"2024-04-21T22:53:39.759204+0000","last_clean":"2024-04-21T22:53:39.759204+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-21T22:53:39.759204+0000","last_undegraded":"2024-04-21T22:53:39.759204+0000","last_fullsized":"2024-04-21T22:53:39.759204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:59:51.600148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758563+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-21T22:53:39.758563+0000","last_peered":"2024-04-21T22:53:39.758563+0000","last_clean":"2024-04-21T22:53:39.758563+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-21T22:53:39.758563+0000","last_undegraded":"2024-04-21T22:53:39.758563+0000","last_fullsized":"2024-04-21T22:53:39.758563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:31:56.768493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758249+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-21T22:53:39.758249+0000","last_peered":"2024-04-21T22:53:39.758249+0000","last_clean":"2024-04-21T22:53:39.758249+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-21T22:53:39.758249+0000","last_undegraded":"2024-04-21T22:53:39.758249+0000","last_fullsized":"2024-04-21T22:53:39.758249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:49.627279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.229937+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-21T22:53:40.229937+0000","last_peered":"2024-04-21T22:53:40.229937+0000","last_clean":"2024-04-21T22:53:40.229937+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-21T22:53:40.229937+0000","last_undegraded":"2024-04-21T22:53:40.229937+0000","last_fullsized":"2024-04-21T22:53:40.229937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":83307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":672133,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":81751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":672155,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:53:47.890 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:53:48.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.054+0000 7f2808426640 1 Processor -- start 2024-04-21T22:53:48.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.054+0000 7f2808426640 1 -- start start 2024-04-21T22:53:48.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.054+0000 7f2808426640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28001523e0 0x7f28000c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.054+0000 7f2808426640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28000c2d50 0x7f2800158b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.054+0000 7f2808426640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28000ca590 con 0x7f2800070330 2024-04-21T22:53:48.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.054+0000 7f2808426640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f28000c9720 con 0x7f28000c2d50 2024-04-21T22:53:48.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.054+0000 7f2808426640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f28001527c0 con 0x7f28001523e0 2024-04-21T22:53:48.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.058+0000 7f28069c3640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2800070330 0x7f28000c8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49504/0 (socket says 172.21.15.110:49504) 2024-04-21T22:53:48.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.058+0000 7f28069c3640 1 -- 172.21.15.110:0/2446795136 learned_addr learned my addr 172.21.15.110:0/2446795136 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:48.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.058+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286196392 0 0) 0x7f28000ca590 con 0x7f2800070330 2024-04-21T22:53:48.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.058+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27ec003530 con 0x7f2800070330 2024-04-21T22:53:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 312728245 0 0) 0x7f27ec003530 con 0x7f2800070330 2024-04-21T22:53:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28001523e0 msgr2=0x7f28000c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28001523e0 0x7f28000c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 >> v2:172.21.15.154:3300/0 conn(0x7f28000c2d50 msgr2=0x7f2800158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 --2- 172.21.15.110:0/2446795136 >> v2:172.21.15.154:3300/0 conn(0x7f28000c2d50 0x7f2800158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28000ca830 con 0x7f2800070330 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f27f8001680 con 0x7f2800070330 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 >> v1:172.21.15.110:6789/0 conn(0x7f2800070330 legacy=0x7f28000c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec0039c0 0x7f27ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec004810 0x7f27ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28001523e0 0x7f27ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f28000c9720 con 0x7f27ec004810 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28001527c0 con 0x7f27ec0039c0 2024-04-21T22:53:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.062+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f27ec005590 con 0x7f28001523e0 2024-04-21T22:53:48.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.066+0000 7f28059c1640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec004810 0x7f27ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.070+0000 7f28059c1640 1 -- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28001523e0 msgr2=0x7f27ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:48.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.070+0000 7f28059c1640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28001523e0 0x7f27ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.070+0000 7f28059c1640 1 -- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec0039c0 msgr2=0x7f27ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:48.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.070+0000 7f28059c1640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec0039c0 0x7f27ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.070+0000 7f28059c1640 1 -- 172.21.15.110:0/2446795136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec003530 con 0x7f27ec004810 2024-04-21T22:53:48.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.074+0000 7f28059c1640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec004810 0x7f27ec004c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009890 tx=0x7f27f001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7938a6638786c7d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:48.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00b0070 con 0x7f27ec004810 2024-04-21T22:53:48.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f00ab620 con 0x7f27ec004810 2024-04-21T22:53:48.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f28051c0640 1 -- 172.21.15.110:0/2446795136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0009460 con 0x7f27ec004810 2024-04-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f2808426640 1 -- 172.21.15.110:0/2446795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec004810 msgr2=0x7f27ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f2808426640 1 --2- 172.21.15.110:0/2446795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec004810 0x7f27ec004c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009890 tx=0x7f27f001c3c0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f28069c3640 1 -- 172.21.15.110:0/2446795136 reap_dead start 2024-04-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f2808426640 1 -- 172.21.15.110:0/2446795136 shutdown_connections 2024-04-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f2808426640 1 -- 172.21.15.110:0/2446795136 >> 172.21.15.110:0/2446795136 conn(0x7f28000714f0 msgr2=0x7f2800071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f2808426640 1 -- 172.21.15.110:0/2446795136 shutdown_connections 2024-04-21T22:53:48.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.078+0000 7f2808426640 1 -- 172.21.15.110:0/2446795136 wait complete. 2024-04-21T22:53:48.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 Processor -- start 2024-04-21T22:53:48.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 -- start start 2024-04-21T22:53:48.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec004810 0x7f28001e3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28000c6260 0x7f28001ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28000ce250 0x7f28001ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f280006f850 con 0x7f28000ce250 2024-04-21T22:53:48.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28000cadd0 con 0x7f27ec004810 2024-04-21T22:53:48.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f2808426640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f280006fb30 con 0x7f28000c6260 2024-04-21T22:53:48.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f28069c3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28000ce250 0x7f28001ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f28069c3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28000ce250 0x7f28001ee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35596/0 (socket says 172.21.15.110:35596) 2024-04-21T22:53:48.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f28069c3640 1 -- 172.21.15.110:0/3802896328 learned_addr learned my addr 172.21.15.110:0/3802896328 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:48.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.082+0000 7f28059c1640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28000c6260 0x7f28001ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.086+0000 7f28061c2640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec004810 0x7f28001e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.086+0000 7f28069c3640 1 -- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28000c6260 msgr2=0x7f28001ee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.086+0000 7f28069c3640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28000c6260 0x7f28001ee3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.086+0000 7f28069c3640 1 -- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec004810 msgr2=0x7f28001e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.086+0000 7f28069c3640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec004810 0x7f28001e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.086+0000 7f28069c3640 1 -- 172.21.15.110:0/3802896328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28000c7d60 con 0x7f28000ce250 2024-04-21T22:53:48.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.090+0000 7f28069c3640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28000ce250 0x7f28001ee8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28000cb2c0 tx=0x7f27f800f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:48.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.094+0000 7f27f6ffd640 1 -- 172.21.15.110:0/3802896328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f800fea0 con 0x7f28000ce250 2024-04-21T22:53:48.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.094+0000 7f27f6ffd640 1 -- 172.21.15.110:0/3802896328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8007d00 con 0x7f28000ce250 2024-04-21T22:53:48.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.094+0000 7f27f6ffd640 1 -- 172.21.15.110:0/3802896328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f800a290 con 0x7f28000ce250 2024-04-21T22:53:48.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.094+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2800153f90 con 0x7f28000ce250 2024-04-21T22:53:48.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.094+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2800154230 con 0x7f28000ce250 2024-04-21T22:53:48.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.094+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280004f510 con 0x7f28000ce250 2024-04-21T22:53:48.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.114+0000 7f27f6ffd640 1 -- 172.21.15.110:0/3802896328 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27f800a430 con 0x7f28000ce250 2024-04-21T22:53:48.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.114+0000 7f27f6ffd640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f27e4067910 0x7f27e4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.118+0000 7f28061c2640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f27e4067910 0x7f27e4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.118+0000 7f28061c2640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f27e4067910 0x7f27e4069dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27fc004ba0 tx=0x7f27fc0093d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:48.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.414+0000 7f27f6ffd640 1 -- 172.21.15.110:0/3802896328 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f27f8056b40 con 0x7f28000ce250 2024-04-21T22:53:48.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.414+0000 7f27f6ffd640 1 -- 172.21.15.110:0/3802896328 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f27f80591a0 con 0x7f28000ce250 2024-04-21T22:53:48.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.578+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28000c91d0 con 0x7f27e4067910 2024-04-21T22:53:48.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.586+0000 7f27f6ffd640 1 -- 172.21.15.110:0/3802896328 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7f28000c91d0 con 0x7f27e4067910 2024-04-21T22:53:48.586 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:48.590 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-21T22:53:48.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f27e4067910 msgr2=0x7f27e4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f27e4067910 0x7f27e4069dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27fc004ba0 tx=0x7f27fc0093d0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28000ce250 msgr2=0x7f28001ee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28000ce250 0x7f28001ee8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28000cb2c0 tx=0x7f27f800f820 comp rx=0 tx=0).stop 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 shutdown_connections 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f27e4067910 0x7f27e4069dd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28000ce250 0x7f28001ee8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28000c6260 0x7f28001ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 --2- 172.21.15.110:0/3802896328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27ec004810 0x7f28001e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 >> 172.21.15.110:0/3802896328 conn(0x7f28000714f0 msgr2=0x7f2800150790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 shutdown_connections 2024-04-21T22:53:48.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.590+0000 7f2808426640 1 -- 172.21.15.110:0/3802896328 wait complete. 2024-04-21T22:53:48.607 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-04-21T22:53:47.356378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234804,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739916,"statfs":{"total":773094113280,"available":772853673984,"internally_reserved":0,"allocated":2064384,"data_stored":1839116,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.923039"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757459+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-21T22:53:39.757459+0000","last_peered":"2024-04-21T22:53:39.757459+0000","last_clean":"2024-04-21T22:53:39.757459+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-21T22:53:39.757459+0000","last_undegraded":"2024-04-21T22:53:39.757459+0000","last_fullsized":"2024-04-21T22:53:39.757459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757842+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-21T22:53:39.757842+0000","last_peered":"2024-04-21T22:53:39.757842+0000","last_clean":"2024-04-21T22:53:39.757842+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-21T22:53:39.757842+0000","last_undegraded":"2024-04-21T22:53:39.757842+0000","last_fullsized":"2024-04-21T22:53:39.757842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:25:19.748728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:27:16.978980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704596+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-21T22:53:39.704596+0000","last_peered":"2024-04-21T22:53:39.704596+0000","last_clean":"2024-04-21T22:53:39.704596+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-21T22:53:39.704596+0000","last_undegraded":"2024-04-21T22:53:39.704596+0000","last_fullsized":"2024-04-21T22:53:39.704596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756734+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-21T22:53:39.756734+0000","last_peered":"2024-04-21T22:53:39.756734+0000","last_clean":"2024-04-21T22:53:39.756734+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-21T22:53:39.756734+0000","last_undegraded":"2024-04-21T22:53:39.756734+0000","last_fullsized":"2024-04-21T22:53:39.756734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:26:22.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704812+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-21T22:53:39.704812+0000","last_peered":"2024-04-21T22:53:39.704812+0000","last_clean":"2024-04-21T22:53:39.704812+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-21T22:53:39.704812+0000","last_undegraded":"2024-04-21T22:53:39.704812+0000","last_fullsized":"2024-04-21T22:53:39.704812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756017+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-21T22:53:39.756017+0000","last_peered":"2024-04-21T22:53:39.756017+0000","last_clean":"2024-04-21T22:53:39.756017+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-21T22:53:39.756017+0000","last_undegraded":"2024-04-21T22:53:39.756017+0000","last_fullsized":"2024-04-21T22:53:39.756017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761187+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-21T22:53:39.761187+0000","last_peered":"2024-04-21T22:53:39.761187+0000","last_clean":"2024-04-21T22:53:39.761187+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-21T22:53:39.761187+0000","last_undegraded":"2024-04-21T22:53:39.761187+0000","last_fullsized":"2024-04-21T22:53:39.761187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:40:03.621192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755669+0000","last_change":"2024-04-21T22:53:38.576571+0000","last_active":"2024-04-21T22:53:39.755669+0000","last_peered":"2024-04-21T22:53:39.755669+0000","last_clean":"2024-04-21T22:53:39.755669+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-21T22:53:39.755669+0000","last_undegraded":"2024-04-21T22:53:39.755669+0000","last_fullsized":"2024-04-21T22:53:39.755669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757319+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-21T22:53:39.757319+0000","last_peered":"2024-04-21T22:53:39.757319+0000","last_clean":"2024-04-21T22:53:39.757319+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-21T22:53:39.757319+0000","last_undegraded":"2024-04-21T22:53:39.757319+0000","last_fullsized":"2024-04-21T22:53:39.757319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:26.176484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757851+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-21T22:53:39.757851+0000","last_peered":"2024-04-21T22:53:39.757851+0000","last_clean":"2024-04-21T22:53:39.757851+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-21T22:53:39.757851+0000","last_undegraded":"2024-04-21T22:53:39.757851+0000","last_fullsized":"2024-04-21T22:53:39.757851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757122+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-21T22:53:39.757122+0000","last_peered":"2024-04-21T22:53:39.757122+0000","last_clean":"2024-04-21T22:53:39.757122+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-21T22:53:39.757122+0000","last_undegraded":"2024-04-21T22:53:39.757122+0000","last_fullsized":"2024-04-21T22:53:39.757122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:51:01.311466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757254+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-21T22:53:39.757254+0000","last_peered":"2024-04-21T22:53:39.757254+0000","last_clean":"2024-04-21T22:53:39.757254+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-21T22:53:39.757254+0000","last_undegraded":"2024-04-21T22:53:39.757254+0000","last_fullsized":"2024-04-21T22:53:39.757254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757697+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-21T22:53:39.757697+0000","last_peered":"2024-04-21T22:53:39.757697+0000","last_clean":"2024-04-21T22:53:39.757697+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-21T22:53:39.757697+0000","last_undegraded":"2024-04-21T22:53:39.757697+0000","last_fullsized":"2024-04-21T22:53:39.757697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759126+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-21T22:53:39.759126+0000","last_peered":"2024-04-21T22:53:39.759126+0000","last_clean":"2024-04-21T22:53:39.759126+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-21T22:53:39.759126+0000","last_undegraded":"2024-04-21T22:53:39.759126+0000","last_fullsized":"2024-04-21T22:53:39.759126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:52:43.706899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721436+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-21T22:53:39.721436+0000","last_peered":"2024-04-21T22:53:39.721436+0000","last_clean":"2024-04-21T22:53:39.721436+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-21T22:53:39.721436+0000","last_undegraded":"2024-04-21T22:53:39.721436+0000","last_fullsized":"2024-04-21T22:53:39.721436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723468+0000","last_change":"2024-04-21T22:53:38.601841+0000","last_active":"2024-04-21T22:53:39.723468+0000","last_peered":"2024-04-21T22:53:39.723468+0000","last_clean":"2024-04-21T22:53:39.723468+0000","last_became_active":"2024-04-21T22:53:38.601086+0000","last_became_peered":"2024-04-21T22:53:38.601086+0000","last_unstale":"2024-04-21T22:53:39.723468+0000","last_undegraded":"2024-04-21T22:53:39.723468+0000","last_fullsized":"2024-04-21T22:53:39.723468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:45:23.058986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.762282+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-21T22:53:39.762282+0000","last_peered":"2024-04-21T22:53:39.762282+0000","last_clean":"2024-04-21T22:53:39.762282+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-21T22:53:39.762282+0000","last_undegraded":"2024-04-21T22:53:39.762282+0000","last_fullsized":"2024-04-21T22:53:39.762282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723205+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-21T22:53:39.723205+0000","last_peered":"2024-04-21T22:53:39.723205+0000","last_clean":"2024-04-21T22:53:39.723205+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-21T22:53:39.723205+0000","last_undegraded":"2024-04-21T22:53:39.723205+0000","last_fullsized":"2024-04-21T22:53:39.723205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:37:06.081826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757282+0000","last_change":"2024-04-21T22:53:38.610862+0000","last_active":"2024-04-21T22:53:39.757282+0000","last_peered":"2024-04-21T22:53:39.757282+0000","last_clean":"2024-04-21T22:53:39.757282+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-21T22:53:39.757282+0000","last_undegraded":"2024-04-21T22:53:39.757282+0000","last_fullsized":"2024-04-21T22:53:39.757282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:51.748240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745760+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-21T22:53:39.745760+0000","last_peered":"2024-04-21T22:53:39.745760+0000","last_clean":"2024-04-21T22:53:39.745760+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-21T22:53:39.745760+0000","last_undegraded":"2024-04-21T22:53:39.745760+0000","last_fullsized":"2024-04-21T22:53:39.745760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755353+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-21T22:53:39.755353+0000","last_peered":"2024-04-21T22:53:39.755353+0000","last_clean":"2024-04-21T22:53:39.755353+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-21T22:53:39.755353+0000","last_undegraded":"2024-04-21T22:53:39.755353+0000","last_fullsized":"2024-04-21T22:53:39.755353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759590+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-21T22:53:39.759590+0000","last_peered":"2024-04-21T22:53:39.759590+0000","last_clean":"2024-04-21T22:53:39.759590+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-21T22:53:39.759590+0000","last_undegraded":"2024-04-21T22:53:39.759590+0000","last_fullsized":"2024-04-21T22:53:39.759590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:47:54.239652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721864+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-21T22:53:39.721864+0000","last_peered":"2024-04-21T22:53:39.721864+0000","last_clean":"2024-04-21T22:53:39.721864+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-21T22:53:39.721864+0000","last_undegraded":"2024-04-21T22:53:39.721864+0000","last_fullsized":"2024-04-21T22:53:39.721864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758853+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-21T22:53:39.758853+0000","last_peered":"2024-04-21T22:53:39.758853+0000","last_clean":"2024-04-21T22:53:39.758853+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-21T22:53:39.758853+0000","last_undegraded":"2024-04-21T22:53:39.758853+0000","last_fullsized":"2024-04-21T22:53:39.758853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:25:42.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705131+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-21T22:53:39.705131+0000","last_peered":"2024-04-21T22:53:39.705131+0000","last_clean":"2024-04-21T22:53:39.705131+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-21T22:53:39.705131+0000","last_undegraded":"2024-04-21T22:53:39.705131+0000","last_fullsized":"2024-04-21T22:53:39.705131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757428+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-21T22:53:39.757428+0000","last_peered":"2024-04-21T22:53:39.757428+0000","last_clean":"2024-04-21T22:53:39.757428+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-21T22:53:39.757428+0000","last_undegraded":"2024-04-21T22:53:39.757428+0000","last_fullsized":"2024-04-21T22:53:39.757428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757859+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-21T22:53:39.757859+0000","last_peered":"2024-04-21T22:53:39.757859+0000","last_clean":"2024-04-21T22:53:39.757859+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-21T22:53:39.757859+0000","last_undegraded":"2024-04-21T22:53:39.757859+0000","last_fullsized":"2024-04-21T22:53:39.757859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759786+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-21T22:53:39.759786+0000","last_peered":"2024-04-21T22:53:39.759786+0000","last_clean":"2024-04-21T22:53:39.759786+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-21T22:53:39.759786+0000","last_undegraded":"2024-04-21T22:53:39.759786+0000","last_fullsized":"2024-04-21T22:53:39.759786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:43:35.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722003+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-21T22:53:39.722003+0000","last_peered":"2024-04-21T22:53:39.722003+0000","last_clean":"2024-04-21T22:53:39.722003+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-21T22:53:39.722003+0000","last_undegraded":"2024-04-21T22:53:39.722003+0000","last_fullsized":"2024-04-21T22:53:39.722003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761458+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-21T22:53:39.761458+0000","last_peered":"2024-04-21T22:53:39.761458+0000","last_clean":"2024-04-21T22:53:39.761458+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-21T22:53:39.761458+0000","last_undegraded":"2024-04-21T22:53:39.761458+0000","last_fullsized":"2024-04-21T22:53:39.761458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704355+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-21T22:53:39.704355+0000","last_peered":"2024-04-21T22:53:39.704355+0000","last_clean":"2024-04-21T22:53:39.704355+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-21T22:53:39.704355+0000","last_undegraded":"2024-04-21T22:53:39.704355+0000","last_fullsized":"2024-04-21T22:53:39.704355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755367+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-21T22:53:39.755367+0000","last_peered":"2024-04-21T22:53:39.755367+0000","last_clean":"2024-04-21T22:53:39.755367+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-21T22:53:39.755367+0000","last_undegraded":"2024-04-21T22:53:39.755367+0000","last_fullsized":"2024-04-21T22:53:39.755367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746430+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-21T22:53:39.746430+0000","last_peered":"2024-04-21T22:53:39.746430+0000","last_clean":"2024-04-21T22:53:39.746430+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-21T22:53:39.746430+0000","last_undegraded":"2024-04-21T22:53:39.746430+0000","last_fullsized":"2024-04-21T22:53:39.746430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050038+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-21T22:53:40.050038+0000","last_peered":"2024-04-21T22:53:40.050038+0000","last_clean":"2024-04-21T22:53:40.050038+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-21T22:53:40.050038+0000","last_undegraded":"2024-04-21T22:53:40.050038+0000","last_fullsized":"2024-04-21T22:53:40.050038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:31.566421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757473+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-21T22:53:39.757473+0000","last_peered":"2024-04-21T22:53:39.757473+0000","last_clean":"2024-04-21T22:53:39.757473+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-21T22:53:39.757473+0000","last_undegraded":"2024-04-21T22:53:39.757473+0000","last_fullsized":"2024-04-21T22:53:39.757473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758930+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-21T22:53:39.758930+0000","last_peered":"2024-04-21T22:53:39.758930+0000","last_clean":"2024-04-21T22:53:39.758930+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-21T22:53:39.758930+0000","last_undegraded":"2024-04-21T22:53:39.758930+0000","last_fullsized":"2024-04-21T22:53:39.758930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:38:02.541775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721605+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-21T22:53:39.721605+0000","last_peered":"2024-04-21T22:53:39.721605+0000","last_clean":"2024-04-21T22:53:39.721605+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-21T22:53:39.721605+0000","last_undegraded":"2024-04-21T22:53:39.721605+0000","last_fullsized":"2024-04-21T22:53:39.721605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746093+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-21T22:53:39.746093+0000","last_peered":"2024-04-21T22:53:39.746093+0000","last_clean":"2024-04-21T22:53:39.746093+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-21T22:53:39.746093+0000","last_undegraded":"2024-04-21T22:53:39.746093+0000","last_fullsized":"2024-04-21T22:53:39.746093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755825+0000","last_change":"2024-04-21T22:53:37.185089+0000","last_active":"2024-04-21T22:53:39.755825+0000","last_peered":"2024-04-21T22:53:39.755825+0000","last_clean":"2024-04-21T22:53:39.755825+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-21T22:53:39.755825+0000","last_undegraded":"2024-04-21T22:53:39.755825+0000","last_fullsized":"2024-04-21T22:53:39.755825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705229+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-21T22:53:39.705229+0000","last_peered":"2024-04-21T22:53:39.705229+0000","last_clean":"2024-04-21T22:53:39.705229+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-21T22:53:39.705229+0000","last_undegraded":"2024-04-21T22:53:39.705229+0000","last_fullsized":"2024-04-21T22:53:39.705229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:09.983320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757753+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-21T22:53:39.757753+0000","last_peered":"2024-04-21T22:53:39.757753+0000","last_clean":"2024-04-21T22:53:39.757753+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-21T22:53:39.757753+0000","last_undegraded":"2024-04-21T22:53:39.757753+0000","last_fullsized":"2024-04-21T22:53:39.757753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759728+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-21T22:53:39.759728+0000","last_peered":"2024-04-21T22:53:39.759728+0000","last_clean":"2024-04-21T22:53:39.759728+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-21T22:53:39.759728+0000","last_undegraded":"2024-04-21T22:53:39.759728+0000","last_fullsized":"2024-04-21T22:53:39.759728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:13.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047461+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-21T22:53:40.047461+0000","last_peered":"2024-04-21T22:53:40.047461+0000","last_clean":"2024-04-21T22:53:40.047461+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-21T22:53:40.047461+0000","last_undegraded":"2024-04-21T22:53:40.047461+0000","last_fullsized":"2024-04-21T22:53:40.047461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722381+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-21T22:53:39.722381+0000","last_peered":"2024-04-21T22:53:39.722381+0000","last_clean":"2024-04-21T22:53:39.722381+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-21T22:53:39.722381+0000","last_undegraded":"2024-04-21T22:53:39.722381+0000","last_fullsized":"2024-04-21T22:53:39.722381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:50.140041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.280055+0000","last_change":"2024-04-21T22:53:37.134021+0000","last_active":"2024-04-21T22:53:40.280055+0000","last_peered":"2024-04-21T22:53:40.280055+0000","last_clean":"2024-04-21T22:53:40.280055+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-21T22:53:40.280055+0000","last_undegraded":"2024-04-21T22:53:40.280055+0000","last_fullsized":"2024-04-21T22:53:40.280055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:57.000042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757466+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-21T22:53:39.757466+0000","last_peered":"2024-04-21T22:53:39.757466+0000","last_clean":"2024-04-21T22:53:39.757466+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-21T22:53:39.757466+0000","last_undegraded":"2024-04-21T22:53:39.757466+0000","last_fullsized":"2024-04-21T22:53:39.757466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.045806+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-21T22:53:40.045806+0000","last_peered":"2024-04-21T22:53:40.045806+0000","last_clean":"2024-04-21T22:53:40.045806+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-21T22:53:40.045806+0000","last_undegraded":"2024-04-21T22:53:40.045806+0000","last_fullsized":"2024-04-21T22:53:40.045806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757940+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-21T22:53:39.757940+0000","last_peered":"2024-04-21T22:53:39.757940+0000","last_clean":"2024-04-21T22:53:39.757940+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-21T22:53:39.757940+0000","last_undegraded":"2024-04-21T22:53:39.757940+0000","last_fullsized":"2024-04-21T22:53:39.757940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722866+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-21T22:53:39.722866+0000","last_peered":"2024-04-21T22:53:39.722866+0000","last_clean":"2024-04-21T22:53:39.722866+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-21T22:53:39.722866+0000","last_undegraded":"2024-04-21T22:53:39.722866+0000","last_fullsized":"2024-04-21T22:53:39.722866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:52.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722199+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-21T22:53:39.722199+0000","last_peered":"2024-04-21T22:53:39.722199+0000","last_clean":"2024-04-21T22:53:39.722199+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-21T22:53:39.722199+0000","last_undegraded":"2024-04-21T22:53:39.722199+0000","last_fullsized":"2024-04-21T22:53:39.722199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:27.631111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756116+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-21T22:53:39.756116+0000","last_peered":"2024-04-21T22:53:39.756116+0000","last_clean":"2024-04-21T22:53:39.756116+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-21T22:53:39.756116+0000","last_undegraded":"2024-04-21T22:53:39.756116+0000","last_fullsized":"2024-04-21T22:53:39.756116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754875+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-21T22:53:39.754875+0000","last_peered":"2024-04-21T22:53:39.754875+0000","last_clean":"2024-04-21T22:53:39.754875+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-21T22:53:39.754875+0000","last_undegraded":"2024-04-21T22:53:39.754875+0000","last_fullsized":"2024-04-21T22:53:39.754875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.228676+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-21T22:53:40.228676+0000","last_peered":"2024-04-21T22:53:40.228676+0000","last_clean":"2024-04-21T22:53:40.228676+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-21T22:53:40.228676+0000","last_undegraded":"2024-04-21T22:53:40.228676+0000","last_fullsized":"2024-04-21T22:53:40.228676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721602+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-21T22:53:39.721602+0000","last_peered":"2024-04-21T22:53:39.721602+0000","last_clean":"2024-04-21T22:53:39.721602+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-21T22:53:39.721602+0000","last_undegraded":"2024-04-21T22:53:39.721602+0000","last_fullsized":"2024-04-21T22:53:39.721602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758292+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-21T22:53:39.758292+0000","last_peered":"2024-04-21T22:53:39.758292+0000","last_clean":"2024-04-21T22:53:39.758292+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-21T22:53:39.758292+0000","last_undegraded":"2024-04-21T22:53:39.758292+0000","last_fullsized":"2024-04-21T22:53:39.758292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705317+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-21T22:53:39.705317+0000","last_peered":"2024-04-21T22:53:39.705317+0000","last_clean":"2024-04-21T22:53:39.705317+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-21T22:53:39.705317+0000","last_undegraded":"2024-04-21T22:53:39.705317+0000","last_fullsized":"2024-04-21T22:53:39.705317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.164673+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-21T22:53:40.164673+0000","last_peered":"2024-04-21T22:53:40.164673+0000","last_clean":"2024-04-21T22:53:40.164673+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-21T22:53:40.164673+0000","last_undegraded":"2024-04-21T22:53:40.164673+0000","last_fullsized":"2024-04-21T22:53:40.164673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757835+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-21T22:53:39.757835+0000","last_peered":"2024-04-21T22:53:39.757835+0000","last_clean":"2024-04-21T22:53:39.757835+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-21T22:53:39.757835+0000","last_undegraded":"2024-04-21T22:53:39.757835+0000","last_fullsized":"2024-04-21T22:53:39.757835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760485+0000","last_change":"2024-04-21T22:53:37.253316+0000","last_active":"2024-04-21T22:53:39.760485+0000","last_peered":"2024-04-21T22:53:39.760485+0000","last_clean":"2024-04-21T22:53:39.760485+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-21T22:53:39.760485+0000","last_undegraded":"2024-04-21T22:53:39.760485+0000","last_fullsized":"2024-04-21T22:53:39.760485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:45:21.383363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757430+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-21T22:53:39.757430+0000","last_peered":"2024-04-21T22:53:39.757430+0000","last_clean":"2024-04-21T22:53:39.757430+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-21T22:53:39.757430+0000","last_undegraded":"2024-04-21T22:53:39.757430+0000","last_fullsized":"2024-04-21T22:53:39.757430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758514+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-21T22:53:39.758514+0000","last_peered":"2024-04-21T22:53:39.758514+0000","last_clean":"2024-04-21T22:53:39.758514+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-21T22:53:39.758514+0000","last_undegraded":"2024-04-21T22:53:39.758514+0000","last_fullsized":"2024-04-21T22:53:39.758514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722910+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-21T22:53:39.722910+0000","last_peered":"2024-04-21T22:53:39.722910+0000","last_clean":"2024-04-21T22:53:39.722910+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-21T22:53:39.722910+0000","last_undegraded":"2024-04-21T22:53:39.722910+0000","last_fullsized":"2024-04-21T22:53:39.722910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:03.405030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754772+0000","last_change":"2024-04-21T22:52:58.454152+0000","last_active":"2024-04-21T22:53:39.754772+0000","last_peered":"2024-04-21T22:53:39.754772+0000","last_clean":"2024-04-21T22:53:39.754772+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-21T22:53:39.754772+0000","last_undegraded":"2024-04-21T22:53:39.754772+0000","last_fullsized":"2024-04-21T22:53:39.754772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_clean_scrub_stamp":"2024-04-21T22:52:55.145387+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:11:10.808812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722531+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-21T22:53:39.722531+0000","last_peered":"2024-04-21T22:53:39.722531+0000","last_clean":"2024-04-21T22:53:39.722531+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-21T22:53:39.722531+0000","last_undegraded":"2024-04-21T22:53:39.722531+0000","last_fullsized":"2024-04-21T22:53:39.722531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:29.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746081+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-21T22:53:39.746081+0000","last_peered":"2024-04-21T22:53:39.746081+0000","last_clean":"2024-04-21T22:53:39.746081+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-21T22:53:39.746081+0000","last_undegraded":"2024-04-21T22:53:39.746081+0000","last_fullsized":"2024-04-21T22:53:39.746081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721802+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-21T22:53:39.721802+0000","last_peered":"2024-04-21T22:53:39.721802+0000","last_clean":"2024-04-21T22:53:39.721802+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-21T22:53:39.721802+0000","last_undegraded":"2024-04-21T22:53:39.721802+0000","last_fullsized":"2024-04-21T22:53:39.721802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757228+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-21T22:53:39.757228+0000","last_peered":"2024-04-21T22:53:39.757228+0000","last_clean":"2024-04-21T22:53:39.757228+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-21T22:53:39.757228+0000","last_undegraded":"2024-04-21T22:53:39.757228+0000","last_fullsized":"2024-04-21T22:53:39.757228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761321+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-21T22:53:39.761321+0000","last_peered":"2024-04-21T22:53:39.761321+0000","last_clean":"2024-04-21T22:53:39.761321+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-21T22:53:39.761321+0000","last_undegraded":"2024-04-21T22:53:39.761321+0000","last_fullsized":"2024-04-21T22:53:39.761321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758128+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-21T22:53:39.758128+0000","last_peered":"2024-04-21T22:53:39.758128+0000","last_clean":"2024-04-21T22:53:39.758128+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-21T22:53:39.758128+0000","last_undegraded":"2024-04-21T22:53:39.758128+0000","last_fullsized":"2024-04-21T22:53:39.758128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:23.439754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722969+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-21T22:53:39.722969+0000","last_peered":"2024-04-21T22:53:39.722969+0000","last_clean":"2024-04-21T22:53:39.722969+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-21T22:53:39.722969+0000","last_undegraded":"2024-04-21T22:53:39.722969+0000","last_fullsized":"2024-04-21T22:53:39.722969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756576+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-21T22:53:39.756576+0000","last_peered":"2024-04-21T22:53:39.756576+0000","last_clean":"2024-04-21T22:53:39.756576+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-21T22:53:39.756576+0000","last_undegraded":"2024-04-21T22:53:39.756576+0000","last_fullsized":"2024-04-21T22:53:39.756576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760419+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-21T22:53:39.760419+0000","last_peered":"2024-04-21T22:53:39.760419+0000","last_clean":"2024-04-21T22:53:39.760419+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-21T22:53:39.760419+0000","last_undegraded":"2024-04-21T22:53:39.760419+0000","last_fullsized":"2024-04-21T22:53:39.760419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704674+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-21T22:53:39.704674+0000","last_peered":"2024-04-21T22:53:39.704674+0000","last_clean":"2024-04-21T22:53:39.704674+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-21T22:53:39.704674+0000","last_undegraded":"2024-04-21T22:53:39.704674+0000","last_fullsized":"2024-04-21T22:53:39.704674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723164+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-21T22:53:39.723164+0000","last_peered":"2024-04-21T22:53:39.723164+0000","last_clean":"2024-04-21T22:53:39.723164+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-21T22:53:39.723164+0000","last_undegraded":"2024-04-21T22:53:39.723164+0000","last_fullsized":"2024-04-21T22:53:39.723164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:56.447185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758199+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-21T22:53:39.758199+0000","last_peered":"2024-04-21T22:53:39.758199+0000","last_clean":"2024-04-21T22:53:39.758199+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-21T22:53:39.758199+0000","last_undegraded":"2024-04-21T22:53:39.758199+0000","last_fullsized":"2024-04-21T22:53:39.758199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746156+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-21T22:53:39.746156+0000","last_peered":"2024-04-21T22:53:39.746156+0000","last_clean":"2024-04-21T22:53:39.746156+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-21T22:53:39.746156+0000","last_undegraded":"2024-04-21T22:53:39.746156+0000","last_fullsized":"2024-04-21T22:53:39.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745957+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-21T22:53:39.745957+0000","last_peered":"2024-04-21T22:53:39.745957+0000","last_clean":"2024-04-21T22:53:39.745957+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-21T22:53:39.745957+0000","last_undegraded":"2024-04-21T22:53:39.745957+0000","last_fullsized":"2024-04-21T22:53:39.745957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050396+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-21T22:53:40.050396+0000","last_peered":"2024-04-21T22:53:40.050396+0000","last_clean":"2024-04-21T22:53:40.050396+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-21T22:53:40.050396+0000","last_undegraded":"2024-04-21T22:53:40.050396+0000","last_fullsized":"2024-04-21T22:53:40.050396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745835+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-21T22:53:39.745835+0000","last_peered":"2024-04-21T22:53:39.745835+0000","last_clean":"2024-04-21T22:53:39.745835+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-21T22:53:39.745835+0000","last_undegraded":"2024-04-21T22:53:39.745835+0000","last_fullsized":"2024-04-21T22:53:39.745835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755887+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-21T22:53:39.755887+0000","last_peered":"2024-04-21T22:53:39.755887+0000","last_clean":"2024-04-21T22:53:39.755887+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-21T22:53:39.755887+0000","last_undegraded":"2024-04-21T22:53:39.755887+0000","last_fullsized":"2024-04-21T22:53:39.755887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721729+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-21T22:53:39.721729+0000","last_peered":"2024-04-21T22:53:39.721729+0000","last_clean":"2024-04-21T22:53:39.721729+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-21T22:53:39.721729+0000","last_undegraded":"2024-04-21T22:53:39.721729+0000","last_fullsized":"2024-04-21T22:53:39.721729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746329+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-21T22:53:39.746329+0000","last_peered":"2024-04-21T22:53:39.746329+0000","last_clean":"2024-04-21T22:53:39.746329+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-21T22:53:39.746329+0000","last_undegraded":"2024-04-21T22:53:39.746329+0000","last_fullsized":"2024-04-21T22:53:39.746329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745442+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-21T22:53:39.745442+0000","last_peered":"2024-04-21T22:53:39.745442+0000","last_clean":"2024-04-21T22:53:39.745442+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-21T22:53:39.745442+0000","last_undegraded":"2024-04-21T22:53:39.745442+0000","last_fullsized":"2024-04-21T22:53:39.745442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758163+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-21T22:53:39.758163+0000","last_peered":"2024-04-21T22:53:39.758163+0000","last_clean":"2024-04-21T22:53:39.758163+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-21T22:53:39.758163+0000","last_undegraded":"2024-04-21T22:53:39.758163+0000","last_fullsized":"2024-04-21T22:53:39.758163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761803+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-21T22:53:39.761803+0000","last_peered":"2024-04-21T22:53:39.761803+0000","last_clean":"2024-04-21T22:53:39.761803+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-21T22:53:39.761803+0000","last_undegraded":"2024-04-21T22:53:39.761803+0000","last_fullsized":"2024-04-21T22:53:39.761803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050273+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-21T22:53:40.050273+0000","last_peered":"2024-04-21T22:53:40.050273+0000","last_clean":"2024-04-21T22:53:40.050273+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-21T22:53:40.050273+0000","last_undegraded":"2024-04-21T22:53:40.050273+0000","last_fullsized":"2024-04-21T22:53:40.050273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722321+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-21T22:53:39.722321+0000","last_peered":"2024-04-21T22:53:39.722321+0000","last_clean":"2024-04-21T22:53:39.722321+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-21T22:53:39.722321+0000","last_undegraded":"2024-04-21T22:53:39.722321+0000","last_fullsized":"2024-04-21T22:53:39.722321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:24:31.689158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722538+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-21T22:53:39.722538+0000","last_peered":"2024-04-21T22:53:39.722538+0000","last_clean":"2024-04-21T22:53:39.722538+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-21T22:53:39.722538+0000","last_undegraded":"2024-04-21T22:53:39.722538+0000","last_fullsized":"2024-04-21T22:53:39.722538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:05.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047053+0000","last_change":"2024-04-21T22:53:37.189530+0000","last_active":"2024-04-21T22:53:40.047053+0000","last_peered":"2024-04-21T22:53:40.047053+0000","last_clean":"2024-04-21T22:53:40.047053+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-21T22:53:40.047053+0000","last_undegraded":"2024-04-21T22:53:40.047053+0000","last_fullsized":"2024-04-21T22:53:40.047053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:16.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755277+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-21T22:53:39.755277+0000","last_peered":"2024-04-21T22:53:39.755277+0000","last_clean":"2024-04-21T22:53:39.755277+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-21T22:53:39.755277+0000","last_undegraded":"2024-04-21T22:53:39.755277+0000","last_fullsized":"2024-04-21T22:53:39.755277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047082+0000","last_change":"2024-04-21T22:53:37.187992+0000","last_active":"2024-04-21T22:53:40.047082+0000","last_peered":"2024-04-21T22:53:40.047082+0000","last_clean":"2024-04-21T22:53:40.047082+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-21T22:53:40.047082+0000","last_undegraded":"2024-04-21T22:53:40.047082+0000","last_fullsized":"2024-04-21T22:53:40.047082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:24.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759204+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-21T22:53:39.759204+0000","last_peered":"2024-04-21T22:53:39.759204+0000","last_clean":"2024-04-21T22:53:39.759204+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-21T22:53:39.759204+0000","last_undegraded":"2024-04-21T22:53:39.759204+0000","last_fullsized":"2024-04-21T22:53:39.759204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:59:51.600148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758563+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-21T22:53:39.758563+0000","last_peered":"2024-04-21T22:53:39.758563+0000","last_clean":"2024-04-21T22:53:39.758563+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-21T22:53:39.758563+0000","last_undegraded":"2024-04-21T22:53:39.758563+0000","last_fullsized":"2024-04-21T22:53:39.758563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:31:56.768493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758249+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-21T22:53:39.758249+0000","last_peered":"2024-04-21T22:53:39.758249+0000","last_clean":"2024-04-21T22:53:39.758249+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-21T22:53:39.758249+0000","last_undegraded":"2024-04-21T22:53:39.758249+0000","last_fullsized":"2024-04-21T22:53:39.758249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:49.627279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.229937+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-21T22:53:40.229937+0000","last_peered":"2024-04-21T22:53:40.229937+0000","last_clean":"2024-04-21T22:53:40.229937+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-21T22:53:40.229937+0000","last_undegraded":"2024-04-21T22:53:40.229937+0000","last_fullsized":"2024-04-21T22:53:40.229937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":83307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":672133,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":81751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":672155,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:53:48.612 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-21T22:53:48.612 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-21T22:53:48.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-21T22:53:48.613 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-21T22:53:48.613 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-21T22:53:48.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 Processor -- start 2024-04-21T22:53:48.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 -- start start 2024-04-21T22:53:48.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f02f4154550 0x7f02f40c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02f406beb0 0x7f02f406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f406b720 0x7f02f415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f02f415e270 con 0x7f02f4154550 2024-04-21T22:53:48.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f02f415af50 con 0x7f02f406beb0 2024-04-21T22:53:48.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02fab2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f02f415d960 con 0x7f02f406b720 2024-04-21T22:53:48.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02f88c8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f02f4154550 0x7f02f40c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02f88c8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f02f4154550 0x7f02f40c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35606/0 (socket says 172.21.15.110:35606) 2024-04-21T22:53:48.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02f88c8640 1 -- 172.21.15.110:0/2292161071 learned_addr learned my addr 172.21.15.110:0/2292161071 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:48.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02f90c9640 1 --2- 172.21.15.110:0/2292161071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f406b720 0x7f02f415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.778+0000 7f02f3fff640 1 --2- 172.21.15.110:0/2292161071 >> v2:172.21.15.154:3300/0 conn(0x7f02f406beb0 0x7f02f406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.782+0000 7f02f88c8640 1 -- 172.21.15.110:0/2292161071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f406b720 msgr2=0x7f02f415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:48.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.782+0000 7f02f88c8640 1 --2- 172.21.15.110:0/2292161071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f406b720 0x7f02f415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.782+0000 7f02f88c8640 1 -- 172.21.15.110:0/2292161071 >> v2:172.21.15.154:3300/0 conn(0x7f02f406beb0 msgr2=0x7f02f406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:48.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.782+0000 7f02f88c8640 1 --2- 172.21.15.110:0/2292161071 >> v2:172.21.15.154:3300/0 conn(0x7f02f406beb0 0x7f02f406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.782+0000 7f02f88c8640 1 -- 172.21.15.110:0/2292161071 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f415b210 con 0x7f02f4154550 2024-04-21T22:53:48.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.786+0000 7f02f88c8640 1 --2- 172.21.15.110:0/2292161071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f4154550 0x7f02f40c7180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02f4062060 tx=0x7f02e401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dc11357c6dba19 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:48.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.790+0000 7f02f37fe640 1 -- 172.21.15.110:0/2292161071 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e40b1070 con 0x7f02f4154550 2024-04-21T22:53:48.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.790+0000 7f02f37fe640 1 -- 172.21.15.110:0/2292161071 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e40ac620 con 0x7f02f4154550 2024-04-21T22:53:48.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.790+0000 7f02f37fe640 1 -- 172.21.15.110:0/2292161071 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e40ac9f0 con 0x7f02f4154550 2024-04-21T22:53:48.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- 172.21.15.110:0/2292161071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f4154550 msgr2=0x7f02f40c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 --2- 172.21.15.110:0/2292161071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f4154550 0x7f02f40c7180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02f4062060 tx=0x7f02e401c4f0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- 172.21.15.110:0/2292161071 shutdown_connections 2024-04-21T22:53:48.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 --2- 172.21.15.110:0/2292161071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f406b720 0x7f02f415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 --2- 172.21.15.110:0/2292161071 >> v2:172.21.15.154:3300/0 conn(0x7f02f406beb0 0x7f02f406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 --2- 172.21.15.110:0/2292161071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f4154550 0x7f02f40c7180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- 172.21.15.110:0/2292161071 >> 172.21.15.110:0/2292161071 conn(0x7f02f406e3d0 msgr2=0x7f02f4071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:48.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- 172.21.15.110:0/2292161071 shutdown_connections 2024-04-21T22:53:48.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- 172.21.15.110:0/2292161071 wait complete. 2024-04-21T22:53:48.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 Processor -- start 2024-04-21T22:53:48.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- start start 2024-04-21T22:53:48.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f406b720 0x7f02f4074700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02f406beb0 0x7f02f4152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f4154550 0x7f02f41f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:48.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f02f415e700 con 0x7f02f406b720 2024-04-21T22:53:48.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02f415acc0 con 0x7f02f406beb0 2024-04-21T22:53:48.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02fab2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f02f415e880 con 0x7f02f4154550 2024-04-21T22:53:48.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.794+0000 7f02f88c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f406b720 0x7f02f4074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f88c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f406b720 0x7f02f4074700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35618/0 (socket says 172.21.15.110:35618) 2024-04-21T22:53:48.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f88c8640 1 -- 172.21.15.110:0/1969994328 learned_addr learned my addr 172.21.15.110:0/1969994328 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:48.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f90c9640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f4154550 0x7f02f41f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f3fff640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02f406beb0 0x7f02f4152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:48.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f88c8640 1 -- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f4154550 msgr2=0x7f02f41f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f88c8640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f4154550 0x7f02f41f70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f88c8640 1 -- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02f406beb0 msgr2=0x7f02f4152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:48.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f88c8640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02f406beb0 0x7f02f4152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:48.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.798+0000 7f02f88c8640 1 -- 172.21.15.110:0/1969994328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f40caf50 con 0x7f02f406b720 2024-04-21T22:53:48.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.802+0000 7f02f88c8640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f406b720 0x7f02f4074700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f02e401a120 tx=0x7f02e4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:48.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.806+0000 7f02f17fa640 1 -- 172.21.15.110:0/1969994328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e40ba020 con 0x7f02f406b720 2024-04-21T22:53:48.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.806+0000 7f02f17fa640 1 -- 172.21.15.110:0/1969994328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e40b2040 con 0x7f02f406b720 2024-04-21T22:53:48.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.806+0000 7f02f17fa640 1 -- 172.21.15.110:0/1969994328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e40b1050 con 0x7f02f406b720 2024-04-21T22:53:48.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.806+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f40cb550 con 0x7f02f406b720 2024-04-21T22:53:48.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.806+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f40cbad0 con 0x7f02f406b720 2024-04-21T22:53:48.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:48.806+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f404f510 con 0x7f02f406b720 2024-04-21T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.094+0000 7f02f17fa640 1 -- 172.21.15.110:0/1969994328 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02e40bd020 con 0x7f02f406b720 2024-04-21T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.094+0000 7f02f17fa640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f02e0067910 0x7f02e0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.094+0000 7f02f3fff640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f02e0067910 0x7f02e0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.094+0000 7f02f3fff640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f02e0067910 0x7f02e0069dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f02f414e960 tx=0x7f02e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.130+0000 7f02f17fa640 1 -- 172.21.15.110:0/1969994328 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f02e40edec0 con 0x7f02f406b720 2024-04-21T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.130+0000 7f02f17fa640 1 -- 172.21.15.110:0/1969994328 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f02e40c4020 con 0x7f02f406b720 2024-04-21T22:53:49.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.342+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f02f406c7d0 con 0x7f02f406b720 2024-04-21T22:53:49.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.614+0000 7f02f17fa640 1 -- 172.21.15.110:0/1969994328 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166894 (secure 0 0 0) 0x7f02e4016110 con 0x7f02f406b720 2024-04-21T22:53:49.616 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f02e0067910 msgr2=0x7f02e0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f02e0067910 0x7f02e0069dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f02f414e960 tx=0x7f02e8008040 comp rx=0 tx=0).stop 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f406b720 msgr2=0x7f02f4074700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f406b720 0x7f02f4074700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f02e401a120 tx=0x7f02e4019290 comp rx=0 tx=0).stop 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 shutdown_connections 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f02e0067910 0x7f02e0069dd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02f4154550 0x7f02f41f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02f406beb0 0x7f02f4152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 --2- 172.21.15.110:0/1969994328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02f406b720 0x7f02f4074700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 >> 172.21.15.110:0/1969994328 conn(0x7f02f406e3d0 msgr2=0x7f02f41488d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 shutdown_connections 2024-04-21T22:53:49.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.618+0000 7f02fab2c640 1 -- 172.21.15.110:0/1969994328 wait complete. 2024-04-21T22:53:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3950016020},{"type":"v1","addr":"172.21.15.110:6801","nonce":3950016020}]},"active_addr":"172.21.15.110:6801/3950016020","active_change":"2024-04-21T22:52:40.865722+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":4012074451}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2535724254}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1880185487}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2021825633}]}]} 2024-04-21T22:53:49.642 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-21T22:53:49.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-21T22:53:49.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:49.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36bdeeb640 1 Processor -- start 2024-04-21T22:53:49.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36bdeeb640 1 -- start start 2024-04-21T22:53:49.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36bdeeb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36b806bd60 0x7f36b80c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36bdeeb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b815a390 con 0x7f36b80cc000 2024-04-21T22:53:49.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36bdeeb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b806b600 con 0x7f36b8154600 2024-04-21T22:53:49.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36bdeeb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f36b81549e0 con 0x7f36b806bd60 2024-04-21T22:53:49.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36b7fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f36b80cc000 0x7f36b8164c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36020/0 (socket says 172.21.15.110:36020) 2024-04-21T22:53:49.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36b7fff640 1 -- 172.21.15.110:0/3708796435 learned_addr learned my addr 172.21.15.110:0/3708796435 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:49.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.762+0000 7f36b6ffd640 1 --2- 172.21.15.110:0/3708796435 >> v2:172.21.15.154:3300/0 conn(0x7f36b806bd60 0x7f36b80c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.766+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413967494 0 0) 0x7f36b815a390 con 0x7f36b80cc000 2024-04-21T22:53:49.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.766+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a0003530 con 0x7f36b80cc000 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 520518611 0 0) 0x7f36a0003530 con 0x7f36b80cc000 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 >> v2:172.21.15.154:3300/0 conn(0x7f36b806bd60 msgr2=0x7f36b80c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 --2- 172.21.15.110:0/3708796435 >> v2:172.21.15.154:3300/0 conn(0x7f36b806bd60 0x7f36b80c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 >> v1:172.21.15.154:6789/0 conn(0x7f36b8154600 legacy=0x7f36b815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b815a630 con 0x7f36b80cc000 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f36b0001a00 con 0x7f36b80cc000 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 >> v1:172.21.15.110:6789/0 conn(0x7f36b80cc000 legacy=0x7f36b8164c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36a0003a10 0x7f36a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36a0004810 0x7f36a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f36a000c050 con 0x7f36a00051d0 2024-04-21T22:53:49.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36a000c200 con 0x7f36a0004810 2024-04-21T22:53:49.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f36a000c400 con 0x7f36a0003a10 2024-04-21T22:53:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.770+0000 7f36b77fe640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36a0003a10 0x7f36a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.774+0000 7f36b7fff640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.774+0000 7f36b7fff640 1 -- 172.21.15.110:0/3708796435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36a0003a10 msgr2=0x7f36a0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:49.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.774+0000 7f36b7fff640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36a0003a10 0x7f36a0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.774+0000 7f36b7fff640 1 -- 172.21.15.110:0/3708796435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36a0004810 msgr2=0x7f36a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:49.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.774+0000 7f36b7fff640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36a0004810 0x7f36a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.774+0000 7f36b7fff640 1 -- 172.21.15.110:0/3708796435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a0003530 con 0x7f36a00051d0 2024-04-21T22:53:49.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.778+0000 7f36b7fff640 1 -- 172.21.15.110:0/3708796435 reap_dead start 2024-04-21T22:53:49.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.778+0000 7f36b7fff640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36a000b9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36b000a7b0 tx=0x7f36b001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a304842c6ef88e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:49.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b000a3d0 con 0x7f36a00051d0 2024-04-21T22:53:49.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b00ac660 con 0x7f36a00051d0 2024-04-21T22:53:49.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36b67fc640 1 -- 172.21.15.110:0/3708796435 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b00aca50 con 0x7f36a00051d0 2024-04-21T22:53:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36bdeeb640 1 -- 172.21.15.110:0/3708796435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 msgr2=0x7f36a000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36a000b9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36b000a7b0 tx=0x7f36b001d2c0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36bdeeb640 1 -- 172.21.15.110:0/3708796435 shutdown_connections 2024-04-21T22:53:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/3708796435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36a000b9d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36bdeeb640 1 -- 172.21.15.110:0/3708796435 >> 172.21.15.110:0/3708796435 conn(0x7f36b8071f90 msgr2=0x7f36b80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36bdeeb640 1 -- 172.21.15.110:0/3708796435 shutdown_connections 2024-04-21T22:53:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.782+0000 7f36bdeeb640 1 -- 172.21.15.110:0/3708796435 wait complete. 2024-04-21T22:53:49.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 Processor -- start 2024-04-21T22:53:49.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 -- start start 2024-04-21T22:53:49.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36b80c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b814dee0 0x7f36b80c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b8142f80 0x7f36b80c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f36b815b110 con 0x7f36a00051d0 2024-04-21T22:53:49.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36b815ac80 con 0x7f36b814dee0 2024-04-21T22:53:49.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36bdeeb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f36b815b290 con 0x7f36b8142f80 2024-04-21T22:53:49.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36b80c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36b80c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60070/0 (socket says 172.21.15.110:60070) 2024-04-21T22:53:49.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36b77fe640 1 -- 172.21.15.110:0/2578591251 learned_addr learned my addr 172.21.15.110:0/2578591251 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:49.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36b6ffd640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b814dee0 0x7f36b80c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.786+0000 7f36b7fff640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b8142f80 0x7f36b80c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.790+0000 7f36b77fe640 1 -- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b8142f80 msgr2=0x7f36b80c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:49.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.790+0000 7f36b77fe640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b8142f80 0x7f36b80c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.790+0000 7f36b77fe640 1 -- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b814dee0 msgr2=0x7f36b80c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:49.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.790+0000 7f36b77fe640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b814dee0 0x7f36b80c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:49.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.790+0000 7f36b77fe640 1 -- 172.21.15.110:0/2578591251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b81f0260 con 0x7f36a00051d0 2024-04-21T22:53:49.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.794+0000 7f36b77fe640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36b80c57f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36a800f670 tx=0x7f36a800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:49.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.794+0000 7f369ffff640 1 -- 172.21.15.110:0/2578591251 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80050d0 con 0x7f36a00051d0 2024-04-21T22:53:49.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.794+0000 7f369ffff640 1 -- 172.21.15.110:0/2578591251 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a8018070 con 0x7f36a00051d0 2024-04-21T22:53:49.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.794+0000 7f369ffff640 1 -- 172.21.15.110:0/2578591251 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a800d730 con 0x7f36a00051d0 2024-04-21T22:53:49.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.794+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b81f0540 con 0x7f36a00051d0 2024-04-21T22:53:49.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.798+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b81f0b00 con 0x7f36a00051d0 2024-04-21T22:53:49.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.798+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b804f510 con 0x7f36a00051d0 2024-04-21T22:53:49.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.814+0000 7f369ffff640 1 -- 172.21.15.110:0/2578591251 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36a800d8d0 con 0x7f36a00051d0 2024-04-21T22:53:49.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.818+0000 7f369ffff640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f36a4067910 0x7f36a4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:49.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.818+0000 7f36b6ffd640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f36a4067910 0x7f36a4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:49.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:49.818+0000 7f36b6ffd640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f36a4067910 0x7f36a4069dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36b81429e0 tx=0x7f36ac009320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.118+0000 7f369ffff640 1 -- 172.21.15.110:0/2578591251 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f36a80549e0 con 0x7f36a00051d0 2024-04-21T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.118+0000 7f369ffff640 1 -- 172.21.15.110:0/2578591251 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f36a8056940 con 0x7f36a00051d0 2024-04-21T22:53:50.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.286+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36b8158530 con 0x7f36a00051d0 2024-04-21T22:53:50.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.358+0000 7f369ffff640 1 -- 172.21.15.110:0/2578591251 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f36a805ac40 con 0x7f36a00051d0 2024-04-21T22:53:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:50.359 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:50.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f36a4067910 msgr2=0x7f36a4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:50.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f36a4067910 0x7f36a4069dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36b81429e0 tx=0x7f36ac009320 comp rx=0 tx=0).stop 2024-04-21T22:53:50.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 msgr2=0x7f36b80c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:50.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36b80c57f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36a800f670 tx=0x7f36a800fb30 comp rx=0 tx=0).stop 2024-04-21T22:53:50.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 shutdown_connections 2024-04-21T22:53:50.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f36a4067910 0x7f36a4069dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:50.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b8142f80 0x7f36b80c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:50.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b814dee0 0x7f36b80c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:50.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 --2- 172.21.15.110:0/2578591251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00051d0 0x7f36b80c57f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:50.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 >> 172.21.15.110:0/2578591251 conn(0x7f36b8071f90 msgr2=0x7f36b8158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:50.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 shutdown_connections 2024-04-21T22:53:50.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.362+0000 7f36bdeeb640 1 -- 172.21.15.110:0/2578591251 wait complete. 2024-04-21T22:53:50.381 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-21T22:53:50.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:50.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7feda5788640 1 Processor -- start 2024-04-21T22:53:50.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7feda5788640 1 -- start start 2024-04-21T22:53:50.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7feda5788640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feda0061ff0 0x7feda006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:50.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7feda5788640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda0154930 con 0x7feda006f390 2024-04-21T22:53:50.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7feda5788640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda015ae30 con 0x7feda0154550 2024-04-21T22:53:50.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7feda5788640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7feda00c8020 con 0x7feda0061ff0 2024-04-21T22:53:50.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7fed9e7fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feda0061ff0 0x7feda006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:50.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7fed9f7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7feda006f390 0x7feda0164bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36024/0 (socket says 172.21.15.110:36024) 2024-04-21T22:53:50.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.506+0000 7fed9f7fe640 1 -- 172.21.15.110:0/3810852376 learned_addr learned my addr 172.21.15.110:0/3810852376 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:50.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.510+0000 7fed9e7fc640 1 -- 172.21.15.110:0/3810852376 >> v1:172.21.15.154:6789/0 conn(0x7feda0154550 legacy=0x7feda006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:50.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.510+0000 7fed9e7fc640 1 -- 172.21.15.110:0/3810852376 >> v1:172.21.15.110:6789/0 conn(0x7feda006f390 legacy=0x7feda0164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:50.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.510+0000 7fed9e7fc640 1 -- 172.21.15.110:0/3810852376 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda015b110 con 0x7feda0061ff0 2024-04-21T22:53:50.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.514+0000 7fed9e7fc640 1 --2- 172.21.15.110:0/3810852376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0061ff0 0x7feda006b1e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed940097c0 tx=0x7fed9401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47017aa44830aed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:50.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7fed9dffb640 1 -- 172.21.15.110:0/3810852376 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed940b5070 con 0x7feda0061ff0 2024-04-21T22:53:50.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7fed9dffb640 1 -- 172.21.15.110:0/3810852376 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed940a8950 con 0x7feda0061ff0 2024-04-21T22:53:50.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7fed9dffb640 1 -- 172.21.15.110:0/3810852376 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed940a8d20 con 0x7feda0061ff0 2024-04-21T22:53:50.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7feda5788640 1 -- 172.21.15.110:0/3810852376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0061ff0 msgr2=0x7feda006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:50.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7feda5788640 1 --2- 172.21.15.110:0/3810852376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0061ff0 0x7feda006b1e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed940097c0 tx=0x7fed9401ec50 comp rx=0 tx=0).stop 2024-04-21T22:53:50.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7feda5788640 1 -- 172.21.15.110:0/3810852376 shutdown_connections 2024-04-21T22:53:50.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7feda5788640 1 --2- 172.21.15.110:0/3810852376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0061ff0 0x7feda006b1e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:50.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7feda5788640 1 -- 172.21.15.110:0/3810852376 >> 172.21.15.110:0/3810852376 conn(0x7feda00cc250 msgr2=0x7feda00cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:50.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7feda5788640 1 -- 172.21.15.110:0/3810852376 shutdown_connections 2024-04-21T22:53:50.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.522+0000 7feda5788640 1 -- 172.21.15.110:0/3810852376 wait complete. 2024-04-21T22:53:50.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 Processor -- start 2024-04-21T22:53:50.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 -- start start 2024-04-21T22:53:50.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feda0061ff0 0x7feda00c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:50.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feda006f390 0x7feda0159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:50.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0154550 0x7feda0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:50.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7feda00c7cb0 con 0x7feda0154550 2024-04-21T22:53:50.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feda00c79d0 con 0x7feda0061ff0 2024-04-21T22:53:50.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7feda5788640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7feda006e580 con 0x7feda006f390 2024-04-21T22:53:50.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7fed9f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0154550 0x7feda0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:50.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7fed9f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0154550 0x7feda0159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60088/0 (socket says 172.21.15.110:60088) 2024-04-21T22:53:50.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.526+0000 7fed9f7fe640 1 -- 172.21.15.110:0/2873170017 learned_addr learned my addr 172.21.15.110:0/2873170017 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:50.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.530+0000 7fed9e7fc640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feda006f390 0x7feda0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:50.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.530+0000 7fed9effd640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feda0061ff0 0x7feda00c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:50.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.530+0000 7fed9f7fe640 1 -- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feda006f390 msgr2=0x7feda0159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:50.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.530+0000 7fed9f7fe640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feda006f390 0x7feda0159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:50.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.530+0000 7fed9f7fe640 1 -- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feda0061ff0 msgr2=0x7feda00c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:50.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.530+0000 7fed9f7fe640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feda0061ff0 0x7feda00c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:50.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.530+0000 7fed9f7fe640 1 -- 172.21.15.110:0/2873170017 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda01e60e0 con 0x7feda0154550 2024-04-21T22:53:50.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.534+0000 7fed9f7fe640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0154550 0x7feda0159c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed9800cbc0 tx=0x7fed9800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:50.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.542+0000 7fed877fe640 1 -- 172.21.15.110:0/2873170017 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98017070 con 0x7feda0154550 2024-04-21T22:53:50.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.542+0000 7fed877fe640 1 -- 172.21.15.110:0/2873170017 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9800ad40 con 0x7feda0154550 2024-04-21T22:53:50.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.542+0000 7fed877fe640 1 -- 172.21.15.110:0/2873170017 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98012600 con 0x7feda0154550 2024-04-21T22:53:50.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.542+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda01f3700 con 0x7feda0154550 2024-04-21T22:53:50.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.542+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda01f3c80 con 0x7feda0154550 2024-04-21T22:53:50.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.542+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda004f510 con 0x7feda0154550 2024-04-21T22:53:50.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.818+0000 7fed877fe640 1 -- 172.21.15.110:0/2873170017 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed9801a070 con 0x7feda0154550 2024-04-21T22:53:50.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.818+0000 7fed877fe640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fed8c067910 0x7fed8c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:50.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.818+0000 7fed9effd640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fed8c067910 0x7fed8c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:50.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.822+0000 7fed9effd640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fed8c067910 0x7fed8c069dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feda014a7f0 tx=0x7fed90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:50.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.854+0000 7fed877fe640 1 -- 172.21.15.110:0/2873170017 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fed980543a0 con 0x7feda0154550 2024-04-21T22:53:50.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:50.854+0000 7fed877fe640 1 -- 172.21.15.110:0/2873170017 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7feda01e60e0 con 0x7feda0154550 2024-04-21T22:53:51.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.022+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feda006c8b0 con 0x7feda0154550 2024-04-21T22:53:51.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.062+0000 7fed877fe640 1 -- 172.21.15.110:0/2873170017 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7fed98056300 con 0x7feda0154550 2024-04-21T22:53:51.063 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:51.063 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fed8c067910 msgr2=0x7fed8c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fed8c067910 0x7fed8c069dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feda014a7f0 tx=0x7fed90008040 comp rx=0 tx=0).stop 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0154550 msgr2=0x7feda0159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0154550 0x7feda0159c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed9800cbc0 tx=0x7fed9800a430 comp rx=0 tx=0).stop 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 shutdown_connections 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fed8c067910 0x7fed8c069dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feda0154550 0x7feda0159c50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feda006f390 0x7feda0159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 --2- 172.21.15.110:0/2873170017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feda0061ff0 0x7feda00c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 >> 172.21.15.110:0/2873170017 conn(0x7feda00cc250 msgr2=0x7feda01509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 shutdown_connections 2024-04-21T22:53:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.066+0000 7feda5788640 1 -- 172.21.15.110:0/2873170017 wait complete. 2024-04-21T22:53:51.084 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-21T22:53:51.084 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-21T22:53:51.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-21T22:53:51.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-21T22:53:51.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-21T22:53:51.086 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-21T22:53:51.086 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-21T22:53:51.087 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-21T22:53:51.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.262+0000 7fd09339c640 1 Processor -- start 2024-04-21T22:53:51.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.262+0000 7fd09339c640 1 -- start start 2024-04-21T22:53:51.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.262+0000 7fd09339c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c151410 0x7fd08c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.262+0000 7fd09339c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08c0c9830 0x7fd08c0c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.262+0000 7fd09339c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08c0c8ae0 con 0x7fd08c151030 2024-04-21T22:53:51.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.262+0000 7fd09339c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd08c0c3fa0 con 0x7fd08c0c9830 2024-04-21T22:53:51.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.262+0000 7fd09339c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd08c0c4280 con 0x7fd08c151410 2024-04-21T22:53:51.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fd091939640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08c0c9830 0x7fd08c0c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fd090937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c151410 0x7fd08c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f1245b39640 1 Processor -- start 2024-04-21T22:53:51.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fd090937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c151410 0x7fd08c0c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48134/0 (socket says 172.21.15.110:48134) 2024-04-21T22:53:51.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fd090937640 1 -- 172.21.15.110:0/2113037041 learned_addr learned my addr 172.21.15.110:0/2113037041 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f1245b39640 1 -- start start 2024-04-21T22:53:51.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fe109229640 1 Processor -- start 2024-04-21T22:53:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f1245b39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12380d5000 0x7f123804c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f1245b39640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123804c820 con 0x7f12380347a0 2024-04-21T22:53:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f1245b39640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123804b990 con 0x7f12380db440 2024-04-21T22:53:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f1245b39640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f123804bc70 con 0x7f12380d5000 2024-04-21T22:53:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fe109229640 1 -- start start 2024-04-21T22:53:51.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fc63284f640 1 Processor -- start 2024-04-21T22:53:51.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f123effd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f12380347a0 0x7f12380dad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36030/0 (socket says 172.21.15.110:36030) 2024-04-21T22:53:51.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7f123effd640 1 -- 172.21.15.110:0/349225658 learned_addr learned my addr 172.21.15.110:0/349225658 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:51.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fe109229640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0fc0db440 0x7fe0fc0e6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fe109229640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc04b990 con 0x7fe0fc0347a0 2024-04-21T22:53:51.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fe109229640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc04bc70 con 0x7fe0fc0d5000 2024-04-21T22:53:51.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.266+0000 7fc63284f640 1 -- start start 2024-04-21T22:53:51.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fccb3220640 1 Processor -- start 2024-04-21T22:53:51.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fe109229640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe0fc006a50 con 0x7fe0fc0db440 2024-04-21T22:53:51.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fccb3220640 1 -- start start 2024-04-21T22:53:51.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fc63284f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6240dd4e0 0x7fc62404b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fc63284f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc62404b630 0x7fc6240071a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fc63284f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6240dd8c0 con 0x7fc6240076e0 2024-04-21T22:53:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fc63284f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc6240e7690 con 0x7fc6240dd4e0 2024-04-21T22:53:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fc63284f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc6240e73f0 con 0x7fc62404b630 2024-04-21T22:53:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 Processor -- start 2024-04-21T22:53:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 -- start start 2024-04-21T22:53:51.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f7e358b5640 1 Processor -- start 2024-04-21T22:53:51.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f7e358b5640 1 -- start start 2024-04-21T22:53:51.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fccb3220640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcca40d8fb0 0x7fcca4046360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fccb3220640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcca4007ed0 0x7fcca40468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fccb3220640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca40deec0 con 0x7fcca4047150 2024-04-21T22:53:51.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fccb3220640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fcca40df160 con 0x7fcca40d8fb0 2024-04-21T22:53:51.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fccb3220640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcca40df440 con 0x7fcca4007ed0 2024-04-21T22:53:51.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fe10259c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe0fc0347a0 0x7fe0fc0dad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36042/0 (socket says 172.21.15.110:36042) 2024-04-21T22:53:51.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fe10259c640 1 -- 172.21.15.110:0/4194501092 learned_addr learned my addr 172.21.15.110:0/4194501092 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:51.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fe10359e640 1 --2- 172.21.15.110:0/4194501092 >> v2:172.21.15.110:3300/0 conn(0x7fe0fc0db440 0x7fe0fc0e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22cc0d6ec0 0x7f22cc0dd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc047280 0x7f22cc04e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22cc0476a0 0x7f22cc04ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f22cc0ddb10 con 0x7f22cc0476a0 2024-04-21T22:53:51.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f22cc0e1060 con 0x7f22cc0d6ec0 2024-04-21T22:53:51.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f22d9099640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f22cc0d72a0 con 0x7f22cc047280 2024-04-21T22:53:51.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7fc62bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6240dd4e0 0x7fc62404b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f7e358b5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e2804c650 0x7f7e28007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f7e358b5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e280dd8c0 con 0x7f7e2804b160 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f7e358b5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2804cce0 con 0x7f7e280dd4e0 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.270+0000 7f7e358b5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7e28006fa0 con 0x7f7e2804c650 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7fd090937640 1 -- 172.21.15.110:0/2113037041 >> v2:172.21.15.154:3300/0 conn(0x7fd08c0c9830 msgr2=0x7fd08c0c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7fd090937640 1 --2- 172.21.15.110:0/2113037041 >> v2:172.21.15.154:3300/0 conn(0x7fd08c0c9830 0x7fd08c0c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7fd090937640 1 -- 172.21.15.110:0/2113037041 >> v1:172.21.15.154:6789/0 conn(0x7fd08c151030 legacy=0x7fd08c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7fd090937640 1 -- 172.21.15.110:0/2113037041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c0c4560 con 0x7fd08c151410 2024-04-21T22:53:51.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7fe10359e640 1 -- 172.21.15.110:0/4194501092 >> v1:172.21.15.154:6789/0 conn(0x7fe0fc0d5000 legacy=0x7fe0fc04c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7fe10359e640 1 -- 172.21.15.110:0/4194501092 >> v1:172.21.15.110:6789/0 conn(0x7fe0fc0347a0 legacy=0x7fe0fc0dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7fe10359e640 1 -- 172.21.15.110:0/4194501092 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc006d30 con 0x7fe0fc0db440 2024-04-21T22:53:51.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.274+0000 7f22d259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc047280 0x7f22cc04e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.278+0000 7fc62bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6240dd4e0 0x7fc62404b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60112/0 (socket says 172.21.15.110:60112) 2024-04-21T22:53:51.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.278+0000 7fc62bfff640 1 -- 172.21.15.110:0/1679493660 learned_addr learned my addr 172.21.15.110:0/1679493660 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.278+0000 7f22d259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc047280 0x7f22cc04e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48138/0 (socket says 172.21.15.110:48138) 2024-04-21T22:53:51.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.278+0000 7f22d259c640 1 -- 172.21.15.110:0/1819973899 learned_addr learned my addr 172.21.15.110:0/1819973899 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.278+0000 7f123f7fe640 1 --2- 172.21.15.110:0/349225658 >> v2:172.21.15.154:3300/0 conn(0x7f12380d5000 0x7f123804c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7fd090937640 1 --2- 172.21.15.110:0/2113037041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c151410 0x7fd08c0c9140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00bb10 tx=0x7fd07c01eb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18cc36c42b0ebd64 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7fe10359e640 1 --2- 172.21.15.110:0/4194501092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0db440 0x7fe0fc0e6640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe104000b70 tx=0x7fe10409ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50605b008aa0f76 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7f0268eb1640 1 Processor -- start 2024-04-21T22:53:51.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7fccb0fbc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcca40d8fb0 0x7fcca4046360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7f0268eb1640 1 -- start start 2024-04-21T22:53:51.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7f0268eb1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f026406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7f0268eb1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02640cd9b0 con 0x7f026406c380 2024-04-21T22:53:51.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7f0268eb1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f026415a5d0 con 0x7f02640cf250 2024-04-21T22:53:51.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7f0268eb1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f026415a8b0 con 0x7f02640ce570 2024-04-21T22:53:51.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7fccb0fbc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcca40d8fb0 0x7fcca4046360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60116/0 (socket says 172.21.15.110:60116) 2024-04-21T22:53:51.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.282+0000 7fccb0fbc640 1 -- 172.21.15.110:0/395868858 learned_addr learned my addr 172.21.15.110:0/395868858 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fc62bfff640 1 -- 172.21.15.110:0/1679493660 >> v2:172.21.15.154:3300/0 conn(0x7fc62404b630 msgr2=0x7fc6240071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fc62bfff640 1 --2- 172.21.15.110:0/1679493660 >> v2:172.21.15.154:3300/0 conn(0x7fc62404b630 0x7fc6240071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fc62bfff640 1 -- 172.21.15.110:0/1679493660 >> v1:172.21.15.154:6789/0 conn(0x7fc6240076e0 legacy=0x7fc6240e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fc62bfff640 1 -- 172.21.15.110:0/1679493660 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc624006400 con 0x7fc6240dd4e0 2024-04-21T22:53:51.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fccabfff640 1 --2- 172.21.15.110:0/395868858 >> v2:172.21.15.154:3300/0 conn(0x7fcca4007ed0 0x7fcca40468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7f123e7fc640 1 -- 172.21.15.110:0/349225658 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327031003 0 0) 0x7f122c001120 con 0x7f12380347a0 2024-04-21T22:53:51.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7f123e7fc640 1 -- 172.21.15.110:0/349225658 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1230003530 con 0x7f12380347a0 2024-04-21T22:53:51.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fccb0fbc640 1 -- 172.21.15.110:0/395868858 >> v2:172.21.15.154:3300/0 conn(0x7fcca4007ed0 msgr2=0x7fcca40468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fccb0fbc640 1 --2- 172.21.15.110:0/395868858 >> v2:172.21.15.154:3300/0 conn(0x7fcca4007ed0 0x7fcca40468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fccb0fbc640 1 -- 172.21.15.110:0/395868858 >> v1:172.21.15.154:6789/0 conn(0x7fcca4047150 legacy=0x7fcca404bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.286+0000 7fccb0fbc640 1 -- 172.21.15.110:0/395868858 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca40df720 con 0x7fcca40d8fb0 2024-04-21T22:53:51.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.290+0000 7f0262d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f026406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.290+0000 7f123f7fe640 1 -- 172.21.15.110:0/349225658 >> v1:172.21.15.154:6789/0 conn(0x7f12380db440 legacy=0x7f12380e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.290+0000 7f123f7fe640 1 -- 172.21.15.110:0/349225658 >> v1:172.21.15.110:6789/0 conn(0x7f12380347a0 legacy=0x7f12380dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.290+0000 7f123f7fe640 1 -- 172.21.15.110:0/349225658 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1238006a50 con 0x7f12380d5000 2024-04-21T22:53:51.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f7e2ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e2804c650 0x7f7e28007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f22d259c640 1 -- 172.21.15.110:0/1819973899 >> v2:172.21.15.154:3300/0 conn(0x7f22cc0d6ec0 msgr2=0x7f22cc0dd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f22d259c640 1 --2- 172.21.15.110:0/1819973899 >> v2:172.21.15.154:3300/0 conn(0x7f22cc0d6ec0 0x7f22cc0dd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f22d259c640 1 -- 172.21.15.110:0/1819973899 >> v2:172.21.15.110:3300/0 conn(0x7f22cc0476a0 msgr2=0x7f22cc04ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f22d259c640 1 --2- 172.21.15.110:0/1819973899 >> v2:172.21.15.110:3300/0 conn(0x7f22cc0476a0 0x7f22cc04ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f22d259c640 1 -- 172.21.15.110:0/1819973899 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc04d540 con 0x7f22cc047280 2024-04-21T22:53:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f0262d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f026406c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48148/0 (socket says 172.21.15.110:48148) 2024-04-21T22:53:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f0262d9d640 1 -- 172.21.15.110:0/331817176 learned_addr learned my addr 172.21.15.110:0/331817176 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7fc62bfff640 1 --2- 172.21.15.110:0/1679493660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240dd4e0 0x7fc62404b0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6240e7810 tx=0x7fc62001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bdc72133c43505 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f7e2ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e2804c650 0x7f7e28007430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60132/0 (socket says 172.21.15.110:60132) 2024-04-21T22:53:51.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.294+0000 7f7e2ffff640 1 -- 172.21.15.110:0/2646256199 learned_addr learned my addr 172.21.15.110:0/2646256199 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.298+0000 7fccb0fbc640 1 --2- 172.21.15.110:0/395868858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40d8fb0 0x7fcca4046360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcca400ab70 tx=0x7fcca001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f92c884fd1c7bc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.298+0000 7f7e2ffff640 1 -- 172.21.15.110:0/2646256199 >> v1:172.21.15.154:6789/0 conn(0x7f7e280dd4e0 legacy=0x7f7e280e7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.298+0000 7f7e2ffff640 1 -- 172.21.15.110:0/2646256199 >> v1:172.21.15.110:6789/0 conn(0x7f7e2804b160 legacy=0x7f7e280eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.298+0000 7f7e2ffff640 1 -- 172.21.15.110:0/2646256199 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e28006390 con 0x7f7e2804c650 2024-04-21T22:53:51.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7f7e2ffff640 1 --2- 172.21.15.110:0/2646256199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804c650 0x7f7e28007430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009870 tx=0x7f7e1c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5255d7adba56b7f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7f123f7fe640 1 --2- 172.21.15.110:0/349225658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f123804c2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12340097c0 tx=0x7f123401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fdc74eca58f8641 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7f0262d9d640 1 -- 172.21.15.110:0/331817176 >> v1:172.21.15.154:6789/0 conn(0x7f02640cf250 legacy=0x7f02640cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7f0262d9d640 1 -- 172.21.15.110:0/331817176 >> v1:172.21.15.110:6789/0 conn(0x7f026406c380 legacy=0x7f02640ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7f0262d9d640 1 -- 172.21.15.110:0/331817176 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026415ab90 con 0x7f02640ce570 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe101d9b640 1 -- 172.21.15.110:0/4194501092 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104132070 con 0x7fe0fc0db440 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe101d9b640 1 -- 172.21.15.110:0/4194501092 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe104125810 con 0x7fe0fc0db440 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe101d9b640 1 -- 172.21.15.110:0/4194501092 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104125c80 con 0x7fe0fc0db440 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe109229640 1 -- 172.21.15.110:0/4194501092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0db440 msgr2=0x7fe0fc0e6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe109229640 1 --2- 172.21.15.110:0/4194501092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0db440 0x7fe0fc0e6640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe104000b70 tx=0x7fe10409ba20 comp rx=0 tx=0).stop 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe109229640 1 -- 172.21.15.110:0/4194501092 shutdown_connections 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe109229640 1 --2- 172.21.15.110:0/4194501092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0db440 0x7fe0fc0e6640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.306+0000 7fe109229640 1 -- 172.21.15.110:0/4194501092 >> 172.21.15.110:0/4194501092 conn(0x7fe0fc050190 msgr2=0x7fe0fc0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 -- 172.21.15.110:0/4194501092 shutdown_connections 2024-04-21T22:53:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 -- 172.21.15.110:0/4194501092 wait complete. 2024-04-21T22:53:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 Processor -- start 2024-04-21T22:53:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 -- start start 2024-04-21T22:53:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7f22d259c640 1 --2- 172.21.15.110:0/1819973899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc047280 0x7f22cc04e910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22cc04f8f0 tx=0x7f22c401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=622e705c24ed3b8c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0fc0347a0 0x7fe0fc0d78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0d5000 0x7fe0fc0d7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0fc0db440 0x7fe0fc0d58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0d53e0 con 0x7fe0fc0d5000 2024-04-21T22:53:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc045130 con 0x7fe0fc0347a0 2024-04-21T22:53:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.310+0000 7fe109229640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc034c10 con 0x7fe0fc0db440 2024-04-21T22:53:51.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.314+0000 7fc62affd640 1 -- 172.21.15.110:0/1679493660 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6200ab5f0 con 0x7fc6240dd4e0 2024-04-21T22:53:51.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.314+0000 7fc62affd640 1 -- 172.21.15.110:0/1679493660 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6200b0070 con 0x7fc6240dd4e0 2024-04-21T22:53:51.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.314+0000 7fc62affd640 1 -- 172.21.15.110:0/1679493660 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6200ab9b0 con 0x7fc6240dd4e0 2024-04-21T22:53:51.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.314+0000 7fc63284f640 1 -- 172.21.15.110:0/1679493660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240dd4e0 msgr2=0x7fc62404b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.314+0000 7fc63284f640 1 --2- 172.21.15.110:0/1679493660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240dd4e0 0x7fc62404b0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6240e7810 tx=0x7fc62001c4e0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- 172.21.15.110:0/1679493660 shutdown_connections 2024-04-21T22:53:51.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 --2- 172.21.15.110:0/1679493660 >> v2:172.21.15.154:3300/0 conn(0x7fc62404b630 0x7fc6240071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 --2- 172.21.15.110:0/1679493660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240dd4e0 0x7fc62404b0f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- 172.21.15.110:0/1679493660 >> 172.21.15.110:0/1679493660 conn(0x7fc6240505e0 msgr2=0x7fc6240509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- 172.21.15.110:0/1679493660 shutdown_connections 2024-04-21T22:53:51.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- 172.21.15.110:0/1679493660 wait complete. 2024-04-21T22:53:51.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f0262d9d640 1 --2- 172.21.15.110:0/331817176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f026406c760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f025c009e80 tx=0x7f025c01f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ae976767f4d1fb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 Processor -- start 2024-04-21T22:53:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- start start 2024-04-21T22:53:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e2f7fe640 1 -- 172.21.15.110:0/2646256199 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0b5070 con 0x7f7e2804c650 2024-04-21T22:53:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e2f7fe640 1 -- 172.21.15.110:0/2646256199 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0a89d0 con 0x7f7e2804c650 2024-04-21T22:53:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e2f7fe640 1 -- 172.21.15.110:0/2646256199 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0a8da0 con 0x7f7e2804c650 2024-04-21T22:53:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240076e0 0x7fc624047960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62404b630 0x7fc6240d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6240dd4e0 0x7fc6240e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc62404c010 con 0x7fc6240076e0 2024-04-21T22:53:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc624006c80 con 0x7fc62404b630 2024-04-21T22:53:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fc63284f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc62404c190 con 0x7fc6240dd4e0 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 -- 172.21.15.110:0/2646256199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804c650 msgr2=0x7f7e28007430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 --2- 172.21.15.110:0/2646256199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804c650 0x7f7e28007430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009870 tx=0x7f7e1c01ecd0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 -- 172.21.15.110:0/2646256199 shutdown_connections 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 --2- 172.21.15.110:0/2646256199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804c650 0x7f7e28007430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 -- 172.21.15.110:0/2646256199 >> 172.21.15.110:0/2646256199 conn(0x7f7e280505e0 msgr2=0x7f7e280509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 -- 172.21.15.110:0/2646256199 shutdown_connections 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 -- 172.21.15.110:0/2646256199 wait complete. 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 Processor -- start 2024-04-21T22:53:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7f7e358b5640 1 -- start start 2024-04-21T22:53:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fccab7fe640 1 -- 172.21.15.110:0/395868858 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca00b5070 con 0x7fcca40d8fb0 2024-04-21T22:53:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fccab7fe640 1 -- 172.21.15.110:0/395868858 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca00a89d0 con 0x7fcca40d8fb0 2024-04-21T22:53:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.318+0000 7fccab7fe640 1 -- 172.21.15.110:0/395868858 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca00a8da0 con 0x7fcca40d8fb0 2024-04-21T22:53:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fe10259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0d5000 0x7fe0fc0d7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7f7e358b5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804b160 0x7f7e280e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7f7e358b5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2804c650 0x7f7e2817a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7f7e358b5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e280dd4e0 0x7f7e2817aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7f7e358b5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28006950 con 0x7f7e2804b160 2024-04-21T22:53:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7f7e358b5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2804ca90 con 0x7f7e280dd4e0 2024-04-21T22:53:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7f7e358b5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7e28006c30 con 0x7f7e2804c650 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- 172.21.15.110:0/395868858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40d8fb0 msgr2=0x7fcca4046360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 --2- 172.21.15.110:0/395868858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40d8fb0 0x7fcca4046360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcca400ab70 tx=0x7fcca001ecd0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- 172.21.15.110:0/395868858 shutdown_connections 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 --2- 172.21.15.110:0/395868858 >> v2:172.21.15.154:3300/0 conn(0x7fcca4007ed0 0x7fcca40468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 --2- 172.21.15.110:0/395868858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40d8fb0 0x7fcca4046360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- 172.21.15.110:0/395868858 >> 172.21.15.110:0/395868858 conn(0x7fcca40512a0 msgr2=0x7fcca40516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- 172.21.15.110:0/395868858 shutdown_connections 2024-04-21T22:53:51.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- 172.21.15.110:0/395868858 wait complete. 2024-04-21T22:53:51.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fe10259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0d5000 0x7fe0fc0d7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60136/0 (socket says 172.21.15.110:60136) 2024-04-21T22:53:51.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fe10259c640 1 -- 172.21.15.110:0/2101084159 learned_addr learned my addr 172.21.15.110:0/2101084159 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 Processor -- start 2024-04-21T22:53:51.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- start start 2024-04-21T22:53:51.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fc62bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240076e0 0x7fc624047960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4047150 0x7fcca40ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcca40d8fb0 0x7fcca4050220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40dd700 0x7fcca4175240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcca40d9390 con 0x7fcca40dd700 2024-04-21T22:53:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcca40476b0 con 0x7fcca4047150 2024-04-21T22:53:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fccb3220640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcca40d9510 con 0x7fcca40d8fb0 2024-04-21T22:53:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fc62bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240076e0 0x7fc624047960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60140/0 (socket says 172.21.15.110:60140) 2024-04-21T22:53:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.322+0000 7fc62bfff640 1 -- 172.21.15.110:0/1240397179 learned_addr learned my addr 172.21.15.110:0/1240397179 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.326+0000 7fe10259c640 1 -- 172.21.15.110:0/2101084159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0fc0db440 msgr2=0x7fe0fc0d58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.326+0000 7fe10259c640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0fc0db440 0x7fe0fc0d58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.326+0000 7fe10259c640 1 -- 172.21.15.110:0/2101084159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0fc0347a0 msgr2=0x7fe0fc0d78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.326+0000 7fe10259c640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0fc0347a0 0x7fe0fc0d78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.326+0000 7fe10259c640 1 -- 172.21.15.110:0/2101084159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc04b5a0 con 0x7fe0fc0d5000 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd083fff640 1 -- 172.21.15.110:0/2113037041 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0b4070 con 0x7fd08c151410 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd083fff640 1 -- 172.21.15.110:0/2113037041 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c0a79f0 con 0x7fd08c151410 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd083fff640 1 -- 172.21.15.110:0/2113037041 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0a7dc0 con 0x7fd08c151410 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fc62bfff640 1 -- 172.21.15.110:0/1240397179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6240dd4e0 msgr2=0x7fc6240e5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fc62bfff640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6240dd4e0 0x7fc6240e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fc62bfff640 1 -- 172.21.15.110:0/1240397179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62404b630 msgr2=0x7fc6240d89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fc62bfff640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62404b630 0x7fc6240d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fc62bfff640 1 -- 172.21.15.110:0/1240397179 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6240e5650 con 0x7fc6240076e0 2024-04-21T22:53:51.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 -- 172.21.15.110:0/2113037041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c151410 msgr2=0x7fd08c0c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 --2- 172.21.15.110:0/2113037041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c151410 0x7fd08c0c9140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00bb10 tx=0x7fd07c01eb60 comp rx=0 tx=0).stop 2024-04-21T22:53:51.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 -- 172.21.15.110:0/2113037041 shutdown_connections 2024-04-21T22:53:51.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 --2- 172.21.15.110:0/2113037041 >> v2:172.21.15.154:3300/0 conn(0x7fd08c0c9830 0x7fd08c0c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 --2- 172.21.15.110:0/2113037041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c151410 0x7fd08c0c9140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 -- 172.21.15.110:0/2113037041 >> 172.21.15.110:0/2113037041 conn(0x7fd08c06e520 msgr2=0x7fd08c06e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 -- 172.21.15.110:0/2113037041 shutdown_connections 2024-04-21T22:53:51.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 -- 172.21.15.110:0/2113037041 wait complete. 2024-04-21T22:53:51.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 Processor -- start 2024-04-21T22:53:51.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.330+0000 7fd09339c640 1 -- start start 2024-04-21T22:53:51.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.334+0000 7fd09339c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08c0c9830 0x7fd08c13c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.334+0000 7fd09339c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c151030 0x7fd08c13d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.334+0000 7fd09339c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c1408c0 0x7fd08c13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.334+0000 7fd09339c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c06b5b0 con 0x7fd08c0c9830 2024-04-21T22:53:51.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.334+0000 7fd09339c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c06b430 con 0x7fd08c151030 2024-04-21T22:53:51.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.334+0000 7fd09339c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd08c06b730 con 0x7fd08c1408c0 2024-04-21T22:53:51.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.334+0000 7fe10259c640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0d5000 0x7fe0fc0d7e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800c430 tx=0x7fe0f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d1d9b640 1 -- 172.21.15.110:0/1819973899 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b2070 con 0x7f22cc047280 2024-04-21T22:53:51.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d1d9b640 1 -- 172.21.15.110:0/1819973899 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c40a9070 con 0x7f22cc047280 2024-04-21T22:53:51.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d1d9b640 1 -- 172.21.15.110:0/1819973899 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40ad880 con 0x7f22cc047280 2024-04-21T22:53:51.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- 172.21.15.110:0/1819973899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc047280 msgr2=0x7f22cc04e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 --2- 172.21.15.110:0/1819973899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc047280 0x7f22cc04e910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22cc04f8f0 tx=0x7f22c401c490 comp rx=0 tx=0).stop 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- 172.21.15.110:0/1819973899 shutdown_connections 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 --2- 172.21.15.110:0/1819973899 >> v2:172.21.15.110:3300/0 conn(0x7f22cc0476a0 0x7f22cc04ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 --2- 172.21.15.110:0/1819973899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc047280 0x7f22cc04e910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 --2- 172.21.15.110:0/1819973899 >> v2:172.21.15.154:3300/0 conn(0x7f22cc0d6ec0 0x7f22cc0dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- 172.21.15.110:0/1819973899 >> 172.21.15.110:0/1819973899 conn(0x7f22cc00e0d0 msgr2=0x7f22cc00e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- 172.21.15.110:0/1819973899 shutdown_connections 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- 172.21.15.110:0/1819973899 wait complete. 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 Processor -- start 2024-04-21T22:53:51.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- start start 2024-04-21T22:53:51.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22cc047280 0x7f22cc178740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22cc0476a0 0x7f22cc050210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc0d6ec0 0x7f22cc0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc04d120 con 0x7f22cc047280 2024-04-21T22:53:51.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0e0b40 con 0x7f22cc0476a0 2024-04-21T22:53:51.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f22d9099640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f22cc04d2a0 con 0x7f22cc0d6ec0 2024-04-21T22:53:51.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7f7e348b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804b160 0x7f7e280e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8017070 con 0x7fe0fc0d5000 2024-04-21T22:53:51.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8005cf0 con 0x7fe0fc0d5000 2024-04-21T22:53:51.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc179ce0 con 0x7fe0fc0d5000 2024-04-21T22:53:51.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80072d0 con 0x7fe0fc0d5000 2024-04-21T22:53:51.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.338+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc0d6860 con 0x7fe0fc0d5000 2024-04-21T22:53:51.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f7e348b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804b160 0x7f7e280e5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60142/0 (socket says 172.21.15.110:60142) 2024-04-21T22:53:51.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f7e348b3640 1 -- 172.21.15.110:0/740427292 learned_addr learned my addr 172.21.15.110:0/740427292 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0fc0053a0 con 0x7fe0fc0d5000 2024-04-21T22:53:51.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f123e7fc640 1 -- 172.21.15.110:0/349225658 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340b5070 con 0x7f12380d5000 2024-04-21T22:53:51.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f123e7fc640 1 -- 172.21.15.110:0/349225658 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12340a8950 con 0x7f12380d5000 2024-04-21T22:53:51.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f123e7fc640 1 -- 172.21.15.110:0/349225658 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340a8d20 con 0x7f12380d5000 2024-04-21T22:53:51.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7fccabfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcca40d8fb0 0x7fcca4050220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- 172.21.15.110:0/349225658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 msgr2=0x7f123804c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 --2- 172.21.15.110:0/349225658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f123804c2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12340097c0 tx=0x7f123401ec50 comp rx=0 tx=0).stop 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- 172.21.15.110:0/349225658 shutdown_connections 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 --2- 172.21.15.110:0/349225658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f123804c2e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- 172.21.15.110:0/349225658 >> 172.21.15.110:0/349225658 conn(0x7f1238050190 msgr2=0x7f12380505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- 172.21.15.110:0/349225658 shutdown_connections 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- 172.21.15.110:0/349225658 wait complete. 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 Processor -- start 2024-04-21T22:53:51.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- start start 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380347a0 0x7f12380d7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f12380d9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12380db440 0x7f12380da130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1238045130 con 0x7f12380db440 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1238007010 con 0x7f12380d5000 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.342+0000 7f1245b39640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f12380d53e0 con 0x7f12380347a0 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.346+0000 7f7e348b3640 1 -- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2804c650 msgr2=0x7f7e2817a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.346+0000 7f7e348b3640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2804c650 0x7f7e2817a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.346+0000 7f7e348b3640 1 -- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e280dd4e0 msgr2=0x7f7e2817aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.346+0000 7f7e348b3640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e280dd4e0 0x7f7e2817aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.346+0000 7f7e348b3640 1 -- 172.21.15.110:0/740427292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e280dec40 con 0x7f7e2804b160 2024-04-21T22:53:51.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.350+0000 7fd091939640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c1408c0 0x7fd08c13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.350+0000 7fccabfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcca40d8fb0 0x7fcca4050220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48172/0 (socket says 172.21.15.110:48172) 2024-04-21T22:53:51.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.350+0000 7fccabfff640 1 -- 172.21.15.110:0/2663877317 learned_addr learned my addr 172.21.15.110:0/2663877317 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.354+0000 7f22d2d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22cc047280 0x7f22cc178740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.354+0000 7f7e348b3640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804b160 0x7f7e280e5d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400b410 tx=0x7f7e2400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.354+0000 7fc62bfff640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240076e0 0x7fc624047960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc6200ad040 tx=0x7fc62001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.354+0000 7f22d2d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22cc047280 0x7f22cc178740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60168/0 (socket says 172.21.15.110:60168) 2024-04-21T22:53:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.354+0000 7f22d2d9d640 1 -- 172.21.15.110:0/1684470376 learned_addr learned my addr 172.21.15.110:0/1684470376 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.354+0000 7fccb0fbc640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4047150 0x7fcca40ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.358+0000 7fccb17bd640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40dd700 0x7fcca4175240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7fd090937640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c151030 0x7fd08c13d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7fccabfff640 1 -- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4047150 msgr2=0x7fcca40ddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7fccabfff640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4047150 0x7fcca40ddbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7fccabfff640 1 -- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40dd700 msgr2=0x7fcca4175240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7fccabfff640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcca40dd700 0x7fcca4175240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7fccabfff640 1 -- 172.21.15.110:0/2663877317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca4005cc0 con 0x7fcca40d8fb0 2024-04-21T22:53:51.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7f22d2d9d640 1 -- 172.21.15.110:0/1684470376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc0d6ec0 msgr2=0x7f22cc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7f22d2d9d640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22cc0d6ec0 0x7f22cc0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7f22d2d9d640 1 -- 172.21.15.110:0/1684470376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22cc0476a0 msgr2=0x7f22cc050210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7f22d2d9d640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22cc0476a0 0x7f22cc050210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.362+0000 7f22d2d9d640 1 -- 172.21.15.110:0/1684470376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc0c8660 con 0x7f22cc047280 2024-04-21T22:53:51.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7fd091939640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c1408c0 0x7fd08c13ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48188/0 (socket says 172.21.15.110:48188) 2024-04-21T22:53:51.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7fd091939640 1 -- 172.21.15.110:0/1853678022 learned_addr learned my addr 172.21.15.110:0/1853678022 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0261d9b640 1 -- 172.21.15.110:0/331817176 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0b4070 con 0x7f02640ce570 2024-04-21T22:53:51.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0261d9b640 1 -- 172.21.15.110:0/331817176 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c0af400 con 0x7f02640ce570 2024-04-21T22:53:51.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0261d9b640 1 -- 172.21.15.110:0/331817176 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0af7d0 con 0x7f02640ce570 2024-04-21T22:53:51.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0268eb1640 1 -- 172.21.15.110:0/331817176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 msgr2=0x7f026406c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0268eb1640 1 --2- 172.21.15.110:0/331817176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f026406c760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f025c009e80 tx=0x7f025c01f1c0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0268eb1640 1 -- 172.21.15.110:0/331817176 shutdown_connections 2024-04-21T22:53:51.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0268eb1640 1 --2- 172.21.15.110:0/331817176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f026406c760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.366+0000 7f0268eb1640 1 -- 172.21.15.110:0/331817176 >> 172.21.15.110:0/331817176 conn(0x7f02640b1640 msgr2=0x7f02640b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 -- 172.21.15.110:0/331817176 shutdown_connections 2024-04-21T22:53:51.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 -- 172.21.15.110:0/331817176 wait complete. 2024-04-21T22:53:51.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 Processor -- start 2024-04-21T22:53:51.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 -- start start 2024-04-21T22:53:51.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026406c380 0x7f026415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f0264151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02640cf250 0x7f0264158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f026415a2a0 con 0x7f02640cf250 2024-04-21T22:53:51.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02640cb130 con 0x7f026406c380 2024-04-21T22:53:51.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.370+0000 7f0268eb1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f026415b150 con 0x7f02640ce570 2024-04-21T22:53:51.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7f123effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f12380d9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7f123effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f12380d9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47556/0 (socket says 172.21.15.110:47556) 2024-04-21T22:53:51.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7f123effd640 1 -- 172.21.15.110:0/688594589 learned_addr learned my addr 172.21.15.110:0/688594589 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7fd091939640 1 -- 172.21.15.110:0/1853678022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c151030 msgr2=0x7fd08c13d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7fd091939640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c151030 0x7fd08c13d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7fd091939640 1 -- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08c0c9830 msgr2=0x7fd08c13c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7fd091939640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08c0c9830 0x7fd08c13c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7fd091939640 1 -- 172.21.15.110:0/1853678022 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c140140 con 0x7fd08c1408c0 2024-04-21T22:53:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.386+0000 7fd090937640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c151030 0x7fd08c13d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:53:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.390+0000 7fccabfff640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcca40d8fb0 0x7fcca4050220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c820 tx=0x7fcc9800cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.394+0000 7f026259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026406c380 0x7f026415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6200be5f0 con 0x7fc6240076e0 2024-04-21T22:53:51.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6200be7b0 con 0x7fc6240076e0 2024-04-21T22:53:51.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6200beba0 con 0x7fc6240076e0 2024-04-21T22:53:51.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62404a690 con 0x7fc6240076e0 2024-04-21T22:53:51.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6240dbe70 con 0x7fc6240076e0 2024-04-21T22:53:51.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24015020 con 0x7f7e2804b160 2024-04-21T22:53:51.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24011830 con 0x7f7e2804b160 2024-04-21T22:53:51.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24011c20 con 0x7f7e2804b160 2024-04-21T22:53:51.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e280e0610 con 0x7f7e2804b160 2024-04-21T22:53:51.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.398+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2817a030 con 0x7f7e2804b160 2024-04-21T22:53:51.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc62404a440 con 0x7fc6240076e0 2024-04-21T22:53:51.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e280de9e0 con 0x7f7e2804b160 2024-04-21T22:53:51.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7f123effd640 1 -- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380347a0 msgr2=0x7f12380d7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7f123effd640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380347a0 0x7f12380d7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7f123effd640 1 -- 172.21.15.110:0/688594589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12380db440 msgr2=0x7f12380da130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7f123effd640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12380db440 0x7f12380da130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7f123effd640 1 -- 172.21.15.110:0/688594589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12380492d0 con 0x7f12380d5000 2024-04-21T22:53:51.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.402+0000 7f22d2d9d640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22cc047280 0x7f22cc178740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22d4073d30 tx=0x7f22d4068dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7f026259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026406c380 0x7f026415b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47568/0 (socket says 172.21.15.110:47568) 2024-04-21T22:53:51.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7f026259c640 1 -- 172.21.15.110:0/866078956 learned_addr learned my addr 172.21.15.110:0/866078956 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98015070 con 0x7fcca40d8fb0 2024-04-21T22:53:51.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc98007a30 con 0x7fcca40d8fb0 2024-04-21T22:53:51.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca40d7370 con 0x7fcca40d8fb0 2024-04-21T22:53:51.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98007e20 con 0x7fcca40d8fb0 2024-04-21T22:53:51.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca4175eb0 con 0x7fcca40d8fb0 2024-04-21T22:53:51.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.406+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcca404fdf0 con 0x7fcca40d8fb0 2024-04-21T22:53:51.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.410+0000 7f123effd640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f12380d9bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c790 tx=0x7f122c00cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.410+0000 7f0262d9d640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02640cf250 0x7f0264158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.414+0000 7fd091939640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c1408c0 0x7fd08c13ee20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd08400efc0 tx=0x7fd08400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.418+0000 7f026259c640 1 -- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 msgr2=0x7f0264151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.418+0000 7f026259c640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02640ce570 0x7f0264151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.418+0000 7f026259c640 1 -- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02640cf250 msgr2=0x7f0264158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.418+0000 7f026259c640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02640cf250 0x7f0264158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.418+0000 7f026259c640 1 -- 172.21.15.110:0/866078956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02640b3090 con 0x7f026406c380 2024-04-21T22:53:51.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.426+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0f801a070 con 0x7fe0fc0d5000 2024-04-21T22:53:51.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.426+0000 7fe0eb7fe640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe0f00678c0 0x7fe0f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.426+0000 7fe102d9d640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe0f00678c0 0x7fe0f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.426+0000 7fe102d9d640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe0f00678c0 0x7fe0f0069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007fd0 tx=0x7fe0f40079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.434+0000 7f026259c640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026406c380 0x7f026415b400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c490 tx=0x7f024c001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.434+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c017070 con 0x7f12380d5000 2024-04-21T22:53:51.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.434+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f122c005ac0 con 0x7f12380d5000 2024-04-21T22:53:51.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.434+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c007070 con 0x7f12380d5000 2024-04-21T22:53:51.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.434+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12380328a0 con 0x7f12380d5000 2024-04-21T22:53:51.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.434+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12380d5840 con 0x7f12380d5000 2024-04-21T22:53:51.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.438+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12380053a0 con 0x7f12380d5000 2024-04-21T22:53:51.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.438+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e24018020 con 0x7f7e2804b160 2024-04-21T22:53:51.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.438+0000 7f7e2d7fa640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7e140678c0 0x7f7e14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.438+0000 7f7e2ffff640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7e140678c0 0x7f7e14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.438+0000 7f7e2ffff640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7e140678c0 0x7f7e14069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0b2000 tx=0x7f7e1c004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.442+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe0f8053c90 con 0x7fe0fc0d5000 2024-04-21T22:53:51.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.442+0000 7fe0eb7fe640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fe0f006fa60 0x7fe0f0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.442+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 --> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0f801fe50 con 0x7fe0f006fa60 2024-04-21T22:53:51.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.442+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe0f8051e90 con 0x7fe0fc0d5000 2024-04-21T22:53:51.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.442+0000 7fe10359e640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fe0f006fa60 0x7fe0f0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.442+0000 7fe10359e640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fe0f006fa60 0x7fe0f0071e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.446+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== osd.0 v2:172.21.15.110:6826/2616906515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0f801fe50 con 0x7fe0f006fa60 2024-04-21T22:53:51.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.446+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c017070 con 0x7f026406c380 2024-04-21T22:53:51.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.446+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c003600 con 0x7f026406c380 2024-04-21T22:53:51.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.446+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0264152240 con 0x7f026406c380 2024-04-21T22:53:51.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.446+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c003a30 con 0x7f026406c380 2024-04-21T22:53:51.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.446+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026415d700 con 0x7f026406c380 2024-04-21T22:53:51.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d406f640 con 0x7f22cc047280 2024-04-21T22:53:51.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc0e6ee0 con 0x7f22cc047280 2024-04-21T22:53:51.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc0caaa0 con 0x7f22cc047280 2024-04-21T22:53:51.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0264152520 con 0x7f026406c380 2024-04-21T22:53:51.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7e24054690 con 0x7f7e2804b160 2024-04-21T22:53:51.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f7e2d7fa640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7f7e1406fac0 0x7f7e14071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 --> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e14072590 con 0x7f7e1406fac0 2024-04-21T22:53:51.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7e24052890 con 0x7f7e2804b160 2024-04-21T22:53:51.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22cc0e7180 con 0x7f22cc047280 2024-04-21T22:53:51.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f7e350b4640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7f7e1406fac0 0x7f7e14071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f7e350b4640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7f7e1406fac0 0x7f7e14071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.450+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== osd.6 v2:172.21.15.154:6800/847095598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e14072590 con 0x7f7e1406fac0 2024-04-21T22:53:51.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.458+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 --> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0fc032e70 con 0x7fe0f006fa60 2024-04-21T22:53:51.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.458+0000 7fe0eb7fe640 1 -- 172.21.15.110:0/2101084159 <== osd.0 v2:172.21.15.110:6826/2616906515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe0fc032e70 con 0x7fe0f006fa60 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fe0f006fa60 msgr2=0x7fe0f0071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fe0f006fa60 0x7fe0f0071e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe0f00678c0 msgr2=0x7fe0f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe0f00678c0 0x7fe0f0069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007fd0 tx=0x7fe0f40079a0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0d5000 msgr2=0x7fe0fc0d7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 --2- 172.21.15.110:0/2101084159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0fc0d5000 0x7fe0fc0d7e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800c430 tx=0x7fe0f800c8f0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe10359e640 1 -- 172.21.15.110:0/2101084159 reap_dead start 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 shutdown_connections 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 >> 172.21.15.110:0/2101084159 conn(0x7fe0fc050190 msgr2=0x7fe0fc0d3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 shutdown_connections 2024-04-21T22:53:51.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.462+0000 7fe109229640 1 -- 172.21.15.110:0/2101084159 wait complete. 2024-04-21T22:53:51.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 --> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e280057f0 con 0x7f7e1406fac0 2024-04-21T22:53:51.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e2d7fa640 1 -- 172.21.15.110:0/740427292 <== osd.6 v2:172.21.15.154:6800/847095598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7e280057f0 con 0x7f7e1406fac0 2024-04-21T22:53:51.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7f7e1406fac0 msgr2=0x7f7e14071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7f7e1406fac0 0x7f7e14071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7e140678c0 msgr2=0x7f7e14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7e140678c0 0x7f7e14069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0b2000 tx=0x7f7e1c004740 comp rx=0 tx=0).stop 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804b160 msgr2=0x7f7e280e5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 --2- 172.21.15.110:0/740427292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2804b160 0x7f7e280e5d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400b410 tx=0x7f7e2400b8d0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e350b4640 1 -- 172.21.15.110:0/740427292 reap_dead start 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 shutdown_connections 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 >> 172.21.15.110:0/740427292 conn(0x7f7e280505e0 msgr2=0x7f7e28007430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 shutdown_connections 2024-04-21T22:53:51.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.466+0000 7f7e358b5640 1 -- 172.21.15.110:0/740427292 wait complete. 2024-04-21T22:53:51.475 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:51.476 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-21T22:53:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.486+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc98018070 con 0x7fcca40d8fb0 2024-04-21T22:53:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.486+0000 7fcca97fa640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fcc90067940 0x7fcc90069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.486+0000 7fccb0fbc640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fcc90067940 0x7fcc90069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.486+0000 7fccb0fbc640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fcc90067940 0x7fcc90069e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcca00b2000 tx=0x7fcca0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.487 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:51.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-21T22:53:51.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.490+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6200b43f0 con 0x7fc6240076e0 2024-04-21T22:53:51.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.490+0000 7fc628ff9640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc610067910 0x7fc610069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.490+0000 7fc62b7fe640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc610067910 0x7fc610069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.490+0000 7fc62b7fe640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc610067910 0x7fc610069dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6240d6c00 tx=0x7fc618006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcc98054470 con 0x7fcca40d8fb0 2024-04-21T22:53:51.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fcca97fa640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7fcc9006fb40 0x7fcc90071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 --> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc9800fe50 con 0x7fcc9006fb40 2024-04-21T22:53:51.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc6200eef40 con 0x7fc6240076e0 2024-04-21T22:53:51.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcc98052670 con 0x7fcca40d8fb0 2024-04-21T22:53:51.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fccb17bd640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7fcc9006fb40 0x7fcc90071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fc628ff9640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7fc61006fb10 0x7fc610071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 --> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6200aaec0 con 0x7fc61006fb10 2024-04-21T22:53:51.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc6200ed140 con 0x7fc6240076e0 2024-04-21T22:53:51.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fc630dec640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7fc61006fb10 0x7fc610071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fc630dec640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7fc61006fb10 0x7fc610071f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fccb17bd640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7fcc9006fb40 0x7fcc90071f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.494+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== osd.3 v2:172.21.15.110:6818/888134246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6200aaec0 con 0x7fc61006fb10 2024-04-21T22:53:51.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.498+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== osd.7 v2:172.21.15.154:6816/2454373145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc9800fe50 con 0x7fcc9006fb40 2024-04-21T22:53:51.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.506+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d408f070 con 0x7f22cc047280 2024-04-21T22:53:51.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.506+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4099060 con 0x7f22cc047280 2024-04-21T22:53:51.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f22d406faa0 con 0x7f22cc047280 2024-04-21T22:53:51.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f22bb7fe640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f22c00678f0 0x7f22c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f22d259c640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f22c00678f0 0x7f22c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f22d259c640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f22c00678f0 0x7f22c0069db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22c40af000 tx=0x7f22c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f122c01a070 con 0x7f12380d5000 2024-04-21T22:53:51.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f122bfff640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f12240678c0 0x7f1224069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f123f7fe640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f12240678c0 0x7f1224069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.510+0000 7f123f7fe640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f12240678c0 0x7f1224069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12340b2000 tx=0x7f1234004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f22d40cfc10 con 0x7f22cc047280 2024-04-21T22:53:51.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7f22bb7fe640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f22c006faf0 0x7f22c0071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 --> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22c00725c0 con 0x7f22c006faf0 2024-04-21T22:53:51.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f22d40cde10 con 0x7f22cc047280 2024-04-21T22:53:51.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7f22d359e640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f22c006faf0 0x7f22c0071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7f22d359e640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f22c006faf0 0x7f22c0071f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== osd.2 v2:172.21.15.110:6802/2146442210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22c00725c0 con 0x7f22c006faf0 2024-04-21T22:53:51.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 --> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcca40057f0 con 0x7fcc9006fb40 2024-04-21T22:53:51.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fcca97fa640 1 -- 172.21.15.110:0/2663877317 <== osd.7 v2:172.21.15.154:6816/2454373145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcca40057f0 con 0x7fcc9006fb40 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7fcc9006fb40 msgr2=0x7fcc90071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7fcc9006fb40 0x7fcc90071f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fcc90067940 msgr2=0x7fcc90069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fcc90067940 0x7fcc90069e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcca00b2000 tx=0x7fcca0009040 comp rx=0 tx=0).stop 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcca40d8fb0 msgr2=0x7fcca4050220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 --2- 172.21.15.110:0/2663877317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcca40d8fb0 0x7fcca4050220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c820 tx=0x7fcc9800cce0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb17bd640 1 -- 172.21.15.110:0/2663877317 reap_dead start 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 shutdown_connections 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 >> 172.21.15.110:0/2663877317 conn(0x7fcca40512a0 msgr2=0x7fcca40d49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 shutdown_connections 2024-04-21T22:53:51.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.514+0000 7fccb3220640 1 -- 172.21.15.110:0/2663877317 wait complete. 2024-04-21T22:53:51.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.518+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f122c053d70 con 0x7f12380d5000 2024-04-21T22:53:51.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.518+0000 7f122bfff640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f122406fac0 0x7f1224071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.518+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 --> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1224072590 con 0x7f122406fac0 2024-04-21T22:53:51.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.518+0000 7f123ffff640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f122406fac0 0x7f1224071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.518+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f122c051f70 con 0x7f12380d5000 2024-04-21T22:53:51.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.518+0000 7f123ffff640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f122406fac0 0x7f1224071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.522+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== osd.5 v2:172.21.15.154:6803/828597106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1224072590 con 0x7f122406fac0 2024-04-21T22:53:51.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 --> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6240057f0 con 0x7fc61006fb10 2024-04-21T22:53:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc628ff9640 1 -- 172.21.15.110:0/1240397179 <== osd.3 v2:172.21.15.110:6818/888134246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6240057f0 con 0x7fc61006fb10 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7fc61006fb10 msgr2=0x7fc610071f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7fc61006fb10 0x7fc610071f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc610067910 msgr2=0x7fc610069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc610067910 0x7fc610069dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6240d6c00 tx=0x7fc618006ca0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240076e0 msgr2=0x7fc624047960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 --2- 172.21.15.110:0/1240397179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240076e0 0x7fc624047960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc6200ad040 tx=0x7fc62001ad20 comp rx=0 tx=0).stop 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc630dec640 1 -- 172.21.15.110:0/1240397179 reap_dead start 2024-04-21T22:53:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 shutdown_connections 2024-04-21T22:53:51.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 >> 172.21.15.110:0/1240397179 conn(0x7fc6240505e0 msgr2=0x7fc62404f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 shutdown_connections 2024-04-21T22:53:51.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.526+0000 7fc63284f640 1 -- 172.21.15.110:0/1240397179 wait complete. 2024-04-21T22:53:51.533 INFO:teuthology.orchestra.run.smithi110.stdout:60129542160 2024-04-21T22:53:51.533 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-21T22:53:51.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 --> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1238032e70 con 0x7f122406fac0 2024-04-21T22:53:51.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f122bfff640 1 -- 172.21.15.110:0/688594589 <== osd.5 v2:172.21.15.154:6803/828597106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1238032e70 con 0x7f122406fac0 2024-04-21T22:53:51.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f122406fac0 msgr2=0x7f1224071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f122406fac0 0x7f1224071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f12240678c0 msgr2=0x7f1224069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f12240678c0 0x7f1224069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12340b2000 tx=0x7f1234004740 comp rx=0 tx=0).stop 2024-04-21T22:53:51.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 msgr2=0x7f12380d9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 --2- 172.21.15.110:0/688594589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12380d5000 0x7f12380d9bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c790 tx=0x7f122c00cc50 comp rx=0 tx=0).stop 2024-04-21T22:53:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f123ffff640 1 -- 172.21.15.110:0/688594589 reap_dead start 2024-04-21T22:53:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 shutdown_connections 2024-04-21T22:53:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 >> 172.21.15.110:0/688594589 conn(0x7f1238050190 msgr2=0x7f1238034c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 shutdown_connections 2024-04-21T22:53:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.538+0000 7f1245b39640 1 -- 172.21.15.110:0/688594589 wait complete. 2024-04-21T22:53:51.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 --> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f22cc0057f0 con 0x7f22c006faf0 2024-04-21T22:53:51.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22bb7fe640 1 -- 172.21.15.110:0/1684470376 <== osd.2 v2:172.21.15.110:6802/2146442210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f22cc0057f0 con 0x7f22c006faf0 2024-04-21T22:53:51.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f22c006faf0 msgr2=0x7f22c0071f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f22c006faf0 0x7f22c0071f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f22c00678f0 msgr2=0x7f22c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f22c00678f0 0x7f22c0069db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22c40af000 tx=0x7f22c4008040 comp rx=0 tx=0).stop 2024-04-21T22:53:51.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22cc047280 msgr2=0x7f22cc178740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 --2- 172.21.15.110:0/1684470376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22cc047280 0x7f22cc178740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22d4073d30 tx=0x7f22d4068dc0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d359e640 1 -- 172.21.15.110:0/1684470376 reap_dead start 2024-04-21T22:53:51.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 shutdown_connections 2024-04-21T22:53:51.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.542+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 >> 172.21.15.110:0/1684470376 conn(0x7f22cc00e0d0 msgr2=0x7f22cc0cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.550+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 shutdown_connections 2024-04-21T22:53:51.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.550+0000 7f22d9099640 1 -- 172.21.15.110:0/1684470376 wait complete. 2024-04-21T22:53:51.554 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:51.555 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-21T22:53:51.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.562+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084018020 con 0x7fd08c1408c0 2024-04-21T22:53:51.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.562+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd084014480 con 0x7fd08c1408c0 2024-04-21T22:53:51.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.562+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084014870 con 0x7fd08c1408c0 2024-04-21T22:53:51.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.562+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c140420 con 0x7fd08c1408c0 2024-04-21T22:53:51.562 INFO:teuthology.orchestra.run.smithi110.stdout:60129542159 2024-04-21T22:53:51.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-21T22:53:51.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.562+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1faed0 con 0x7fd08c1408c0 2024-04-21T22:53:51.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.562+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd08c04f510 con 0x7fd08c1408c0 2024-04-21T22:53:51.576 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:51.576 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-21T22:53:51.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.590+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f024c01a070 con 0x7f026406c380 2024-04-21T22:53:51.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.590+0000 7f025affd640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0244067910 0x7f0244069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.590+0000 7f025bfff640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0244067910 0x7f0244069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.590+0000 7f025bfff640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0244067910 0x7f0244069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02640b5a60 tx=0x7f0254006bb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.598+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f024c053ca0 con 0x7f026406c380 2024-04-21T22:53:51.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.598+0000 7f025affd640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f024406fb10 0x7f0244071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.598+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 --> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02440725e0 con 0x7f024406fb10 2024-04-21T22:53:51.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.598+0000 7f0262d9d640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f024406fb10 0x7f0244071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.598+0000 7f0262d9d640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f024406fb10 0x7f0244071f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.602+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 <== osd.4 v2:172.21.15.154:6824/2160786358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f02440725e0 con 0x7f024406fb10 2024-04-21T22:53:51.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.618+0000 7fb3fe9d9640 1 Processor -- start 2024-04-21T22:53:51.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.618+0000 7fb3fe9d9640 1 -- start start 2024-04-21T22:53:51.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.618+0000 7fb3fe9d9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f81504b0 0x7fb3f80c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.618+0000 7fb3fe9d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3f806fc80 0x7fb3f806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.618+0000 7fb3fe9d9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f8150890 con 0x7fb3f80c79d0 2024-04-21T22:53:51.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.618+0000 7fb3fe9d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f80c71d0 con 0x7fb3f806fc80 2024-04-21T22:53:51.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.618+0000 7fb3fe9d9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f815a100 con 0x7fb3f81504b0 2024-04-21T22:53:51.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.622+0000 7fb3fe1d8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb3f80c79d0 0x7fb3f8156150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:46622/0 (socket says 172.21.15.110:46622) 2024-04-21T22:53:51.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.622+0000 7fb3fe1d8640 1 -- 172.21.15.110:0/1006083929 learned_addr learned my addr 172.21.15.110:0/1006083929 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:51.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 --> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f026404f510 con 0x7f024406fb10 2024-04-21T22:53:51.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f025affd640 1 -- 172.21.15.110:0/866078956 <== osd.4 v2:172.21.15.154:6824/2160786358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f026404f510 con 0x7f024406fb10 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f024406fb10 msgr2=0x7f0244071f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f024406fb10 0x7f0244071f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0244067910 msgr2=0x7f0244069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0244067910 0x7f0244069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02640b5a60 tx=0x7f0254006bb0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026406c380 msgr2=0x7f026415b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 --2- 172.21.15.110:0/866078956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026406c380 0x7f026415b400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c490 tx=0x7f024c001e80 comp rx=0 tx=0).stop 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0262d9d640 1 -- 172.21.15.110:0/866078956 reap_dead start 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 shutdown_connections 2024-04-21T22:53:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.626+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 >> 172.21.15.110:0/866078956 conn(0x7f02640b1640 msgr2=0x7f026406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.630+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 shutdown_connections 2024-04-21T22:53:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.630+0000 7f0268eb1640 1 -- 172.21.15.110:0/866078956 wait complete. 2024-04-21T22:53:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.630+0000 7fb3fd1d6640 1 --2- 172.21.15.110:0/1006083929 >> v2:172.21.15.110:3300/0 conn(0x7fb3f806fc80 0x7fb3f806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.630+0000 7fb3fd1d6640 1 -- 172.21.15.110:0/1006083929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f81504b0 msgr2=0x7fb3f80c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.630+0000 7fb3fd1d6640 1 --2- 172.21.15.110:0/1006083929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f81504b0 0x7fb3f80c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.630+0000 7fb3fd1d6640 1 -- 172.21.15.110:0/1006083929 >> v1:172.21.15.154:6789/0 conn(0x7fb3f80c79d0 legacy=0x7fb3f8156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.630+0000 7fb3fd1d6640 1 -- 172.21.15.110:0/1006083929 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f815a3d0 con 0x7fb3f806fc80 2024-04-21T22:53:51.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.638+0000 7f232715e640 1 Processor -- start 2024-04-21T22:53:51.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.638+0000 7f232715e640 1 -- start start 2024-04-21T22:53:51.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.642+0000 7f232715e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2320150f30 0x7f23200c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.642+0000 7f232715e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23200733d0 con 0x7f23200727a0 2024-04-21T22:53:51.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.642+0000 7f232715e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23200c7680 con 0x7f23200c3450 2024-04-21T22:53:51.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.642+0000 7f232715e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f23200736b0 con 0x7f2320150f30 2024-04-21T22:53:51.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.642+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd08401b020 con 0x7fd08c1408c0 2024-04-21T22:53:51.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.642+0000 7f2324efa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2320150f30 0x7f23200c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.642+0000 7fd081ffb640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fd070067940 0x7fd070069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.646+0000 7fd091138640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fd070067940 0x7fd070069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.646+0000 7fd091138640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fd070067940 0x7fd070069e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd088007fd0 tx=0x7fd0880079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.646+0000 7fb3fd1d6640 1 --2- 172.21.15.110:0/1006083929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f806fc80 0x7fb3f806ebf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800a960 tx=0x7fb3e8021160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c81aff47a997dc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.646+0000 7f2324efa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2320150f30 0x7f23200c1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47578/0 (socket says 172.21.15.110:47578) 2024-04-21T22:53:51.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.646+0000 7f2324efa640 1 -- 172.21.15.110:0/2167064361 learned_addr learned my addr 172.21.15.110:0/2167064361 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.651 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:51.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-21T22:53:51.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.650+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd0840553b0 con 0x7fd08c1408c0 2024-04-21T22:53:51.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.654+0000 7fd081ffb640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7fd07006fb40 0x7fd070071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.654+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 --> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd070072610 con 0x7fd07006fb40 2024-04-21T22:53:51.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.654+0000 7fd090937640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7fd07006fb40 0x7fd070071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.654+0000 7fd090937640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7fd07006fb40 0x7fd070071f60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.654+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 <== osd.1 v2:172.21.15.110:6810/3951369001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd070072610 con 0x7fd07006fb40 2024-04-21T22:53:51.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.670+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 --> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd08c156c70 con 0x7fd07006fb40 2024-04-21T22:53:51.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.670+0000 7fd081ffb640 1 -- 172.21.15.110:0/1853678022 <== osd.1 v2:172.21.15.110:6810/3951369001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd08c156c70 con 0x7fd07006fb40 2024-04-21T22:53:51.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7fd07006fb40 msgr2=0x7fd070071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7fd07006fb40 0x7fd070071f60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fd070067940 msgr2=0x7fd070069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fd070067940 0x7fd070069e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd088007fd0 tx=0x7fd0880079a0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c1408c0 msgr2=0x7fd08c13ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 --2- 172.21.15.110:0/1853678022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd08c1408c0 0x7fd08c13ee20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd08400efc0 tx=0x7fd08400c490 comp rx=0 tx=0).stop 2024-04-21T22:53:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd091939640 1 -- 172.21.15.110:0/1853678022 reap_dead start 2024-04-21T22:53:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 shutdown_connections 2024-04-21T22:53:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 >> 172.21.15.110:0/1853678022 conn(0x7fd08c06e520 msgr2=0x7fd08c0c83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 shutdown_connections 2024-04-21T22:53:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.674+0000 7fd09339c640 1 -- 172.21.15.110:0/1853678022 wait complete. 2024-04-21T22:53:51.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.682+0000 7fbaa06d9640 1 Processor -- start 2024-04-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.682+0000 7fbaa06d9640 1 -- start start 2024-04-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.682+0000 7fbaa06d9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba98150f30 0x7fba980c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.682+0000 7fbaa06d9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba980c3450 0x7fba980c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.682+0000 7fbaa06d9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba980733d0 con 0x7fba980727a0 2024-04-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.682+0000 7fbaa06d9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fba980736b0 con 0x7fba980c3450 2024-04-21T22:53:51.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.682+0000 7fbaa06d9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fba98157340 con 0x7fba98150f30 2024-04-21T22:53:51.701 INFO:teuthology.orchestra.run.smithi110.stdout:64424509456 2024-04-21T22:53:51.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-21T22:53:51.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.734+0000 7fba9ec76640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba980c3450 0x7fba980c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.734+0000 7fba9ec76640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba980c3450 0x7fba980c38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60178/0 (socket says 172.21.15.110:60178) 2024-04-21T22:53:51.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.734+0000 7fba9ec76640 1 -- 172.21.15.110:0/2133156931 learned_addr learned my addr 172.21.15.110:0/2133156931 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f51b4d36640 1 Processor -- start 2024-04-21T22:53:51.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f51b4d36640 1 -- start start 2024-04-21T22:53:51.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f51b4d36640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b01544d0 0x7f51b015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f51b4d36640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51b006bc70 0x7f51b00727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f51b4d36640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b015b330 con 0x7f51b0072ce0 2024-04-21T22:53:51.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f51b4d36640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f51b015e8a0 con 0x7f51b006bc70 2024-04-21T22:53:51.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f51b4d36640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f51b006b5e0 con 0x7f51b01544d0 2024-04-21T22:53:51.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f7218ba2640 1 Processor -- start 2024-04-21T22:53:51.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.738+0000 7f7218ba2640 1 -- start start 2024-04-21T22:53:51.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7f7218ba2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f721415c280 0x7f721406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7f7218ba2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72141525b0 con 0x7f72140ca230 2024-04-21T22:53:51.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7f7218ba2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7214158c50 con 0x7f72141521d0 2024-04-21T22:53:51.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7f7218ba2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f721406ba10 con 0x7f721415c280 2024-04-21T22:53:51.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7fba9ec76640 1 -- 172.21.15.110:0/2133156931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba98150f30 msgr2=0x7fba980c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7fba9ec76640 1 --2- 172.21.15.110:0/2133156931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba98150f30 0x7fba980c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7fba9ec76640 1 -- 172.21.15.110:0/2133156931 >> v1:172.21.15.154:6789/0 conn(0x7fba980727a0 legacy=0x7fba981577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.742+0000 7fba9ec76640 1 -- 172.21.15.110:0/2133156931 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980c7680 con 0x7fba980c3450 2024-04-21T22:53:51.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fc9d5640 1 -- 172.21.15.110:0/1006083929 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80b6070 con 0x7fb3f806fc80 2024-04-21T22:53:51.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fc9d5640 1 -- 172.21.15.110:0/1006083929 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e80b1600 con 0x7fb3f806fc80 2024-04-21T22:53:51.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fc9d5640 1 -- 172.21.15.110:0/1006083929 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800b040 con 0x7fb3f806fc80 2024-04-21T22:53:51.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/1006083929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f806fc80 msgr2=0x7fb3f806ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/1006083929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f806fc80 0x7fb3f806ebf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800a960 tx=0x7fb3e8021160 comp rx=0 tx=0).stop 2024-04-21T22:53:51.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7f231f7fe640 1 -- 172.21.15.110:0/2167064361 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904488860 0 0) 0x7f23200733d0 con 0x7f23200727a0 2024-04-21T22:53:51.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7f231f7fe640 1 -- 172.21.15.110:0/2167064361 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2310003530 con 0x7f23200727a0 2024-04-21T22:53:51.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/1006083929 shutdown_connections 2024-04-21T22:53:51.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/1006083929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f806fc80 0x7fb3f806ebf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/1006083929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f81504b0 0x7fb3f80c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/1006083929 >> 172.21.15.110:0/1006083929 conn(0x7fb3f806b3b0 msgr2=0x7fb3f806b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/1006083929 shutdown_connections 2024-04-21T22:53:51.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.746+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/1006083929 wait complete. 2024-04-21T22:53:51.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 Processor -- start 2024-04-21T22:53:51.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fba9ec76640 1 --2- 172.21.15.110:0/2133156931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980c3450 0x7fba980c38e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba90009e50 tx=0x7fba9001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2333fb6cc6afda45 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 -- start start 2024-04-21T22:53:51.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f806fc80 0x7fb3f814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f80c79d0 0x7fb3f8140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f81504b0 0x7fb3f8140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f80c6770 con 0x7fb3f81504b0 2024-04-21T22:53:51.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f80c6490 con 0x7fb3f80c79d0 2024-04-21T22:53:51.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.750+0000 7fb3fe9d9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f80c73f0 con 0x7fb3f806fc80 2024-04-21T22:53:51.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f431c684640 1 Processor -- start 2024-04-21T22:53:51.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f431c684640 1 -- start start 2024-04-21T22:53:51.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f431c684640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43140c1b40 0x7f4314150f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f431c684640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43140c3450 0x7f43140c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f431c684640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140733d0 con 0x7f43140727a0 2024-04-21T22:53:51.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f431c684640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f43140c1f60 con 0x7f43140c1b40 2024-04-21T22:53:51.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f431c684640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f43140736b0 con 0x7f43140c3450 2024-04-21T22:53:51.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f2324efa640 1 -- 172.21.15.110:0/2167064361 >> v1:172.21.15.154:6789/0 conn(0x7f23200c3450 legacy=0x7f23201618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f2324efa640 1 -- 172.21.15.110:0/2167064361 >> v1:172.21.15.110:6789/0 conn(0x7f23200727a0 legacy=0x7f23201577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.754+0000 7f2324efa640 1 -- 172.21.15.110:0/2167064361 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23200c7960 con 0x7f2320150f30 2024-04-21T22:53:51.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.758+0000 7f51aed9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f51b0072ce0 0x7f51b00705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36080/0 (socket says 172.21.15.110:36080) 2024-04-21T22:53:51.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.758+0000 7f51aed9d640 1 -- 172.21.15.110:0/4254531946 learned_addr learned my addr 172.21.15.110:0/4254531946 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:51.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.758+0000 7f721259c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f72141521d0 0x7f72140705a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:46662/0 (socket says 172.21.15.110:46662) 2024-04-21T22:53:51.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.758+0000 7f721259c640 1 -- 172.21.15.110:0/3290758066 learned_addr learned my addr 172.21.15.110:0/3290758066 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:51.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.766+0000 7fb3fe1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f81504b0 0x7fb3f8140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.766+0000 7f2324efa640 1 --2- 172.21.15.110:0/2167064361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320150f30 0x7f23200c1b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f230c00bb10 tx=0x7f230c01ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c625205e4661caf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.766+0000 7fb3fe1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f81504b0 0x7fb3f8140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60204/0 (socket says 172.21.15.110:60204) 2024-04-21T22:53:51.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.766+0000 7fb3fe1d8640 1 -- 172.21.15.110:0/33568154 learned_addr learned my addr 172.21.15.110:0/33568154 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.770+0000 7f51add9b640 1 --2- 172.21.15.110:0/4254531946 >> v2:172.21.15.110:3300/0 conn(0x7f51b006bc70 0x7f51b00727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.770+0000 7fb3fe1d8640 1 -- 172.21.15.110:0/33568154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f806fc80 msgr2=0x7fb3f814df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.770+0000 7fb3fe1d8640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f806fc80 0x7fb3f814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.770+0000 7fb3fe1d8640 1 -- 172.21.15.110:0/33568154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f80c79d0 msgr2=0x7fb3f8140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.770+0000 7fb3fe1d8640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f80c79d0 0x7fb3f8140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.770+0000 7fb3fe1d8640 1 -- 172.21.15.110:0/33568154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f814b190 con 0x7fb3f81504b0 2024-04-21T22:53:51.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.774+0000 7f51ae59c640 1 --2- 172.21.15.110:0/4254531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b01544d0 0x7f51b015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7f51add9b640 1 -- 172.21.15.110:0/4254531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b01544d0 msgr2=0x7f51b015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7f51add9b640 1 --2- 172.21.15.110:0/4254531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b01544d0 0x7f51b015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7f51add9b640 1 -- 172.21.15.110:0/4254531946 >> v1:172.21.15.110:6789/0 conn(0x7f51b0072ce0 legacy=0x7f51b00705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7f51add9b640 1 -- 172.21.15.110:0/4254531946 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b015dae0 con 0x7f51b006bc70 2024-04-21T22:53:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fba9d473640 1 -- 172.21.15.110:0/2133156931 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba900a5670 con 0x7fba980c3450 2024-04-21T22:53:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fba9d473640 1 -- 172.21.15.110:0/2133156931 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba900a5810 con 0x7fba980c3450 2024-04-21T22:53:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fba9d473640 1 -- 172.21.15.110:0/2133156931 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba900a5be0 con 0x7fba980c3450 2024-04-21T22:53:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fb3fe1d8640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f81504b0 0x7fb3f8140890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0001a60 tx=0x7fb3f0001f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 -- 172.21.15.110:0/2133156931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980c3450 msgr2=0x7fba980c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/2133156931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980c3450 0x7fba980c38e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba90009e50 tx=0x7fba9001c9f0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 -- 172.21.15.110:0/2133156931 shutdown_connections 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/2133156931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980c3450 0x7fba980c38e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/2133156931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba98150f30 0x7fba980c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 -- 172.21.15.110:0/2133156931 >> 172.21.15.110:0/2133156931 conn(0x7fba9806e590 msgr2=0x7fba9806e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 -- 172.21.15.110:0/2133156931 shutdown_connections 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7fbaa06d9640 1 -- 172.21.15.110:0/2133156931 wait complete. 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7f431a420640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f43140727a0 0x7f43141577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36098/0 (socket says 172.21.15.110:36098) 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7f431a420640 1 -- 172.21.15.110:0/1439029570 learned_addr learned my addr 172.21.15.110:0/1439029570 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:51.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 Processor -- start 2024-04-21T22:53:51.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.778+0000 7f7212d9d640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f721415c280 0x7f721406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2925220091 0 0) 0x7f72141525b0 con 0x7f72140ca230 2024-04-21T22:53:51.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71fc003530 con 0x7f72140ca230 2024-04-21T22:53:51.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 -- start start 2024-04-21T22:53:51.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980727a0 0x7fba98152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba980c3450 0x7fba9814ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba98150f30 0x7fba981f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fba9815a6d0 con 0x7fba980727a0 2024-04-21T22:53:51.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba9815a550 con 0x7fba98150f30 2024-04-21T22:53:51.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7fbaa06d9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fba98072cb0 con 0x7fba980c3450 2024-04-21T22:53:51.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7f231f7fe640 1 -- 172.21.15.110:0/2167064361 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c0b4070 con 0x7f2320150f30 2024-04-21T22:53:51.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7f231f7fe640 1 -- 172.21.15.110:0/2167064361 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230c0a7a00 con 0x7f2320150f30 2024-04-21T22:53:51.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.782+0000 7f231f7fe640 1 -- 172.21.15.110:0/2167064361 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c0a7dd0 con 0x7f2320150f30 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- 172.21.15.110:0/2167064361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320150f30 msgr2=0x7f23200c1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 --2- 172.21.15.110:0/2167064361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320150f30 0x7f23200c1b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f230c00bb10 tx=0x7f230c01ec50 comp rx=0 tx=0).stop 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- 172.21.15.110:0/2167064361 shutdown_connections 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 --2- 172.21.15.110:0/2167064361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320150f30 0x7f23200c1b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- 172.21.15.110:0/2167064361 >> 172.21.15.110:0/2167064361 conn(0x7f232006e590 msgr2=0x7f232006e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- 172.21.15.110:0/2167064361 shutdown_connections 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- 172.21.15.110:0/2167064361 wait complete. 2024-04-21T22:53:51.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 Processor -- start 2024-04-21T22:53:51.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- start start 2024-04-21T22:53:51.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23200727a0 0x7f23200cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23200c3450 0x7f23201fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320150f30 0x7f2320141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f232015a550 con 0x7f23200c3450 2024-04-21T22:53:51.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2320157340 con 0x7f23200727a0 2024-04-21T22:53:51.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.786+0000 7f232715e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f232015a6d0 con 0x7f2320150f30 2024-04-21T22:53:51.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7fba9dc74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba980c3450 0x7fba9814ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4060290569 0 0) 0x7f71fc003530 con 0x7f72140ca230 2024-04-21T22:53:51.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f721415c280 msgr2=0x7f721406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7f721159a640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f721415c280 0x7f721406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 >> v1:172.21.15.154:6789/0 conn(0x7f72141521d0 legacy=0x7f72140705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7214158f30 con 0x7f72140ca230 2024-04-21T22:53:51.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7fba9dc74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba980c3450 0x7fba9814ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48264/0 (socket says 172.21.15.110:48264) 2024-04-21T22:53:51.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7fba9dc74640 1 -- 172.21.15.110:0/1367410118 learned_addr learned my addr 172.21.15.110:0/1367410118 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.790+0000 7f4319c1f640 1 --2- 172.21.15.110:0/1439029570 >> v2:172.21.15.110:3300/0 conn(0x7f43140c1b40 0x7f4314150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7f2e51d60640 1 Processor -- start 2024-04-21T22:53:51.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7f2e51d60640 1 -- start start 2024-04-21T22:53:51.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7f2e51d60640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e4c150980 0x7f2e4c157240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7f2e51d60640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c3750 0x7f2e4c0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7f2e51d60640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4c06b280 con 0x7f2e4c0c5760 2024-04-21T22:53:51.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7f2e51d60640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2e4c157780 con 0x7f2e4c150980 2024-04-21T22:53:51.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7f2e51d60640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4c06b520 con 0x7f2e4c0c3750 2024-04-21T22:53:51.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.794+0000 7fba9ec76640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba98150f30 0x7fba981f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f7208001680 con 0x7f72140ca230 2024-04-21T22:53:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 >> v1:172.21.15.110:6789/0 conn(0x7f72140ca230 legacy=0x7f721415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f721415c280 0x7f71fc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc003f30 0x7f71fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7fba9e475640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980727a0 0x7fba98152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004d50 0x7f71fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f721406ba10 con 0x7f71fc004d50 2024-04-21T22:53:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc00ba00 con 0x7f71fc003f30 2024-04-21T22:53:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.798+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc00bc00 con 0x7f721415c280 2024-04-21T22:53:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7f4319c1f640 1 -- 172.21.15.110:0/1439029570 >> v2:172.21.15.154:3300/0 conn(0x7f43140c3450 msgr2=0x7f43140c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7f4319c1f640 1 --2- 172.21.15.110:0/1439029570 >> v2:172.21.15.154:3300/0 conn(0x7f43140c3450 0x7f43140c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7f4319c1f640 1 -- 172.21.15.110:0/1439029570 >> v1:172.21.15.110:6789/0 conn(0x7f43140727a0 legacy=0x7f43141577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7f4319c1f640 1 -- 172.21.15.110:0/1439029570 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43140c7680 con 0x7f43140c1b40 2024-04-21T22:53:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7fba9dc74640 1 -- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba98150f30 msgr2=0x7fba981f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7fba9dc74640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba98150f30 0x7fba981f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7fba9dc74640 1 -- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980727a0 msgr2=0x7fba98152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7fba9dc74640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980727a0 0x7fba98152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.802+0000 7fba9dc74640 1 -- 172.21.15.110:0/1367410118 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9814aaa0 con 0x7fba980c3450 2024-04-21T22:53:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.806+0000 7fb3ee7fc640 1 -- 172.21.15.110:0/33568154 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0018070 con 0x7fb3f81504b0 2024-04-21T22:53:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.806+0000 7fb3ee7fc640 1 -- 172.21.15.110:0/33568154 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f00082d0 con 0x7fb3f81504b0 2024-04-21T22:53:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.806+0000 7fb3ee7fc640 1 -- 172.21.15.110:0/33568154 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000d8e0 con 0x7fb3f81504b0 2024-04-21T22:53:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.806+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f8157940 con 0x7fb3f81504b0 2024-04-21T22:53:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.806+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f8144aa0 con 0x7fb3f81504b0 2024-04-21T22:53:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.806+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f804f510 con 0x7fb3f81504b0 2024-04-21T22:53:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.806+0000 7f51add9b640 1 --2- 172.21.15.110:0/4254531946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b006bc70 0x7f51b00727a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51a40097c0 tx=0x7f51a401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2166e38cce2f51ac server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.810+0000 7fba9dc74640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba980c3450 0x7fba9814ede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fba94001eb0 tx=0x7fba9400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.810+0000 7f7212d9d640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004d50 0x7f71fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.814+0000 7f231ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23200c3450 0x7f23201fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.822+0000 7f7211d9b640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc003f30 0x7f71fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.830+0000 7f23256fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320150f30 0x7f2320141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7f23256fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320150f30 0x7f2320141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48276/0 (socket says 172.21.15.110:48276) 2024-04-21T22:53:51.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7f23256fb640 1 -- 172.21.15.110:0/2527903649 learned_addr learned my addr 172.21.15.110:0/2527903649 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7fba8affd640 1 -- 172.21.15.110:0/1367410118 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94015020 con 0x7fba980c3450 2024-04-21T22:53:51.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7fba8affd640 1 -- 172.21.15.110:0/1367410118 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba94003600 con 0x7fba980c3450 2024-04-21T22:53:51.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7fba8affd640 1 -- 172.21.15.110:0/1367410118 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94003a30 con 0x7fba980c3450 2024-04-21T22:53:51.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba98150200 con 0x7fba980c3450 2024-04-21T22:53:51.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9814e300 con 0x7fba980c3450 2024-04-21T22:53:51.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7f2e4affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c3750 0x7f2e4c0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7f2e4affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c3750 0x7f2e4c0c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48284/0 (socket says 172.21.15.110:48284) 2024-04-21T22:53:51.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7f2e4affd640 1 -- 172.21.15.110:0/487268108 learned_addr learned my addr 172.21.15.110:0/487268108 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.834+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9804f510 con 0x7fba980c3450 2024-04-21T22:53:51.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.838+0000 7f2324efa640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23200727a0 0x7f23200cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f2e4affd640 1 -- 172.21.15.110:0/487268108 >> v2:172.21.15.110:3300/0 conn(0x7f2e4c150980 msgr2=0x7f2e4c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f2e4affd640 1 --2- 172.21.15.110:0/487268108 >> v2:172.21.15.110:3300/0 conn(0x7f2e4c150980 0x7f2e4c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f2e4affd640 1 -- 172.21.15.110:0/487268108 >> v1:172.21.15.110:6789/0 conn(0x7f2e4c0c5760 legacy=0x7f2e4c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f2e4affd640 1 -- 172.21.15.110:0/487268108 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4c06b800 con 0x7f2e4c0c3750 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f7211d9b640 1 -- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f721415c280 msgr2=0x7f71fc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f7211d9b640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f721415c280 0x7f71fc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f7211d9b640 1 -- 172.21.15.110:0/3290758066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004d50 msgr2=0x7f71fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f7211d9b640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004d50 0x7f71fc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.842+0000 7f7211d9b640 1 -- 172.21.15.110:0/3290758066 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc003530 con 0x7f71fc003f30 2024-04-21T22:53:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.846+0000 7f8e9a52a640 1 Processor -- start 2024-04-21T22:53:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.846+0000 7f8e9a52a640 1 -- start start 2024-04-21T22:53:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.846+0000 7f8e9a52a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e94154440 0x7f8e940c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.846+0000 7f8e9a52a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8e9415ae60 0x7f8e940c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.846+0000 7f8e9a52a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e9415a250 con 0x7f8e9406c2f0 2024-04-21T22:53:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.850+0000 7f8e9a52a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8e9415d840 con 0x7f8e9415ae60 2024-04-21T22:53:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.850+0000 7f8e9a52a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8e9415da70 con 0x7f8e94154440 2024-04-21T22:53:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.854+0000 7f23256fb640 1 -- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23200727a0 msgr2=0x7f23200cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.854+0000 7f23256fb640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23200727a0 0x7f23200cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.854+0000 7f23256fb640 1 -- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23200c3450 msgr2=0x7f23201fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.854+0000 7f23256fb640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23200c3450 0x7f23201fafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.854+0000 7f23256fb640 1 -- 172.21.15.110:0/2527903649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2320143770 con 0x7f2320150f30 2024-04-21T22:53:51.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.858+0000 7f2e4affd640 1 --2- 172.21.15.110:0/487268108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c3750 0x7f2e4c0c5220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e40006fd0 tx=0x7f2e4001e9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=849c7d19e9428970 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.858+0000 7f7211d9b640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc003f30 0x7f71fc004810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7208003d90 tx=0x7f720801d220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a078e6b941060e45 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:51.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208003990 con 0x7f71fc003f30 2024-04-21T22:53:51.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7208006070 con 0x7f71fc003f30 2024-04-21T22:53:51.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f721159a640 1 -- 172.21.15.110:0/3290758066 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208006480 con 0x7f71fc003f30 2024-04-21T22:53:51.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f7218ba2640 1 -- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc003f30 msgr2=0x7f71fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f7218ba2640 1 --2- 172.21.15.110:0/3290758066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc003f30 0x7f71fc004810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7208003d90 tx=0x7f720801d220 comp rx=0 tx=0).stop 2024-04-21T22:53:51.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f7212d9d640 1 -- 172.21.15.110:0/3290758066 reap_dead start 2024-04-21T22:53:51.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f7218ba2640 1 -- 172.21.15.110:0/3290758066 shutdown_connections 2024-04-21T22:53:51.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f7218ba2640 1 -- 172.21.15.110:0/3290758066 >> 172.21.15.110:0/3290758066 conn(0x7f721406e590 msgr2=0x7f721406e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:51.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f7218ba2640 1 -- 172.21.15.110:0/3290758066 shutdown_connections 2024-04-21T22:53:51.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.974+0000 7f7218ba2640 1 -- 172.21.15.110:0/3290758066 wait complete. 2024-04-21T22:53:51.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 Processor -- start 2024-04-21T22:53:51.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 -- start start 2024-04-21T22:53:51.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72140c2870 0x7f721414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72140c2c50 0x7f721415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141efa30 0x7f7214143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:51.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7214070cb0 con 0x7f72140c2870 2024-04-21T22:53:51.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f721406bf40 con 0x7f72141efa30 2024-04-21T22:53:51.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.978+0000 7f7218ba2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7214070e30 con 0x7f72140c2c50 2024-04-21T22:53:51.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.982+0000 7f7212d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141efa30 0x7f7214143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:51.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.982+0000 7f7212d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141efa30 0x7f7214143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47628/0 (socket says 172.21.15.110:47628) 2024-04-21T22:53:51.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.982+0000 7f7212d9d640 1 -- 172.21.15.110:0/3513603788 learned_addr learned my addr 172.21.15.110:0/3513603788 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:51.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.986+0000 7f7212d9d640 1 -- 172.21.15.110:0/3513603788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72140c2c50 msgr2=0x7f721415a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.986+0000 7f7212d9d640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72140c2c50 0x7f721415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.986+0000 7f7212d9d640 1 -- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72140c2870 msgr2=0x7f721414c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.986+0000 7f7212d9d640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72140c2870 0x7f721414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:51.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.986+0000 7f7212d9d640 1 -- 172.21.15.110:0/3513603788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72141eff90 con 0x7f72141efa30 2024-04-21T22:53:51.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:51.994+0000 7f7212d9d640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141efa30 0x7f7214143640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7214072560 tx=0x7f720c00f4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.002+0000 7f7202ffd640 1 -- 172.21.15.110:0/3513603788 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c01c070 con 0x7f72141efa30 2024-04-21T22:53:52.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.002+0000 7f7202ffd640 1 -- 172.21.15.110:0/3513603788 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720c017400 con 0x7f72141efa30 2024-04-21T22:53:52.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.002+0000 7f7202ffd640 1 -- 172.21.15.110:0/3513603788 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c0177f0 con 0x7f72141efa30 2024-04-21T22:53:52.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.002+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721414e280 con 0x7f72141efa30 2024-04-21T22:53:52.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.002+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72141598e0 con 0x7f72141efa30 2024-04-21T22:53:52.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.002+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721404f510 con 0x7f72141efa30 2024-04-21T22:53:52.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.054+0000 7f7202ffd640 1 -- 172.21.15.110:0/3513603788 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f720c01f070 con 0x7f72141efa30 2024-04-21T22:53:52.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.054+0000 7f7202ffd640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f71f4067940 0x7f71f4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.054+0000 7f721259c640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f71f4067940 0x7f71f4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.054+0000 7f721259c640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f71f4067940 0x7f71f4069e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7204001560 tx=0x7f7204007a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.118+0000 7f4319c1f640 1 --2- 172.21.15.110:0/1439029570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c1b40 0x7f4314150f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43140c99a0 tx=0x7f430401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc27295aeda50c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.158+0000 7fb3ee7fc640 1 -- 172.21.15.110:0/33568154 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3f001b070 con 0x7fb3f81504b0 2024-04-21T22:53:52.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.162+0000 7fb3ee7fc640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb3dc067910 0x7fb3dc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.162+0000 7fb3fd9d7640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb3dc067910 0x7fb3dc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.162+0000 7fb3fd9d7640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb3dc067910 0x7fb3dc069dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009690 tx=0x7fb3f4006c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.174+0000 7f23256fb640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320150f30 0x7f2320141260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f231800c7a0 tx=0x7f231800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.178+0000 7f2e4a7fc640 1 -- 172.21.15.110:0/487268108 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e400ad070 con 0x7f2e4c0c3750 2024-04-21T22:53:52.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.178+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e94154440 0x7f8e940c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.178+0000 7f2e4a7fc640 1 -- 172.21.15.110:0/487268108 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e40004230 con 0x7f2e4c0c3750 2024-04-21T22:53:52.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.178+0000 7f2e4a7fc640 1 -- 172.21.15.110:0/487268108 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e400a76b0 con 0x7f2e4c0c3750 2024-04-21T22:53:52.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 -- 172.21.15.110:0/487268108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c3750 msgr2=0x7f2e4c0c5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 --2- 172.21.15.110:0/487268108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c3750 0x7f2e4c0c5220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e40006fd0 tx=0x7f2e4001e9b0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 -- 172.21.15.110:0/487268108 shutdown_connections 2024-04-21T22:53:52.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 --2- 172.21.15.110:0/487268108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c3750 0x7f2e4c0c5220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 --2- 172.21.15.110:0/487268108 >> v2:172.21.15.110:3300/0 conn(0x7f2e4c150980 0x7f2e4c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 -- 172.21.15.110:0/487268108 >> 172.21.15.110:0/487268108 conn(0x7f2e4c0cc250 msgr2=0x7f2e4c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 -- 172.21.15.110:0/487268108 shutdown_connections 2024-04-21T22:53:52.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f2e51d60640 1 -- 172.21.15.110:0/487268108 wait complete. 2024-04-21T22:53:52.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e94154440 0x7f8e940c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48306/0 (socket says 172.21.15.110:48306) 2024-04-21T22:53:52.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.182+0000 7f8e93fff640 1 -- 172.21.15.110:0/690193394 learned_addr learned my addr 172.21.15.110:0/690193394 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:52.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 Processor -- start 2024-04-21T22:53:52.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 -- start start 2024-04-21T22:53:52.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e4c0c3750 0x7f2e4c154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c5760 0x7f2e4c14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4c150980 0x7f2e4c13ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c0c3b90 con 0x7f2e4c150980 2024-04-21T22:53:52.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c06c7e0 con 0x7f2e4c0c3750 2024-04-21T22:53:52.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.186+0000 7f2e51d60640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4c0c3d10 con 0x7f2e4c0c5760 2024-04-21T22:53:52.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.190+0000 7f231d7fa640 1 -- 172.21.15.110:0/2527903649 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318003b80 con 0x7f2320150f30 2024-04-21T22:53:52.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.190+0000 7f231d7fa640 1 -- 172.21.15.110:0/2527903649 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2318003d20 con 0x7f2320150f30 2024-04-21T22:53:52.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.190+0000 7f231d7fa640 1 -- 172.21.15.110:0/2527903649 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231800aa90 con 0x7f2320150f30 2024-04-21T22:53:52.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.190+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2320143a50 con 0x7f2320150f30 2024-04-21T22:53:52.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.190+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2320144010 con 0x7f2320150f30 2024-04-21T22:53:52.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.194+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232004f510 con 0x7f2320150f30 2024-04-21T22:53:52.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.198+0000 7fb3ee7fc640 1 -- 172.21.15.110:0/33568154 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb3f0053f40 con 0x7fb3f81504b0 2024-04-21T22:53:52.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.198+0000 7fb3ee7fc640 1 -- 172.21.15.110:0/33568154 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fb3f0022020 con 0x7fb3f81504b0 2024-04-21T22:53:52.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.198+0000 7f8e98ac7640 1 --2- 172.21.15.110:0/690193394 >> v2:172.21.15.110:3300/0 conn(0x7f8e9415ae60 0x7f8e940c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.206+0000 7f8e98ac7640 1 -- 172.21.15.110:0/690193394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e94154440 msgr2=0x7f8e940c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:52.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.206+0000 7f8e98ac7640 1 --2- 172.21.15.110:0/690193394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e94154440 0x7f8e940c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.206+0000 7f8e98ac7640 1 -- 172.21.15.110:0/690193394 >> v1:172.21.15.110:6789/0 conn(0x7f8e9406c2f0 legacy=0x7f8e9415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:52.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.206+0000 7f8e98ac7640 1 -- 172.21.15.110:0/690193394 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9415dd50 con 0x7f8e9415ae60 2024-04-21T22:53:52.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431941e640 1 -- 172.21.15.110:0/1439029570 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43040b0070 con 0x7f43140c1b40 2024-04-21T22:53:52.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431941e640 1 -- 172.21.15.110:0/1439029570 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43040ab600 con 0x7f43140c1b40 2024-04-21T22:53:52.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431941e640 1 -- 172.21.15.110:0/1439029570 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43040ab9d0 con 0x7f43140c1b40 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 -- 172.21.15.110:0/1439029570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c1b40 msgr2=0x7f4314150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 --2- 172.21.15.110:0/1439029570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c1b40 0x7f4314150f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43140c99a0 tx=0x7f430401c480 comp rx=0 tx=0).stop 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 -- 172.21.15.110:0/1439029570 shutdown_connections 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 --2- 172.21.15.110:0/1439029570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c1b40 0x7f4314150f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 --2- 172.21.15.110:0/1439029570 >> v2:172.21.15.154:3300/0 conn(0x7f43140c3450 0x7f43140c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 -- 172.21.15.110:0/1439029570 >> 172.21.15.110:0/1439029570 conn(0x7f431406e590 msgr2=0x7f431406e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 -- 172.21.15.110:0/1439029570 shutdown_connections 2024-04-21T22:53:52.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f431c684640 1 -- 172.21.15.110:0/1439029570 wait complete. 2024-04-21T22:53:52.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f51ad59a640 1 -- 172.21.15.110:0/4254531946 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40b5070 con 0x7f51b006bc70 2024-04-21T22:53:52.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f51ad59a640 1 -- 172.21.15.110:0/4254531946 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a40a8990 con 0x7f51b006bc70 2024-04-21T22:53:52.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.210+0000 7f51ad59a640 1 -- 172.21.15.110:0/4254531946 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40a8d60 con 0x7f51b006bc70 2024-04-21T22:53:52.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 Processor -- start 2024-04-21T22:53:52.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 -- start start 2024-04-21T22:53:52.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- 172.21.15.110:0/4254531946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b006bc70 msgr2=0x7f51b00727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 --2- 172.21.15.110:0/4254531946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b006bc70 0x7f51b00727a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51a40097c0 tx=0x7f51a401ec90 comp rx=0 tx=0).stop 2024-04-21T22:53:52.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- 172.21.15.110:0/4254531946 shutdown_connections 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 --2- 172.21.15.110:0/4254531946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b006bc70 0x7f51b00727a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 --2- 172.21.15.110:0/4254531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b01544d0 0x7f51b015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- 172.21.15.110:0/4254531946 >> 172.21.15.110:0/4254531946 conn(0x7f51b006e590 msgr2=0x7f51b006e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- 172.21.15.110:0/4254531946 shutdown_connections 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- 172.21.15.110:0/4254531946 wait complete. 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43140727a0 0x7f4314140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c1b40 0x7f43140cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c3450 0x7f43141fab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4314151470 con 0x7f43140c3450 2024-04-21T22:53:52.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4314157340 con 0x7f43140727a0 2024-04-21T22:53:52.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f431c684640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f431415d8c0 con 0x7f43140c1b40 2024-04-21T22:53:52.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f8e98ac7640 1 --2- 172.21.15.110:0/690193394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e9415ae60 0x7f8e940c8af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009d90 tx=0x7f8e8c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fade27f332acfa5a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 Processor -- start 2024-04-21T22:53:52.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- start start 2024-04-21T22:53:52.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f2e4bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4c150980 0x7f2e4c13ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b006bc70 0x7f51b01e6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b0072ce0 0x7f51b01f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b01544d0 0x7f51b01599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f51b015e380 con 0x7f51b0072ce0 2024-04-21T22:53:52.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51b015e0a0 con 0x7f51b01544d0 2024-04-21T22:53:52.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.214+0000 7f51b4d36640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f51b006b1e0 con 0x7f51b006bc70 2024-04-21T22:53:52.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.218+0000 7f2e4bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4c150980 0x7f2e4c13ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60290/0 (socket says 172.21.15.110:60290) 2024-04-21T22:53:52.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.218+0000 7f2e4bfff640 1 -- 172.21.15.110:0/4166668785 learned_addr learned my addr 172.21.15.110:0/4166668785 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:52.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.222+0000 7f2e4bfff640 1 -- 172.21.15.110:0/4166668785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c5760 msgr2=0x7f2e4c14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.222+0000 7f2e4bfff640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c5760 0x7f2e4c14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.222+0000 7f2e4bfff640 1 -- 172.21.15.110:0/4166668785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e4c0c3750 msgr2=0x7f2e4c154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.222+0000 7f2e4bfff640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e4c0c3750 0x7f2e4c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.222+0000 7f2e4bfff640 1 -- 172.21.15.110:0/4166668785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4c149b00 con 0x7f2e4c150980 2024-04-21T22:53:52.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.226+0000 7f2e4bfff640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4c150980 0x7f2e4c13ce70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400c7b0 tx=0x7f2e4400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.226+0000 7f51add9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b0072ce0 0x7f51b01f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.226+0000 7f51add9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b0072ce0 0x7f51b01f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60312/0 (socket says 172.21.15.110:60312) 2024-04-21T22:53:52.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.226+0000 7f51add9b640 1 -- 172.21.15.110:0/3295814387 learned_addr learned my addr 172.21.15.110:0/3295814387 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:52.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e92ffd640 1 -- 172.21.15.110:0/690193394 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0b2070 con 0x7f8e9415ae60 2024-04-21T22:53:52.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e92ffd640 1 -- 172.21.15.110:0/690193394 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0a5980 con 0x7f8e9415ae60 2024-04-21T22:53:52.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e92ffd640 1 -- 172.21.15.110:0/690193394 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0a5d50 con 0x7f8e9415ae60 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 -- 172.21.15.110:0/690193394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e9415ae60 msgr2=0x7f8e940c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/690193394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e9415ae60 0x7f8e940c8af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009d90 tx=0x7f8e8c01c900 comp rx=0 tx=0).stop 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 -- 172.21.15.110:0/690193394 shutdown_connections 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/690193394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e9415ae60 0x7f8e940c8af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/690193394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e94154440 0x7f8e940c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 -- 172.21.15.110:0/690193394 >> 172.21.15.110:0/690193394 conn(0x7f8e94062670 msgr2=0x7f8e94071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 -- 172.21.15.110:0/690193394 shutdown_connections 2024-04-21T22:53:52.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 -- 172.21.15.110:0/690193394 wait complete. 2024-04-21T22:53:52.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 Processor -- start 2024-04-21T22:53:52.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.230+0000 7f8e9a52a640 1 -- start start 2024-04-21T22:53:52.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f8e9a52a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e9406c2f0 0x7f8e941f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f8e9a52a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e94154440 0x7f8e9415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f8e9a52a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e9415ae60 0x7f8e9415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f8e9a52a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941549a0 con 0x7f8e94154440 2024-04-21T22:53:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f8e9a52a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94154820 con 0x7f8e9415ae60 2024-04-21T22:53:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f8e9a52a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8e941673f0 con 0x7f8e9406c2f0 2024-04-21T22:53:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f431ac21640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c3450 0x7f43141fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f2e33fff640 1 -- 172.21.15.110:0/4166668785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44017070 con 0x7f2e4c150980 2024-04-21T22:53:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4c155b50 con 0x7f2e4c150980 2024-04-21T22:53:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e4c156110 con 0x7f2e4c150980 2024-04-21T22:53:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.234+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4c04f510 con 0x7f2e4c150980 2024-04-21T22:53:52.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.238+0000 7f51add9b640 1 -- 172.21.15.110:0/3295814387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b006bc70 msgr2=0x7f51b01e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.238+0000 7f51add9b640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b006bc70 0x7f51b01e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.238+0000 7f51add9b640 1 -- 172.21.15.110:0/3295814387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b01544d0 msgr2=0x7f51b01599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.238+0000 7f51add9b640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b01544d0 0x7f51b01599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.238+0000 7f51add9b640 1 -- 172.21.15.110:0/3295814387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b00cd050 con 0x7f51b0072ce0 2024-04-21T22:53:52.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.242+0000 7f431ac21640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c3450 0x7f43141fab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60302/0 (socket says 172.21.15.110:60302) 2024-04-21T22:53:52.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.242+0000 7f431ac21640 1 -- 172.21.15.110:0/761064319 learned_addr learned my addr 172.21.15.110:0/761064319 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:52.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.242+0000 7f2e33fff640 1 -- 172.21.15.110:0/4166668785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e44003d90 con 0x7f2e4c150980 2024-04-21T22:53:52.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.242+0000 7f2e33fff640 1 -- 172.21.15.110:0/4166668785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44021060 con 0x7f2e4c150980 2024-04-21T22:53:52.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.242+0000 7f51add9b640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b0072ce0 0x7f51b01f3e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f51a40b3040 tx=0x7f51a401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.246+0000 7f431ac21640 1 -- 172.21.15.110:0/761064319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c1b40 msgr2=0x7f43140cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.246+0000 7f431ac21640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c1b40 0x7f43140cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.246+0000 7f431ac21640 1 -- 172.21.15.110:0/761064319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43140727a0 msgr2=0x7f4314140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.246+0000 7f431ac21640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43140727a0 0x7f4314140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.246+0000 7f431ac21640 1 -- 172.21.15.110:0/761064319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4314142a00 con 0x7f43140c3450 2024-04-21T22:53:52.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.254+0000 7fba8affd640 1 -- 172.21.15.110:0/1367410118 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba94018020 con 0x7fba980c3450 2024-04-21T22:53:52.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.254+0000 7fba8affd640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fba7c067910 0x7fba7c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.254+0000 7fba9e475640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fba7c067910 0x7fba7c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.254+0000 7fba9e475640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fba7c067910 0x7fba7c069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006fd0 tx=0x7fba8c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.258+0000 7fba8affd640 1 -- 172.21.15.110:0/1367410118 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fba94056530 con 0x7fba980c3450 2024-04-21T22:53:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.270+0000 7fba8affd640 1 -- 172.21.15.110:0/1367410118 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fba9401f020 con 0x7fba980c3450 2024-04-21T22:53:52.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.350+0000 7f7202ffd640 1 -- 172.21.15.110:0/3513603788 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f720c0545e0 con 0x7f72141efa30 2024-04-21T22:53:52.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.366+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb3f8153d40 con 0x7fb3f81504b0 2024-04-21T22:53:52.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.378+0000 7f7202ffd640 1 -- 172.21.15.110:0/3513603788 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f720c026080 con 0x7f72141efa30 2024-04-21T22:53:52.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.382+0000 7f8e98ac7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e9415ae60 0x7f8e9415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.386+0000 7f8e98ac7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e9415ae60 0x7f8e9415cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47656/0 (socket says 172.21.15.110:47656) 2024-04-21T22:53:52.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.386+0000 7f8e98ac7640 1 -- 172.21.15.110:0/106956742 learned_addr learned my addr 172.21.15.110:0/106956742 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:52.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.394+0000 7f8e98ac7640 1 -- 172.21.15.110:0/106956742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e9406c2f0 msgr2=0x7f8e941f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.394+0000 7f8e98ac7640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e9406c2f0 0x7f8e941f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.394+0000 7f8e98ac7640 1 -- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e94154440 msgr2=0x7f8e9415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.394+0000 7f8e98ac7640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e94154440 0x7f8e9415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.394+0000 7f8e98ac7640 1 -- 172.21.15.110:0/106956742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e941534b0 con 0x7f8e9415ae60 2024-04-21T22:53:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.406+0000 7f8e98ac7640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e9415ae60 0x7f8e9415cbb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c01d1a0 tx=0x7f8e8c0196a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.426+0000 7f8e90ff9640 1 -- 172.21.15.110:0/106956742 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0b2040 con 0x7f8e9415ae60 2024-04-21T22:53:52.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.426+0000 7f8e90ff9640 1 -- 172.21.15.110:0/106956742 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0bd070 con 0x7f8e9415ae60 2024-04-21T22:53:52.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.426+0000 7f8e90ff9640 1 -- 172.21.15.110:0/106956742 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0ad860 con 0x7f8e9415ae60 2024-04-21T22:53:52.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.426+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e941f6d80 con 0x7f8e9415ae60 2024-04-21T22:53:52.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.426+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e94153a30 con 0x7f8e9415ae60 2024-04-21T22:53:52.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.426+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e9404f510 con 0x7f8e9415ae60 2024-04-21T22:53:52.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.494+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fba98073030 con 0x7fba980c3450 2024-04-21T22:53:52.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.538+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f721406b7f0 con 0x7f72141efa30 2024-04-21T22:53:52.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.550+0000 7f431ac21640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c3450 0x7f43141fab40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f430c00b9a0 tx=0x7f430c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.570+0000 7f2e33fff640 1 -- 172.21.15.110:0/4166668785 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e4401a070 con 0x7f2e4c150980 2024-04-21T22:53:52.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.574+0000 7f2e33fff640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e380678c0 0x7f2e38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.574+0000 7f2e4b7fe640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e380678c0 0x7f2e38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.574+0000 7f2e4b7fe640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e380678c0 0x7f2e38069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009690 tx=0x7f2e3c006c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.582+0000 7f231d7fa640 1 -- 172.21.15.110:0/2527903649 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f231800ac30 con 0x7f2320150f30 2024-04-21T22:53:52.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.582+0000 7f231d7fa640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2304067910 0x7f2304069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.582+0000 7f2324efa640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2304067910 0x7f2304069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.582+0000 7f2324efa640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2304067910 0x7f2304069dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f230c0b1000 tx=0x7f230c0a9070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.590+0000 7f2e33fff640 1 -- 172.21.15.110:0/4166668785 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2e44053ce0 con 0x7f2e4c150980 2024-04-21T22:53:52.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.590+0000 7f2e33fff640 1 -- 172.21.15.110:0/4166668785 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2e44055c40 con 0x7f2e4c150980 2024-04-21T22:53:52.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.594+0000 7f231d7fa640 1 -- 172.21.15.110:0/2527903649 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2318054b30 con 0x7f2320150f30 2024-04-21T22:53:52.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.598+0000 7f519effd640 1 -- 172.21.15.110:0/3295814387 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40bf070 con 0x7f51b0072ce0 2024-04-21T22:53:52.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.598+0000 7f519effd640 1 -- 172.21.15.110:0/3295814387 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a40b0720 con 0x7f51b0072ce0 2024-04-21T22:53:52.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.598+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b01f4340 con 0x7f51b0072ce0 2024-04-21T22:53:52.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.598+0000 7f519effd640 1 -- 172.21.15.110:0/3295814387 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40b5040 con 0x7f51b0072ce0 2024-04-21T22:53:52.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.598+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b00cd500 con 0x7f51b0072ce0 2024-04-21T22:53:52.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.598+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b004f510 con 0x7f51b0072ce0 2024-04-21T22:53:52.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.614+0000 7fb3ee7fc640 1 -- 172.21.15.110:0/33568154 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3f00565a0 con 0x7fb3f81504b0 2024-04-21T22:53:52.612 INFO:teuthology.orchestra.run.smithi110.stdout:64424509453 2024-04-21T22:53:52.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.614+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb3dc067910 msgr2=0x7fb3dc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb3dc067910 0x7fb3dc069dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009690 tx=0x7fb3f4006c00 comp rx=0 tx=0).stop 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f81504b0 msgr2=0x7fb3f8140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f81504b0 0x7fb3f8140890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0001a60 tx=0x7fb3f0001f20 comp rx=0 tx=0).stop 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 shutdown_connections 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb3dc067910 0x7fb3dc069dd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3f81504b0 0x7fb3f8140890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f80c79d0 0x7fb3f8140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 --2- 172.21.15.110:0/33568154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3f806fc80 0x7fb3f814df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 >> 172.21.15.110:0/33568154 conn(0x7fb3f806b3b0 msgr2=0x7fb3f80713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 shutdown_connections 2024-04-21T22:53:52.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.618+0000 7fb3fe9d9640 1 -- 172.21.15.110:0/33568154 wait complete. 2024-04-21T22:53:52.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.626+0000 7f231d7fa640 1 -- 172.21.15.110:0/2527903649 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2318057190 con 0x7f2320150f30 2024-04-21T22:53:52.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.0 2024-04-21T22:53:52.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.658+0000 7fba8affd640 1 -- 172.21.15.110:0/1367410118 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba94058b90 con 0x7fba980c3450 2024-04-21T22:53:52.657 INFO:teuthology.orchestra.run.smithi110.stdout:60129542159 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fba7c067910 msgr2=0x7fba7c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fba7c067910 0x7fba7c069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006fd0 tx=0x7fba8c008040 comp rx=0 tx=0).stop 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba980c3450 msgr2=0x7fba9814ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba980c3450 0x7fba9814ede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fba94001eb0 tx=0x7fba9400c8f0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 shutdown_connections 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fba7c067910 0x7fba7c069dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba98150f30 0x7fba981f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba980c3450 0x7fba9814ede0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 --2- 172.21.15.110:0/1367410118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba980727a0 0x7fba98152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 >> 172.21.15.110:0/1367410118 conn(0x7fba9806e590 msgr2=0x7fba98070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 shutdown_connections 2024-04-21T22:53:52.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.662+0000 7fbaa06d9640 1 -- 172.21.15.110:0/1367410118 wait complete. 2024-04-21T22:53:52.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.7 2024-04-21T22:53:52.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.742+0000 7f8e90ff9640 1 -- 172.21.15.110:0/106956742 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e8c0ada00 con 0x7f8e9415ae60 2024-04-21T22:53:52.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.742+0000 7f8e90ff9640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e80067910 0x7f8e80069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.742+0000 7f8e93fff640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e80067910 0x7f8e80069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.742+0000 7f8e93fff640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e80067910 0x7f8e80069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009770 tx=0x7f8e88008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.754+0000 7f8e90ff9640 1 -- 172.21.15.110:0/106956742 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8e8c002020 con 0x7f8e9415ae60 2024-04-21T22:53:52.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.762+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2e4c0cba00 con 0x7f2e4c150980 2024-04-21T22:53:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.782+0000 7f8e90ff9640 1 -- 172.21.15.110:0/106956742 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f8e8c016520 con 0x7f8e9415ae60 2024-04-21T22:53:52.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.798+0000 7f7202ffd640 1 -- 172.21.15.110:0/3513603788 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72141eff90 con 0x7f72141efa30 2024-04-21T22:53:52.796 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:52.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f71f4067940 msgr2=0x7f71f4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f71f4067940 0x7f71f4069e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7204001560 tx=0x7f7204007a30 comp rx=0 tx=0).stop 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141efa30 msgr2=0x7f7214143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141efa30 0x7f7214143640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7214072560 tx=0x7f720c00f4a0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 shutdown_connections 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f71f4067940 0x7f71f4069e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141efa30 0x7f7214143640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72140c2c50 0x7f721415a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 --2- 172.21.15.110:0/3513603788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72140c2870 0x7f721414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 >> 172.21.15.110:0/3513603788 conn(0x7f721406e590 msgr2=0x7f72141512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 shutdown_connections 2024-04-21T22:53:52.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.802+0000 7f7218ba2640 1 -- 172.21.15.110:0/3513603788 wait complete. 2024-04-21T22:53:52.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.3 2024-04-21T22:53:52.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.826+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f23201441e0 con 0x7f2320150f30 2024-04-21T22:53:52.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.834+0000 7f231d7fa640 1 -- 172.21.15.110:0/2527903649 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2318056a90 con 0x7f2320150f30 2024-04-21T22:53:52.835 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:52.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2304067910 msgr2=0x7f2304069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2304067910 0x7f2304069dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f230c0b1000 tx=0x7f230c0a9070 comp rx=0 tx=0).stop 2024-04-21T22:53:52.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320150f30 msgr2=0x7f2320141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320150f30 0x7f2320141260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f231800c7a0 tx=0x7f231800cc60 comp rx=0 tx=0).stop 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 shutdown_connections 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2304067910 0x7f2304069dd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320150f30 0x7f2320141260 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23200c3450 0x7f23201fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 --2- 172.21.15.110:0/2527903649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23200727a0 0x7f23200cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 >> 172.21.15.110:0/2527903649 conn(0x7f232006e590 msgr2=0x7f232006e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 shutdown_connections 2024-04-21T22:53:52.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.838+0000 7f232715e640 1 -- 172.21.15.110:0/2527903649 wait complete. 2024-04-21T22:53:52.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.6 2024-04-21T22:53:52.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.894+0000 7f519effd640 1 -- 172.21.15.110:0/3295814387 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51a40c2070 con 0x7f51b0072ce0 2024-04-21T22:53:52.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.894+0000 7f519effd640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5190067940 0x7f5190069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:52.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.894+0000 7f51ae59c640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5190067940 0x7f5190069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.894+0000 7f51ae59c640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5190067940 0x7f5190069e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006aa0 tx=0x7f51a0006a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:52.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.918+0000 7f519effd640 1 -- 172.21.15.110:0/3295814387 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f51a40a8910 con 0x7f51b0072ce0 2024-04-21T22:53:52.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.918+0000 7f519effd640 1 -- 172.21.15.110:0/3295814387 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f51a40c9080 con 0x7f51b0072ce0 2024-04-21T22:53:52.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.938+0000 7f430affd640 1 -- 172.21.15.110:0/761064319 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c019070 con 0x7f43140c3450 2024-04-21T22:53:52.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.938+0000 7f430affd640 1 -- 172.21.15.110:0/761064319 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c00cbc0 con 0x7f43140c3450 2024-04-21T22:53:52.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.938+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4314140750 con 0x7f43140c3450 2024-04-21T22:53:52.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.938+0000 7f430affd640 1 -- 172.21.15.110:0/761064319 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c014440 con 0x7f43140c3450 2024-04-21T22:53:52.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.938+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4314142440 con 0x7f43140c3450 2024-04-21T22:53:52.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.938+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f431413c1a0 con 0x7f43140c3450 2024-04-21T22:53:52.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e33fff640 1 -- 172.21.15.110:0/4166668785 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e44059f40 con 0x7f2e4c150980 2024-04-21T22:53:52.940 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e380678c0 msgr2=0x7f2e38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e380678c0 0x7f2e38069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009690 tx=0x7f2e3c006c00 comp rx=0 tx=0).stop 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4c150980 msgr2=0x7f2e4c13ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4c150980 0x7f2e4c13ce70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400c7b0 tx=0x7f2e4400cc70 comp rx=0 tx=0).stop 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 shutdown_connections 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e380678c0 0x7f2e38069d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4c150980 0x7f2e4c13ce70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e4c0c5760 0x7f2e4c14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 --2- 172.21.15.110:0/4166668785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e4c0c3750 0x7f2e4c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.942+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 >> 172.21.15.110:0/4166668785 conn(0x7f2e4c0cc250 msgr2=0x7f2e4c14bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.946+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 shutdown_connections 2024-04-21T22:53:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.946+0000 7f2e51d60640 1 -- 172.21.15.110:0/4166668785 wait complete. 2024-04-21T22:53:52.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.4 2024-04-21T22:53:52.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.990+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8e94157c70 con 0x7f8e9415ae60 2024-04-21T22:53:52.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:52.998+0000 7f8e90ff9640 1 -- 172.21.15.110:0/106956742 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e8c0f1b00 con 0x7f8e9415ae60 2024-04-21T22:53:52.999 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:53.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e80067910 msgr2=0x7f8e80069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e80067910 0x7f8e80069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009770 tx=0x7f8e88008040 comp rx=0 tx=0).stop 2024-04-21T22:53:53.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e9415ae60 msgr2=0x7f8e9415cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e9415ae60 0x7f8e9415cbb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c01d1a0 tx=0x7f8e8c0196a0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 shutdown_connections 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e80067910 0x7f8e80069dd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e9415ae60 0x7f8e9415cbb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e94154440 0x7f8e9415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 --2- 172.21.15.110:0/106956742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e9406c2f0 0x7f8e941f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 >> 172.21.15.110:0/106956742 conn(0x7f8e94062670 msgr2=0x7f8e94159670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 shutdown_connections 2024-04-21T22:53:53.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.002+0000 7f8e9a52a640 1 -- 172.21.15.110:0/106956742 wait complete. 2024-04-21T22:53:53.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.1 2024-04-21T22:53:53.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.102+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f51b0158130 con 0x7f51b0072ce0 2024-04-21T22:53:53.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.234+0000 7f430affd640 1 -- 172.21.15.110:0/761064319 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f430c01c070 con 0x7f43140c3450 2024-04-21T22:53:53.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.234+0000 7f430affd640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f42f80678f0 0x7f42f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.234+0000 7f431a420640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f42f80678f0 0x7f42f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.234+0000 7f431a420640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f42f80678f0 0x7f42f8069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4310000f70 tx=0x7f4310007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.274+0000 7f430affd640 1 -- 172.21.15.110:0/761064319 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f430c054310 con 0x7f43140c3450 2024-04-21T22:53:53.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.274+0000 7f430affd640 1 -- 172.21.15.110:0/761064319 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f431413c1a0 con 0x7f43140c3450 2024-04-21T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f519effd640 1 -- 172.21.15.110:0/3295814387 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51a40187f0 con 0x7f51b0072ce0 2024-04-21T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5190067940 msgr2=0x7f5190069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5190067940 0x7f5190069e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006aa0 tx=0x7f51a0006a30 comp rx=0 tx=0).stop 2024-04-21T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b0072ce0 msgr2=0x7f51b01f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b0072ce0 0x7f51b01f3e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f51a40b3040 tx=0x7f51a401ba30 comp rx=0 tx=0).stop 2024-04-21T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 shutdown_connections 2024-04-21T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5190067940 0x7f5190069e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b01544d0 0x7f51b01599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b0072ce0 0x7f51b01f3e00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 --2- 172.21.15.110:0/3295814387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b006bc70 0x7f51b01e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.374+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 >> 172.21.15.110:0/3295814387 conn(0x7f51b006e590 msgr2=0x7f51b01528a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.378+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 shutdown_connections 2024-04-21T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.378+0000 7f51b4d36640 1 -- 172.21.15.110:0/3295814387 wait complete. 2024-04-21T22:53:53.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.2 2024-04-21T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.446+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f431404f510 con 0x7f43140c3450 2024-04-21T22:53:53.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.518+0000 7f430affd640 1 -- 172.21.15.110:0/761064319 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f430c023020 con 0x7f43140c3450 2024-04-21T22:53:53.519 INFO:teuthology.orchestra.run.smithi110.stdout:60129542158 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f42f80678f0 msgr2=0x7f42f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f42f80678f0 0x7f42f8069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4310000f70 tx=0x7f4310007a90 comp rx=0 tx=0).stop 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c3450 msgr2=0x7f43141fab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c3450 0x7f43141fab40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f430c00b9a0 tx=0x7f430c00be60 comp rx=0 tx=0).stop 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 shutdown_connections 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f42f80678f0 0x7f42f8069db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43140c3450 0x7f43141fab40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c1b40 0x7f43140cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 --2- 172.21.15.110:0/761064319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43140727a0 0x7f4314140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 >> 172.21.15.110:0/761064319 conn(0x7f431406e590 msgr2=0x7f431406e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 shutdown_connections 2024-04-21T22:53:53.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.522+0000 7f431c684640 1 -- 172.21.15.110:0/761064319 wait complete. 2024-04-21T22:53:53.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542159 got 60129542158 for osd.5 2024-04-21T22:53:53.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-21T22:53:53.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-21T22:53:53.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.758+0000 7f380aa22640 1 Processor -- start 2024-04-21T22:53:53.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.758+0000 7f380aa22640 1 -- start start 2024-04-21T22:53:53.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.758+0000 7f380aa22640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38040c6c20 0x7f3804150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.758+0000 7f380aa22640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3804156f60 con 0x7f3804073230 2024-04-21T22:53:53.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.758+0000 7f380aa22640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38040c3f40 con 0x7f3804073610 2024-04-21T22:53:53.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.758+0000 7f380aa22640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f38040c5e60 con 0x7f38040c6c20 2024-04-21T22:53:53.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.762+0000 7f3803fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3804073230 0x7f38040c7620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36128/0 (socket says 172.21.15.110:36128) 2024-04-21T22:53:53.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.762+0000 7f3803fff640 1 -- 172.21.15.110:0/3459720198 learned_addr learned my addr 172.21.15.110:0/3459720198 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:53.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.762+0000 7f38037fe640 1 --2- 172.21.15.110:0/3459720198 >> v2:172.21.15.154:3300/0 conn(0x7f38040c6c20 0x7f3804150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.762+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876179423 0 0) 0x7f3804156f60 con 0x7f3804073230 2024-04-21T22:53:53.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.762+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37ec003530 con 0x7f3804073230 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2508468979 0 0) 0x7f37ec003530 con 0x7f3804073230 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 >> v2:172.21.15.154:3300/0 conn(0x7f38040c6c20 msgr2=0x7f3804150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 --2- 172.21.15.110:0/3459720198 >> v2:172.21.15.154:3300/0 conn(0x7f38040c6c20 0x7f3804150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 >> v1:172.21.15.154:6789/0 conn(0x7f3804073610 legacy=0x7f3804157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38040c4220 con 0x7f3804073230 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f37fc001a20 con 0x7f3804073230 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 >> v1:172.21.15.110:6789/0 conn(0x7f3804073230 legacy=0x7f38040c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec003a10 0x7f37ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec004810 0x7f37ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec0051d0 0x7f37ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec00c0a0 con 0x7f37ec004810 2024-04-21T22:53:53.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec00c220 con 0x7f37ec0051d0 2024-04-21T22:53:53.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.766+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec00c420 con 0x7f37ec003a10 2024-04-21T22:53:53.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.770+0000 7f38037fe640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec004810 0x7f37ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.774+0000 7f3803fff640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec003a10 0x7f37ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.774+0000 7f38037fe640 1 -- 172.21.15.110:0/3459720198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec003a10 msgr2=0x7f37ec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.774+0000 7f38037fe640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec003a10 0x7f37ec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.774+0000 7f38037fe640 1 -- 172.21.15.110:0/3459720198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec0051d0 msgr2=0x7f37ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.774+0000 7f38037fe640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec0051d0 0x7f37ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.774+0000 7f38037fe640 1 -- 172.21.15.110:0/3459720198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec003530 con 0x7f37ec004810 2024-04-21T22:53:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.774+0000 7f3808fbf640 1 -- 172.21.15.110:0/3459720198 reap_dead start 2024-04-21T22:53:53.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.778+0000 7f38037fe640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec004810 0x7f37ec004c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009ae0 tx=0x7f37f801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b102bfa792f3981 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80b2070 con 0x7f37ec004810 2024-04-21T22:53:53.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80a5590 con 0x7f37ec004810 2024-04-21T22:53:53.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f3802ffd640 1 -- 172.21.15.110:0/3459720198 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80096b0 con 0x7f37ec004810 2024-04-21T22:53:53.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f380aa22640 1 -- 172.21.15.110:0/3459720198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec004810 msgr2=0x7f37ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f380aa22640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec004810 0x7f37ec004c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009ae0 tx=0x7f37f801cab0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f380aa22640 1 -- 172.21.15.110:0/3459720198 shutdown_connections 2024-04-21T22:53:53.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f380aa22640 1 --2- 172.21.15.110:0/3459720198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec004810 0x7f37ec004c90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f380aa22640 1 -- 172.21.15.110:0/3459720198 >> 172.21.15.110:0/3459720198 conn(0x7f38040cc930 msgr2=0x7f38040ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:53.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f380aa22640 1 -- 172.21.15.110:0/3459720198 shutdown_connections 2024-04-21T22:53:53.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.782+0000 7f380aa22640 1 -- 172.21.15.110:0/3459720198 wait complete. 2024-04-21T22:53:53.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 Processor -- start 2024-04-21T22:53:53.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 -- start start 2024-04-21T22:53:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec004810 0x7f3804149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f380414d0d0 0x7f38041e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38041f07e0 0x7f38041f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f38040c4ac0 con 0x7f38041f07e0 2024-04-21T22:53:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38040c47e0 con 0x7f37ec004810 2024-04-21T22:53:53.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f380aa22640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f38040c7620 con 0x7f380414d0d0 2024-04-21T22:53:53.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f3808fbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38041f07e0 0x7f38041f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f3808fbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38041f07e0 0x7f38041f0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60324/0 (socket says 172.21.15.110:60324) 2024-04-21T22:53:53.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f3808fbf640 1 -- 172.21.15.110:0/1390792425 learned_addr learned my addr 172.21.15.110:0/1390792425 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:53.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f38037fe640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f380414d0d0 0x7f38041e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.786+0000 7f3803fff640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec004810 0x7f3804149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.790+0000 7f3808fbf640 1 -- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f380414d0d0 msgr2=0x7f38041e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.790+0000 7f3808fbf640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f380414d0d0 0x7f38041e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.790+0000 7f3808fbf640 1 -- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec004810 msgr2=0x7f3804149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.790+0000 7f3808fbf640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec004810 0x7f3804149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.790+0000 7f3808fbf640 1 -- 172.21.15.110:0/1390792425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38041f11a0 con 0x7f38041f07e0 2024-04-21T22:53:53.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.790+0000 7f3808fbf640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38041f07e0 0x7f38041f0c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c390 tx=0x7f37f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.794+0000 7f3800ff9640 1 -- 172.21.15.110:0/1390792425 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4004bb0 con 0x7f38041f07e0 2024-04-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.794+0000 7f3800ff9640 1 -- 172.21.15.110:0/1390792425 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4004d70 con 0x7f38041f07e0 2024-04-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.794+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380414a000 con 0x7f38041f07e0 2024-04-21T22:53:53.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.794+0000 7f3800ff9640 1 -- 172.21.15.110:0/1390792425 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4007270 con 0x7f38041f07e0 2024-04-21T22:53:53.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.794+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38041e4030 con 0x7f38041f07e0 2024-04-21T22:53:53.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.798+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f380404f510 con 0x7f38041f07e0 2024-04-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.798+0000 7f3fe72fe640 1 Processor -- start 2024-04-21T22:53:53.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.798+0000 7f3fe72fe640 1 -- start start 2024-04-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe72fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fe0151050 0x7f3fe00c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe72fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fe006eb90 0x7f3fe00c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe72fe640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe006efa0 con 0x7f3fe015a5a0 2024-04-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe72fe640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe006e7b0 con 0x7f3fe006eb90 2024-04-21T22:53:53.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe72fe640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe00c7a20 con 0x7f3fe0151050 2024-04-21T22:53:53.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe509a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fe0151050 0x7f3fe00c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe509a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fe0151050 0x7f3fe00c1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47682/0 (socket says 172.21.15.110:47682) 2024-04-21T22:53:53.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.802+0000 7f3fe509a640 1 -- 172.21.15.110:0/2108419660 learned_addr learned my addr 172.21.15.110:0/2108419660 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:53.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.810+0000 7f3fe509a640 1 -- 172.21.15.110:0/2108419660 >> v2:172.21.15.110:3300/0 conn(0x7f3fe006eb90 msgr2=0x7f3fe00c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.810+0000 7f3fe509a640 1 --2- 172.21.15.110:0/2108419660 >> v2:172.21.15.110:3300/0 conn(0x7f3fe006eb90 0x7f3fe00c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.810+0000 7f3fe509a640 1 -- 172.21.15.110:0/2108419660 >> v1:172.21.15.154:6789/0 conn(0x7f3fe015a5a0 legacy=0x7f3fe01579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.810+0000 7f3fe509a640 1 -- 172.21.15.110:0/2108419660 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe0151430 con 0x7f3fe0151050 2024-04-21T22:53:53.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.814+0000 7f3fe509a640 1 --2- 172.21.15.110:0/2108419660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 0x7f3fe00c1b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00c72a0 tx=0x7f3fdc0213a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65840219e53d583e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.818+0000 7f3800ff9640 1 -- 172.21.15.110:0/1390792425 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37f4007410 con 0x7f38041f07e0 2024-04-21T22:53:53.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.818+0000 7f3800ff9640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37f0067940 0x7f37f0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.818+0000 7f3803fff640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37f0067940 0x7f37f0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.818+0000 7f3803fff640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37f0067940 0x7f37f0069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0013e0 tx=0x7f37fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-21T22:53:53.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.818+0000 7f3800ff9640 1 -- 172.21.15.110:0/1390792425 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f37f40536d0 con 0x7f38041f07e0 2024-04-21T22:53:53.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fd7fff640 1 -- 172.21.15.110:0/2108419660 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b6070 con 0x7f3fe0151050 2024-04-21T22:53:53.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fd7fff640 1 -- 172.21.15.110:0/2108419660 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0b1600 con 0x7f3fe0151050 2024-04-21T22:53:53.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fd7fff640 1 -- 172.21.15.110:0/2108419660 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b19d0 con 0x7f3fe0151050 2024-04-21T22:53:53.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 -- 172.21.15.110:0/2108419660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 msgr2=0x7f3fe00c1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/2108419660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 0x7f3fe00c1b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00c72a0 tx=0x7f3fdc0213a0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 -- 172.21.15.110:0/2108419660 shutdown_connections 2024-04-21T22:53:53.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/2108419660 >> v2:172.21.15.110:3300/0 conn(0x7f3fe006eb90 0x7f3fe00c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/2108419660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 0x7f3fe00c1b40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 -- 172.21.15.110:0/2108419660 >> 172.21.15.110:0/2108419660 conn(0x7f3fe006ca80 msgr2=0x7f3fe0070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:53.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 -- 172.21.15.110:0/2108419660 shutdown_connections 2024-04-21T22:53:53.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.826+0000 7f3fe72fe640 1 -- 172.21.15.110:0/2108419660 wait complete. 2024-04-21T22:53:53.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 Processor -- start 2024-04-21T22:53:53.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 -- start start 2024-04-21T22:53:53.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe006eb90 0x7f3fe0145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 0x7f3fe0154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fe015a5a0 0x7f3fe0142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe01571a0 con 0x7f3fe015a5a0 2024-04-21T22:53:53.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe006e170 con 0x7f3fe0151050 2024-04-21T22:53:53.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe72fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe00c75e0 con 0x7f3fe006eb90 2024-04-21T22:53:53.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe509a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe006eb90 0x7f3fe0145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe509a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe006eb90 0x7f3fe0145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48372/0 (socket says 172.21.15.110:48372) 2024-04-21T22:53:53.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.830+0000 7f3fe509a640 1 -- 172.21.15.110:0/536498204 learned_addr learned my addr 172.21.15.110:0/536498204 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:53.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.834+0000 7f3fe4899640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 0x7f3fe0154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.846+0000 7f3fe509a640 1 -- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 msgr2=0x7f3fe0154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.846+0000 7f3fe509a640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 0x7f3fe0154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.846+0000 7f3fe509a640 1 -- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fe015a5a0 msgr2=0x7f3fe0142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.846+0000 7f3fe509a640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fe015a5a0 0x7f3fe0142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.846+0000 7f3fe509a640 1 -- 172.21.15.110:0/536498204 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe01549f0 con 0x7f3fe006eb90 2024-04-21T22:53:53.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.854+0000 7f3fe509a640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe006eb90 0x7f3fe0145db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc01dfb0 tx=0x7f3fdc01e140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.860 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-21T22:53:53.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.862+0000 7f3fd5ffb640 1 -- 172.21.15.110:0/536498204 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b6040 con 0x7f3fe006eb90 2024-04-21T22:53:53.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.862+0000 7f3fd5ffb640 1 -- 172.21.15.110:0/536498204 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0c4070 con 0x7f3fe006eb90 2024-04-21T22:53:53.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.862+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe01ebd10 con 0x7f3fe006eb90 2024-04-21T22:53:53.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.862+0000 7f3fd5ffb640 1 -- 172.21.15.110:0/536498204 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0bc8a0 con 0x7f3fe006eb90 2024-04-21T22:53:53.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.862+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe01ec2d0 con 0x7f3fe006eb90 2024-04-21T22:53:53.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.866+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe004f510 con 0x7f3fe006eb90 2024-04-21T22:53:53.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.914+0000 7f3fd5ffb640 1 -- 172.21.15.110:0/536498204 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fdc0bca40 con 0x7f3fe006eb90 2024-04-21T22:53:53.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.918+0000 7f3fd5ffb640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3fc4067940 0x7f3fc4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.918+0000 7f3fe4899640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3fc4067940 0x7f3fc4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.918+0000 7f3fe4899640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3fc4067940 0x7f3fc4069e00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00c72a0 tx=0x7f3fd0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.930+0000 7f45af346640 1 Processor -- start 2024-04-21T22:53:53.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.930+0000 7f45af346640 1 -- start start 2024-04-21T22:53:53.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.930+0000 7f45af346640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a8151250 0x7f45a815b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.930+0000 7f45af346640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45a8156fc0 0x7f45a80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.930+0000 7f45af346640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a8157430 con 0x7f45a8073250 2024-04-21T22:53:53.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.930+0000 7f45af346640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f45a8073690 con 0x7f45a8156fc0 2024-04-21T22:53:53.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.930+0000 7f45af346640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f45a8072e00 con 0x7f45a8151250 2024-04-21T22:53:53.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.934+0000 7f45ac8e1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f45a8073250 0x7f45a80c3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:46690/0 (socket says 172.21.15.110:46690) 2024-04-21T22:53:53.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.934+0000 7f45ac8e1640 1 -- 172.21.15.110:0/3675657935 learned_addr learned my addr 172.21.15.110:0/3675657935 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:53.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.938+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338617736 0 0) 0x7f45a8157430 con 0x7f45a8073250 2024-04-21T22:53:53.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.938+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4594003530 con 0x7f45a8073250 2024-04-21T22:53:53.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1019466234 0 0) 0x7f4594003530 con 0x7f45a8073250 2024-04-21T22:53:53.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a8151250 msgr2=0x7f45a815b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a8151250 0x7f45a815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 >> v2:172.21.15.110:3300/0 conn(0x7f45a8156fc0 msgr2=0x7f45a80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 --2- 172.21.15.110:0/3675657935 >> v2:172.21.15.110:3300/0 conn(0x7f45a8156fc0 0x7f45a80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a8072840 con 0x7f45a8073250 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f4598001680 con 0x7f45a8073250 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 >> v1:172.21.15.154:6789/0 conn(0x7f45a8073250 legacy=0x7f45a80c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a8151250 0x7f45940039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4594004120 0x7f4594004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4594004e70 0x7f459400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8073690 con 0x7f4594004120 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8072e00 con 0x7f4594004e70 2024-04-21T22:53:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.950+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f45940055f0 con 0x7f45a8151250 2024-04-21T22:53:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.954+0000 7f45ad8e3640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4594004e70 0x7f459400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-21T22:53:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.966+0000 7f45ad8e3640 1 -- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a8151250 msgr2=0x7f45940039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.966+0000 7f45ad8e3640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a8151250 0x7f45940039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.966+0000 7f45ad8e3640 1 -- 172.21.15.110:0/3675657935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4594004120 msgr2=0x7f4594004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.966+0000 7f45ad8e3640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4594004120 0x7f4594004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.966+0000 7f45ad8e3640 1 -- 172.21.15.110:0/3675657935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4594003530 con 0x7f4594004e70 2024-04-21T22:53:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.970+0000 7f45ad8e3640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4594004e70 0x7f459400b9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009ca0 tx=0x7f45a001cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d879ed2af7bab00 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:53.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.974+0000 7fedd412d640 1 Processor -- start 2024-04-21T22:53:53.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.974+0000 7fedd412d640 1 -- start start 2024-04-21T22:53:53.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.974+0000 7fedd412d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fedcc072810 0x7fedcc06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.974+0000 7fedd412d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fedcc0ca2a0 0x7fedcc15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.974+0000 7fedd412d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedcc15b660 con 0x7fedcc151fd0 2024-04-21T22:53:53.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.974+0000 7fedd412d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fedcc158c70 con 0x7fedcc0ca2a0 2024-04-21T22:53:53.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.974+0000 7fedd412d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fedcc158f30 con 0x7fedcc072810 2024-04-21T22:53:53.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a00b2070 con 0x7f4594004e70 2024-04-21T22:53:53.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a00a5ca0 con 0x7f4594004e70 2024-04-21T22:53:53.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f459ffff640 1 -- 172.21.15.110:0/3675657935 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0006e60 con 0x7f4594004e70 2024-04-21T22:53:53.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f45af346640 1 -- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4594004e70 msgr2=0x7f459400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:53.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f45af346640 1 --2- 172.21.15.110:0/3675657935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4594004e70 0x7f459400b9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009ca0 tx=0x7f45a001cc70 comp rx=0 tx=0).stop 2024-04-21T22:53:53.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f45ad8e3640 1 -- 172.21.15.110:0/3675657935 reap_dead start 2024-04-21T22:53:53.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f45af346640 1 -- 172.21.15.110:0/3675657935 shutdown_connections 2024-04-21T22:53:53.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f45af346640 1 -- 172.21.15.110:0/3675657935 >> 172.21.15.110:0/3675657935 conn(0x7f45a806e5c0 msgr2=0x7f45a806e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:53.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f45af346640 1 -- 172.21.15.110:0/3675657935 shutdown_connections 2024-04-21T22:53:53.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.982+0000 7f45af346640 1 -- 172.21.15.110:0/3675657935 wait complete. 2024-04-21T22:53:53.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 Processor -- start 2024-04-21T22:53:53.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 -- start start 2024-04-21T22:53:53.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7fedd16c8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fedcc072810 0x7fedcc06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:53.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45a8159640 0x7f45a80c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a81e3010 0x7f45a80c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a8159a20 0x7f45a80c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:53.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f45a815a930 con 0x7f45a8159640 2024-04-21T22:53:53.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45a815a650 con 0x7f45a8159a20 2024-04-21T22:53:53.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.986+0000 7f45af346640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f45a8151630 con 0x7f45a81e3010 2024-04-21T22:53:53.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.990+0000 7fedd16c8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fedcc072810 0x7fedcc06b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47716/0 (socket says 172.21.15.110:47716) 2024-04-21T22:53:53.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.990+0000 7fedd16c8640 1 -- 172.21.15.110:0/1650970469 learned_addr learned my addr 172.21.15.110:0/1650970469 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:53.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.994+0000 7fedd16c8640 1 -- 172.21.15.110:0/1650970469 >> v2:172.21.15.110:3300/0 conn(0x7fedcc0ca2a0 msgr2=0x7fedcc15bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.994+0000 7fedd16c8640 1 --2- 172.21.15.110:0/1650970469 >> v2:172.21.15.110:3300/0 conn(0x7fedcc0ca2a0 0x7fedcc15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:53.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.994+0000 7fedd16c8640 1 -- 172.21.15.110:0/1650970469 >> v1:172.21.15.154:6789/0 conn(0x7fedcc151fd0 legacy=0x7fedcc0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:53.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:53.994+0000 7fedd16c8640 1 -- 172.21.15.110:0/1650970469 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc06ba10 con 0x7fedcc072810 2024-04-21T22:53:54.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.002+0000 7f45ad8e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a8159a20 0x7f45a80c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.002+0000 7f45ad8e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a8159a20 0x7f45a80c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47722/0 (socket says 172.21.15.110:47722) 2024-04-21T22:53:54.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.002+0000 7f45ad8e3640 1 -- 172.21.15.110:0/4172017332 learned_addr learned my addr 172.21.15.110:0/4172017332 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.010+0000 7fedd16c8640 1 --2- 172.21.15.110:0/1650970469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc072810 0x7fedcc06b1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fedcc06f3c0 tx=0x7fedbc01ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f287b35b8dd9b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.022+0000 7f45ad8e3640 1 -- 172.21.15.110:0/4172017332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a81e3010 msgr2=0x7f45a80c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.022+0000 7f45ad8e3640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a81e3010 0x7f45a80c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.022+0000 7f45ad8e3640 1 -- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45a8159640 msgr2=0x7f45a80c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.022+0000 7f45ad8e3640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45a8159640 0x7f45a80c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.022+0000 7f45ad8e3640 1 -- 172.21.15.110:0/4172017332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a81ef680 con 0x7f45a8159a20 2024-04-21T22:53:54.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-21T22:53:54.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.026+0000 7f45ad8e3640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a8159a20 0x7f45a80c38b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45a001c6e0 tx=0x7f4594005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd0ec7640 1 -- 172.21.15.110:0/1650970469 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0b5070 con 0x7fedcc072810 2024-04-21T22:53:54.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd0ec7640 1 -- 172.21.15.110:0/1650970469 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedbc0a89d0 con 0x7fedcc072810 2024-04-21T22:53:54.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd0ec7640 1 -- 172.21.15.110:0/1650970469 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0a8da0 con 0x7fedcc072810 2024-04-21T22:53:54.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- 172.21.15.110:0/1650970469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc072810 msgr2=0x7fedcc06b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 --2- 172.21.15.110:0/1650970469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc072810 0x7fedcc06b1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fedcc06f3c0 tx=0x7fedbc01ecd0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- 172.21.15.110:0/1650970469 shutdown_connections 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 --2- 172.21.15.110:0/1650970469 >> v2:172.21.15.110:3300/0 conn(0x7fedcc0ca2a0 0x7fedcc15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 --2- 172.21.15.110:0/1650970469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc072810 0x7fedcc06b1e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- 172.21.15.110:0/1650970469 >> 172.21.15.110:0/1650970469 conn(0x7fedcc06e590 msgr2=0x7fedcc06e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- 172.21.15.110:0/1650970469 shutdown_connections 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- 172.21.15.110:0/1650970469 wait complete. 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 Processor -- start 2024-04-21T22:53:54.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- start start 2024-04-21T22:53:54.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedcc072810 0x7fedcc0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fedcc0ca2a0 0x7fedcc1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc151fd0 0x7fedcc14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc1523b0 con 0x7fedcc072810 2024-04-21T22:53:54.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc06bfd0 con 0x7fedcc151fd0 2024-04-21T22:53:54.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.038+0000 7fedd412d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc152530 con 0x7fedcc0ca2a0 2024-04-21T22:53:54.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.046+0000 7fedd26ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc151fd0 0x7fedcc14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.046+0000 7f459dffb640 1 -- 172.21.15.110:0/4172017332 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a00b2040 con 0x7f45a8159a20 2024-04-21T22:53:54.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.046+0000 7f459dffb640 1 -- 172.21.15.110:0/4172017332 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a00a5e50 con 0x7f45a8159a20 2024-04-21T22:53:54.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.046+0000 7f459dffb640 1 -- 172.21.15.110:0/4172017332 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a00092f0 con 0x7f45a8159a20 2024-04-21T22:53:54.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.046+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a81ef940 con 0x7f45a8159a20 2024-04-21T22:53:54.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.046+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a81e17b0 con 0x7f45a8159a20 2024-04-21T22:53:54.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.050+0000 7fedd26ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc151fd0 0x7fedcc14ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47732/0 (socket says 172.21.15.110:47732) 2024-04-21T22:53:54.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.050+0000 7fedd26ca640 1 -- 172.21.15.110:0/1255753102 learned_addr learned my addr 172.21.15.110:0/1255753102 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.050+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a804f510 con 0x7f45a8159a20 2024-04-21T22:53:54.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.062+0000 7fedd26ca640 1 -- 172.21.15.110:0/1255753102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fedcc0ca2a0 msgr2=0x7fedcc1f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.062+0000 7fedd26ca640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fedcc0ca2a0 0x7fedcc1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.062+0000 7fedd26ca640 1 -- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedcc072810 msgr2=0x7fedcc0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.062+0000 7fedd26ca640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedcc072810 0x7fedcc0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.062+0000 7fedd26ca640 1 -- 172.21.15.110:0/1255753102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc14c5f0 con 0x7fedcc151fd0 2024-04-21T22:53:54.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.074+0000 7fb128e3e640 1 Processor -- start 2024-04-21T22:53:54.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.074+0000 7fb128e3e640 1 -- start start 2024-04-21T22:53:54.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.074+0000 7fb128e3e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb124158c60 0x7fb1240c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.074+0000 7fb128e3e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1240c9980 0x7fb1240ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.074+0000 7fb128e3e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb124152730 con 0x7fb124152350 2024-04-21T22:53:54.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.074+0000 7fb128e3e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb1240c8fd0 con 0x7fb124158c60 2024-04-21T22:53:54.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.074+0000 7fb128e3e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb12415b8a0 con 0x7fb1240c9980 2024-04-21T22:53:54.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.086+0000 7f3800ff9640 1 -- 172.21.15.110:0/1390792425 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f38041f11a0 con 0x7f38041f07e0 2024-04-21T22:53:54.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.094+0000 7fb11bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb124158c60 0x7fb1240c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.094+0000 7fb11bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb124158c60 0x7fb1240c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60422/0 (socket says 172.21.15.110:60422) 2024-04-21T22:53:54.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.094+0000 7fb11bfff640 1 -- 172.21.15.110:0/2217713800 learned_addr learned my addr 172.21.15.110:0/2217713800 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.094+0000 7fb11bfff640 1 -- 172.21.15.110:0/2217713800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1240c9980 msgr2=0x7fb1240ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.094+0000 7fb11bfff640 1 --2- 172.21.15.110:0/2217713800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1240c9980 0x7fb1240ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.094+0000 7fb11bfff640 1 -- 172.21.15.110:0/2217713800 >> v1:172.21.15.154:6789/0 conn(0x7fb124152350 legacy=0x7fb1240c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.094+0000 7fb11bfff640 1 -- 172.21.15.110:0/2217713800 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12415bb80 con 0x7fb124158c60 2024-04-21T22:53:54.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.098+0000 7fb11bfff640 1 --2- 172.21.15.110:0/2217713800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb124158c60 0x7fb1240c9440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009870 tx=0x7fb10c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adadd118267af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb121d9b640 1 -- 172.21.15.110:0/2217713800 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0b5070 con 0x7fb124158c60 2024-04-21T22:53:54.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb121d9b640 1 -- 172.21.15.110:0/2217713800 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c0a89d0 con 0x7fb124158c60 2024-04-21T22:53:54.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb121d9b640 1 -- 172.21.15.110:0/2217713800 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0a8da0 con 0x7fb124158c60 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 -- 172.21.15.110:0/2217713800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb124158c60 msgr2=0x7fb1240c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 --2- 172.21.15.110:0/2217713800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb124158c60 0x7fb1240c9440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009870 tx=0x7fb10c01ed10 comp rx=0 tx=0).stop 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 -- 172.21.15.110:0/2217713800 shutdown_connections 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 --2- 172.21.15.110:0/2217713800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1240c9980 0x7fb1240ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 --2- 172.21.15.110:0/2217713800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb124158c60 0x7fb1240c9440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 -- 172.21.15.110:0/2217713800 >> 172.21.15.110:0/2217713800 conn(0x7fb1240714d0 msgr2=0x7fb1240718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 -- 172.21.15.110:0/2217713800 shutdown_connections 2024-04-21T22:53:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.102+0000 7fb128e3e640 1 -- 172.21.15.110:0/2217713800 wait complete. 2024-04-21T22:53:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 Processor -- start 2024-04-21T22:53:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 -- start start 2024-04-21T22:53:54.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1240c9980 0x7fb12414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb124152350 0x7fb1240c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb124158c60 0x7fb12406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb12415c420 con 0x7fb1240c9980 2024-04-21T22:53:54.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb12415c140 con 0x7fb124158c60 2024-04-21T22:53:54.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb128e3e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb1240ca020 con 0x7fb124152350 2024-04-21T22:53:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb12259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1240c9980 0x7fb12414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb12259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1240c9980 0x7fb12414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60428/0 (socket says 172.21.15.110:60428) 2024-04-21T22:53:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.106+0000 7fb12259c640 1 -- 172.21.15.110:0/4010368402 learned_addr learned my addr 172.21.15.110:0/4010368402 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.110+0000 7fb12259c640 1 -- 172.21.15.110:0/4010368402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb124152350 msgr2=0x7fb1240c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.110+0000 7fb12259c640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb124152350 0x7fb1240c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.110+0000 7fb12259c640 1 -- 172.21.15.110:0/4010368402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb124158c60 msgr2=0x7fb12406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.110+0000 7fb12259c640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb124158c60 0x7fb12406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.110+0000 7fb12259c640 1 -- 172.21.15.110:0/4010368402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12414fe10 con 0x7fb1240c9980 2024-04-21T22:53:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.114+0000 7fb12259c640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1240c9980 0x7fb12414e490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c4c0 tx=0x7fb114001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.118+0000 7fb11affd640 1 -- 172.21.15.110:0/4010368402 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114017070 con 0x7fb1240c9980 2024-04-21T22:53:54.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.118+0000 7fb11affd640 1 -- 172.21.15.110:0/4010368402 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb114003600 con 0x7fb1240c9980 2024-04-21T22:53:54.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.118+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb124159fa0 con 0x7fb1240c9980 2024-04-21T22:53:54.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.118+0000 7fb11affd640 1 -- 172.21.15.110:0/4010368402 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1140039f0 con 0x7fb1240c9980 2024-04-21T22:53:54.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.118+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12415a280 con 0x7fb1240c9980 2024-04-21T22:53:54.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.118+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12404f510 con 0x7fb1240c9980 2024-04-21T22:53:54.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.138+0000 7fdae9970640 1 Processor -- start 2024-04-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.138+0000 7fdae9970640 1 -- start start 2024-04-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.138+0000 7fdae9970640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdae41619d0 0x7fdae4163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.138+0000 7fdae9970640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdae415c210 con 0x7fdae40727a0 2024-04-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.138+0000 7fdae9970640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdae406bb80 con 0x7fdae4152520 2024-04-21T22:53:54.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.138+0000 7fdae9970640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fdae415c4f0 con 0x7fdae41619d0 2024-04-21T22:53:54.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.222+0000 7f3fd5ffb640 1 -- 172.21.15.110:0/536498204 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3fdc0f5400 con 0x7f3fe006eb90 2024-04-21T22:53:54.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.250+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f38040c8db0 con 0x7f38041f07e0 2024-04-21T22:53:54.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.254+0000 7f3fd5ffb640 1 -- 172.21.15.110:0/536498204 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f3fdc0ce020 con 0x7f3fe006eb90 2024-04-21T22:53:54.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-21T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.398+0000 7f459dffb640 1 -- 172.21.15.110:0/4172017332 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45a0004040 con 0x7f45a8159a20 2024-04-21T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.402+0000 7f459dffb640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f458c067940 0x7f458c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.402+0000 7f45ad0e2640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f458c067940 0x7f458c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.402+0000 7f45ad0e2640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f458c067940 0x7f458c069e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45a40096b0 tx=0x7f45a4006cb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.406+0000 7fb11affd640 1 -- 172.21.15.110:0/4010368402 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb11401a070 con 0x7fb1240c9980 2024-04-21T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.406+0000 7fb11affd640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb104067940 0x7fb104069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.406+0000 7fb11bfff640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb104067940 0x7fb104069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.406+0000 7fb11bfff640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb104067940 0x7fb104069e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b2000 tx=0x7fb10c004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.410+0000 7f459dffb640 1 -- 172.21.15.110:0/4172017332 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f45a00ee0f0 con 0x7f45a8159a20 2024-04-21T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.414+0000 7fedd26ca640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc151fd0 0x7fedcc14ce90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b970 tx=0x7fedc400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.414+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3fe00c7fa0 con 0x7f3fe006eb90 2024-04-21T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.422+0000 7fb11affd640 1 -- 172.21.15.110:0/4010368402 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb114053950 con 0x7fb1240c9980 2024-04-21T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.422+0000 7fb11affd640 1 -- 172.21.15.110:0/4010368402 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fb114021020 con 0x7fb1240c9980 2024-04-21T22:53:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.422+0000 7fdae37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdae41619d0 0x7fdae4163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.422+0000 7fdae37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdae41619d0 0x7fdae4163dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60444/0 (socket says 172.21.15.110:60444) 2024-04-21T22:53:54.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.422+0000 7fdae37fe640 1 -- 172.21.15.110:0/531660782 learned_addr learned my addr 172.21.15.110:0/531660782 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.426+0000 7f3fd5ffb640 1 -- 172.21.15.110:0/536498204 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3fdc01af00 con 0x7f3fe006eb90 2024-04-21T22:53:54.426 INFO:teuthology.orchestra.run.smithi110.stdout:60129542159 2024-04-21T22:53:54.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3fc4067940 msgr2=0x7f3fc4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3fc4067940 0x7f3fc4069e00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00c72a0 tx=0x7f3fd0009040 comp rx=0 tx=0).stop 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe006eb90 msgr2=0x7f3fe0145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe006eb90 0x7f3fe0145db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc01dfb0 tx=0x7f3fdc01e140 comp rx=0 tx=0).stop 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 shutdown_connections 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3fc4067940 0x7f3fc4069e00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fe015a5a0 0x7f3fe0142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe0151050 0x7f3fe0154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 --2- 172.21.15.110:0/536498204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe006eb90 0x7f3fe0145db0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 >> 172.21.15.110:0/536498204 conn(0x7f3fe006ca80 msgr2=0x7f3fe006bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 shutdown_connections 2024-04-21T22:53:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.430+0000 7f3fe72fe640 1 -- 172.21.15.110:0/536498204 wait complete. 2024-04-21T22:53:54.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.434+0000 7fdae37fe640 1 -- 172.21.15.110:0/531660782 >> v1:172.21.15.154:6789/0 conn(0x7fdae4152520 legacy=0x7fdae4158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.434+0000 7fdae37fe640 1 -- 172.21.15.110:0/531660782 >> v1:172.21.15.110:6789/0 conn(0x7fdae40727a0 legacy=0x7fdae40705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.434+0000 7fdae37fe640 1 -- 172.21.15.110:0/531660782 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae406be60 con 0x7fdae41619d0 2024-04-21T22:53:54.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.446+0000 7f459dffb640 1 -- 172.21.15.110:0/4172017332 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f45a0008030 con 0x7f45a8159a20 2024-04-21T22:53:54.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542159 for osd.7 2024-04-21T22:53:54.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.450+0000 7fdae37fe640 1 --2- 172.21.15.110:0/531660782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae4163dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009e50 tx=0x7fdadc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08263013e5e2bc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f3800ff9640 1 -- 172.21.15.110:0/1390792425 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37f4001d10 con 0x7f38041f07e0 2024-04-21T22:53:54.452 INFO:teuthology.orchestra.run.smithi110.stdout:64424509453 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37f0067940 msgr2=0x7f37f0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37f0067940 0x7f37f0069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0013e0 tx=0x7f37fc009040 comp rx=0 tx=0).stop 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38041f07e0 msgr2=0x7f38041f0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38041f07e0 0x7f38041f0c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c390 tx=0x7f37f400c850 comp rx=0 tx=0).stop 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 shutdown_connections 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f37f0067940 0x7f37f0069e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38041f07e0 0x7f38041f0c60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f380414d0d0 0x7f38041e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 --2- 172.21.15.110:0/1390792425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec004810 0x7f3804149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 >> 172.21.15.110:0/1390792425 conn(0x7f38040cc930 msgr2=0x7f38040c61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7fdae1ffb640 1 -- 172.21.15.110:0/531660782 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0a56c0 con 0x7fdae41619d0 2024-04-21T22:53:54.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 shutdown_connections 2024-04-21T22:53:54.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.454+0000 7f380aa22640 1 -- 172.21.15.110:0/1390792425 wait complete. 2024-04-21T22:53:54.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.462+0000 7fdae1ffb640 1 -- 172.21.15.110:0/531660782 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdadc0a5860 con 0x7fdae41619d0 2024-04-21T22:53:54.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.462+0000 7fdae1ffb640 1 -- 172.21.15.110:0/531660782 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0a5c30 con 0x7fdae41619d0 2024-04-21T22:53:54.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- 172.21.15.110:0/531660782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 msgr2=0x7fdae4163dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 --2- 172.21.15.110:0/531660782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae4163dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009e50 tx=0x7fdadc01c9f0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- 172.21.15.110:0/531660782 shutdown_connections 2024-04-21T22:53:54.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 --2- 172.21.15.110:0/531660782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae4163dc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- 172.21.15.110:0/531660782 >> 172.21.15.110:0/531660782 conn(0x7fdae406e5c0 msgr2=0x7fdae406e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- 172.21.15.110:0/531660782 shutdown_connections 2024-04-21T22:53:54.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- 172.21.15.110:0/531660782 wait complete. 2024-04-21T22:53:54.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 Processor -- start 2024-04-21T22:53:54.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- start start 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae40727a0 0x7fdae4163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdae4152520 0x7fdae4160e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae41453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdae40738a0 con 0x7fdae41619d0 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4073720 con 0x7fdae40727a0 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.466+0000 7fdae9970640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdae4070cf0 con 0x7fdae4152520 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.470+0000 7fdae37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae41453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.470+0000 7fdae37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae41453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60458/0 (socket says 172.21.15.110:60458) 2024-04-21T22:53:54.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.470+0000 7fdae37fe640 1 -- 172.21.15.110:0/1939389932 learned_addr learned my addr 172.21.15.110:0/1939389932 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.474+0000 7fdae37fe640 1 -- 172.21.15.110:0/1939389932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdae4152520 msgr2=0x7fdae4160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.474+0000 7fdae37fe640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdae4152520 0x7fdae4160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.474+0000 7fdae37fe640 1 -- 172.21.15.110:0/1939389932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae40727a0 msgr2=0x7fdae4163ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.474+0000 7fdae37fe640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae40727a0 0x7fdae4163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.474+0000 7fdae37fe640 1 -- 172.21.15.110:0/1939389932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae4161db0 con 0x7fdae41619d0 2024-04-21T22:53:54.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.474+0000 7fdae37fe640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae41453a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0af040 tx=0x7fdadc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.0 2024-04-21T22:53:54.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.482+0000 7fedc27fc640 1 -- 172.21.15.110:0/1255753102 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4019070 con 0x7fedcc151fd0 2024-04-21T22:53:54.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.482+0000 7fdacbfff640 1 -- 172.21.15.110:0/1939389932 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0b8470 con 0x7fdae41619d0 2024-04-21T22:53:54.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fdacbfff640 1 -- 172.21.15.110:0/1939389932 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdadc0b8630 con 0x7fdae41619d0 2024-04-21T22:53:54.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fdacbfff640 1 -- 172.21.15.110:0/1939389932 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0b8a20 con 0x7fdae41619d0 2024-04-21T22:53:54.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae4162070 con 0x7fdae41619d0 2024-04-21T22:53:54.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae41632e0 con 0x7fdae41619d0 2024-04-21T22:53:54.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fedc27fc640 1 -- 172.21.15.110:0/1255753102 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc400cb60 con 0x7fedcc151fd0 2024-04-21T22:53:54.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fedc27fc640 1 -- 172.21.15.110:0/1255753102 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4014440 con 0x7fedcc151fd0 2024-04-21T22:53:54.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc0cae70 con 0x7fedcc151fd0 2024-04-21T22:53:54.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc0cb430 con 0x7fedcc151fd0 2024-04-21T22:53:54.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.486+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb40052a0 con 0x7fedcc151fd0 2024-04-21T22:53:54.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.490+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae404f510 con 0x7fdae41619d0 2024-04-21T22:53:54.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.506+0000 7fdacbfff640 1 -- 172.21.15.110:0/1939389932 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdadc0c0070 con 0x7fdae41619d0 2024-04-21T22:53:54.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.506+0000 7fdacbfff640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdad0067940 0x7fdad0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.506+0000 7fdae2ffd640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdad0067940 0x7fdad0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.506+0000 7fdae2ffd640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdad0067940 0x7fdad0069e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdad4007fd0 tx=0x7fdad40079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.510+0000 7fdacbfff640 1 -- 172.21.15.110:0/1939389932 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdadc0ef2b0 con 0x7fdae41619d0 2024-04-21T22:53:54.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.538+0000 7f3927ef3640 1 Processor -- start 2024-04-21T22:53:54.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.542+0000 7f3927ef3640 1 -- start start 2024-04-21T22:53:54.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-21T22:53:54.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.542+0000 7f3927ef3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3920061ff0 0x7f392006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.542+0000 7f3927ef3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3920154930 con 0x7f392006f390 2024-04-21T22:53:54.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.542+0000 7f3927ef3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392015ae30 con 0x7f3920154550 2024-04-21T22:53:54.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.542+0000 7f3927ef3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f39200c8020 con 0x7f3920061ff0 2024-04-21T22:53:54.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.614+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb124150420 con 0x7fb1240c9980 2024-04-21T22:53:54.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.626+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f45a8073030 con 0x7f45a8159a20 2024-04-21T22:53:54.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.650+0000 7fe0a3a9c640 1 Processor -- start 2024-04-21T22:53:54.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.650+0000 7fe0a3a9c640 1 -- start start 2024-04-21T22:53:54.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.650+0000 7fe0a3a9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.650+0000 7fe0a3a9c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c5fa0 0x7fe09c158080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.650+0000 7fe0a3a9c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09c158780 con 0x7fe09c061c30 2024-04-21T22:53:54.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.650+0000 7fe0a3a9c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe09c159020 con 0x7fe09c0c5fa0 2024-04-21T22:53:54.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.650+0000 7fe0a3a9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c158a60 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.654+0000 7fe0a1838640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.654+0000 7fe0a1838640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c0c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48452/0 (socket says 172.21.15.110:48452) 2024-04-21T22:53:54.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.654+0000 7fe0a1838640 1 -- 172.21.15.110:0/1434505508 learned_addr learned my addr 172.21.15.110:0/1434505508 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.658+0000 7fe0a1838640 1 -- 172.21.15.110:0/1434505508 >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c5fa0 msgr2=0x7fe09c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.658+0000 7fe0a1838640 1 --2- 172.21.15.110:0/1434505508 >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c5fa0 0x7fe09c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.658+0000 7fe0a1838640 1 -- 172.21.15.110:0/1434505508 >> v1:172.21.15.154:6789/0 conn(0x7fe09c061c30 legacy=0x7fe09c06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.658+0000 7fe0a1838640 1 -- 172.21.15.110:0/1434505508 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c158d40 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.666+0000 7fe0a1838640 1 --2- 172.21.15.110:0/1434505508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c0c7610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe098009870 tx=0x7fe09801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f256bb886f0cd9ac server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a0836640 1 -- 172.21.15.110:0/1434505508 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a6040 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a0836640 1 -- 172.21.15.110:0/1434505508 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0980af070 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a0836640 1 -- 172.21.15.110:0/1434505508 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980aa860 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1434505508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 msgr2=0x7fe09c0c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1434505508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c0c7610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe098009870 tx=0x7fe09801c520 comp rx=0 tx=0).stop 2024-04-21T22:53:54.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1434505508 shutdown_connections 2024-04-21T22:53:54.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1434505508 >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c5fa0 0x7fe09c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1434505508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c0c7610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1434505508 >> 172.21.15.110:0/1434505508 conn(0x7fe09c0cc250 msgr2=0x7fe09c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1434505508 shutdown_connections 2024-04-21T22:53:54.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1434505508 wait complete. 2024-04-21T22:53:54.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 Processor -- start 2024-04-21T22:53:54.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- start start 2024-04-21T22:53:54.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c061c30 0x7fe09c13ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c1f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c0c5fa0 0x7fe09c0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c164da0 con 0x7fe09c0c5fa0 2024-04-21T22:53:54.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c164c20 con 0x7fe09c061c30 2024-04-21T22:53:54.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.674+0000 7fe0a3a9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c164f20 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.678+0000 7fe0a1037640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c1f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.678+0000 7fe0a1037640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c1f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48460/0 (socket says 172.21.15.110:48460) 2024-04-21T22:53:54.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.678+0000 7fe0a1037640 1 -- 172.21.15.110:0/1198707880 learned_addr learned my addr 172.21.15.110:0/1198707880 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.686+0000 7fe0a1037640 1 -- 172.21.15.110:0/1198707880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c061c30 msgr2=0x7fe09c13ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.686+0000 7fe0a1037640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c061c30 0x7fe09c13ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.686+0000 7fe0a1037640 1 -- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c0c5fa0 msgr2=0x7fe09c0c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.686+0000 7fe0a1037640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c0c5fa0 0x7fe09c0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.686+0000 7fe0a1037640 1 -- 172.21.15.110:0/1198707880 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c062210 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.694+0000 7fe0a1037640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c1f32c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00b3f0 tx=0x7fe08c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.702+0000 7fe0927fc640 1 -- 172.21.15.110:0/1198707880 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c015020 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.702+0000 7fe0927fc640 1 -- 172.21.15.110:0/1198707880 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08c011850 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.702+0000 7fe0927fc640 1 -- 172.21.15.110:0/1198707880 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011c40 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.702+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c0c4cf0 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.702+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c13c610 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.702+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09c04f510 con 0x7fe09c0c5bc0 2024-04-21T22:53:54.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.750+0000 7fb11affd640 1 -- 172.21.15.110:0/4010368402 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb114055fb0 con 0x7fb1240c9980 2024-04-21T22:53:54.750 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:54.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb104067940 msgr2=0x7fb104069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb104067940 0x7fb104069e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b2000 tx=0x7fb10c004740 comp rx=0 tx=0).stop 2024-04-21T22:53:54.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1240c9980 msgr2=0x7fb12414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1240c9980 0x7fb12414e490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c4c0 tx=0x7fb114001e80 comp rx=0 tx=0).stop 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 shutdown_connections 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb104067940 0x7fb104069e00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb124158c60 0x7fb12406cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb124152350 0x7fb1240c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 --2- 172.21.15.110:0/4010368402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1240c9980 0x7fb12414e490 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 >> 172.21.15.110:0/4010368402 conn(0x7fb1240714d0 msgr2=0x7fb124151010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 shutdown_connections 2024-04-21T22:53:54.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.754+0000 7fb128e3e640 1 -- 172.21.15.110:0/4010368402 wait complete. 2024-04-21T22:53:54.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.762+0000 7fdacbfff640 1 -- 172.21.15.110:0/1939389932 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fdadc0165e0 con 0x7fdae41619d0 2024-04-21T22:53:54.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.762+0000 7f3926490640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f392006f390 0x7f3920164bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36152/0 (socket says 172.21.15.110:36152) 2024-04-21T22:53:54.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.762+0000 7f3926490640 1 -- 172.21.15.110:0/2501268272 learned_addr learned my addr 172.21.15.110:0/2501268272 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:54.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.4 2024-04-21T22:53:54.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.838+0000 7fedc27fc640 1 -- 172.21.15.110:0/1255753102 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fedc401c070 con 0x7fedcc151fd0 2024-04-21T22:53:54.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.838+0000 7fedc27fc640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fedb0067910 0x7fedb0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.842+0000 7fedd1ec9640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fedb0067910 0x7fedb0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.842+0000 7fedd1ec9640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fedb0067910 0x7fedb0069dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009670 tx=0x7fedc8006bd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.850+0000 7fedc27fc640 1 -- 172.21.15.110:0/1255753102 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fedc4054340 con 0x7fedcc151fd0 2024-04-21T22:53:54.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.866+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156070347 0 0) 0x7f3920154930 con 0x7f392006f390 2024-04-21T22:53:54.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.866+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f390c003530 con 0x7f392006f390 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3182478149 0 0) 0x7f390c003530 con 0x7f392006f390 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 >> v2:172.21.15.154:3300/0 conn(0x7f3920061ff0 msgr2=0x7f392006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 --2- 172.21.15.110:0/2501268272 >> v2:172.21.15.154:3300/0 conn(0x7f3920061ff0 0x7f392006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 >> v1:172.21.15.154:6789/0 conn(0x7f3920154550 legacy=0x7f392006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392015b110 con 0x7f392006f390 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f3918001a00 con 0x7f392006f390 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 >> v1:172.21.15.110:6789/0 conn(0x7f392006f390 legacy=0x7f3920164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f390c003a10 0x7f390c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f390c004810 0x7f390c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f390c0052f0 0x7f390c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39200c8020 con 0x7f390c003a10 2024-04-21T22:53:54.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f390c00c230 con 0x7f390c0052f0 2024-04-21T22:53:54.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f390c00c430 con 0x7f390c004810 2024-04-21T22:53:54.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.874+0000 7f3925c8f640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f390c003a10 0x7f390c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.878+0000 7fedc27fc640 1 -- 172.21.15.110:0/1255753102 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fedc4023020 con 0x7fedcc151fd0 2024-04-21T22:53:54.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.882+0000 7f3925c8f640 1 -- 172.21.15.110:0/2501268272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f390c004810 msgr2=0x7f390c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.882+0000 7f3925c8f640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f390c004810 0x7f390c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.882+0000 7f3925c8f640 1 -- 172.21.15.110:0/2501268272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f390c0052f0 msgr2=0x7f390c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:54.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.882+0000 7f3925c8f640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f390c0052f0 0x7f390c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.882+0000 7f3925c8f640 1 -- 172.21.15.110:0/2501268272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c003530 con 0x7f390c003a10 2024-04-21T22:53:54.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.882+0000 7f3926490640 1 -- 172.21.15.110:0/2501268272 reap_dead start 2024-04-21T22:53:54.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.886+0000 7f3925c8f640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f390c003a10 0x7f390c003e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f391c007fd0 tx=0x7f391c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580b3388ae9d6183 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.890+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c001250 con 0x7f390c003a10 2024-04-21T22:53:54.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391c005270 con 0x7f390c003a10 2024-04-21T22:53:54.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3924c8d640 1 -- 172.21.15.110:0/2501268272 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c003860 con 0x7f390c003a10 2024-04-21T22:53:54.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3927ef3640 1 -- 172.21.15.110:0/2501268272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f390c003a10 msgr2=0x7f390c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3927ef3640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f390c003a10 0x7f390c003e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f391c007fd0 tx=0x7f391c01c2e0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3927ef3640 1 -- 172.21.15.110:0/2501268272 shutdown_connections 2024-04-21T22:53:54.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3927ef3640 1 --2- 172.21.15.110:0/2501268272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f390c003a10 0x7f390c003e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3927ef3640 1 -- 172.21.15.110:0/2501268272 >> 172.21.15.110:0/2501268272 conn(0x7f39200cc250 msgr2=0x7f39200cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:54.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3927ef3640 1 -- 172.21.15.110:0/2501268272 shutdown_connections 2024-04-21T22:53:54.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.894+0000 7f3927ef3640 1 -- 172.21.15.110:0/2501268272 wait complete. 2024-04-21T22:53:54.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 Processor -- start 2024-04-21T22:53:54.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 -- start start 2024-04-21T22:53:54.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f390c003a10 0x7f39200c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39201f1530 0x7f39201f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3920152b90 0x7f3920153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39200c7cb0 con 0x7f3920152b90 2024-04-21T22:53:54.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39200c79d0 con 0x7f39201f1530 2024-04-21T22:53:54.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3927ef3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f39200c7010 con 0x7f390c003a10 2024-04-21T22:53:54.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3926490640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3920152b90 0x7f3920153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3926490640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3920152b90 0x7f3920153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60504/0 (socket says 172.21.15.110:60504) 2024-04-21T22:53:54.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.898+0000 7f3926490640 1 -- 172.21.15.110:0/4256955763 learned_addr learned my addr 172.21.15.110:0/4256955763 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:54.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.906+0000 7f3926490640 1 -- 172.21.15.110:0/4256955763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f390c003a10 msgr2=0x7f39200c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.906+0000 7f3926490640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f390c003a10 0x7f39200c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.906+0000 7f3926490640 1 -- 172.21.15.110:0/4256955763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39201f1530 msgr2=0x7f39201f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:54.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.906+0000 7f3926490640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39201f1530 0x7f39201f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:54.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.906+0000 7f3926490640 1 -- 172.21.15.110:0/4256955763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39201f4330 con 0x7f3920152b90 2024-04-21T22:53:54.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.910+0000 7f3926490640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3920152b90 0x7f3920153010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3920061f80 tx=0x7f391800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.914+0000 7f39167fc640 1 -- 172.21.15.110:0/4256955763 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391800dae0 con 0x7f3920152b90 2024-04-21T22:53:54.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.914+0000 7f39167fc640 1 -- 172.21.15.110:0/4256955763 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391800dc80 con 0x7f3920152b90 2024-04-21T22:53:54.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.914+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39201f02d0 con 0x7f3920152b90 2024-04-21T22:53:54.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.914+0000 7f39167fc640 1 -- 172.21.15.110:0/4256955763 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918017420 con 0x7f3920152b90 2024-04-21T22:53:54.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.914+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39201f0890 con 0x7f3920152b90 2024-04-21T22:53:54.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.914+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392004f510 con 0x7f3920152b90 2024-04-21T22:53:54.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.946+0000 7f39167fc640 1 -- 172.21.15.110:0/4256955763 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3918014070 con 0x7f3920152b90 2024-04-21T22:53:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.946+0000 7f39167fc640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3904067910 0x7f3904069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.950+0000 7f3925c8f640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3904067910 0x7f3904069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.950+0000 7f3925c8f640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3904067910 0x7f3904069dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f391c0aa000 tx=0x7f391c000fc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:54.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.954+0000 7f39167fc640 1 -- 172.21.15.110:0/4256955763 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3918057090 con 0x7f3920152b90 2024-04-21T22:53:54.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:54.962+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdae406ee90 con 0x7fdae41619d0 2024-04-21T22:53:55.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f459dffb640 1 -- 172.21.15.110:0/4172017332 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f45a0016980 con 0x7f45a8159a20 2024-04-21T22:53:55.009 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:55.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f458c067940 msgr2=0x7f458c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f458c067940 0x7f458c069e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45a40096b0 tx=0x7f45a4006cb0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a8159a20 msgr2=0x7f45a80c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a8159a20 0x7f45a80c38b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45a001c6e0 tx=0x7f4594005840 comp rx=0 tx=0).stop 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 shutdown_connections 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f458c067940 0x7f458c069e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a8159a20 0x7f45a80c38b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a81e3010 0x7f45a80c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 --2- 172.21.15.110:0/4172017332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45a8159640 0x7f45a80c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.010+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 >> 172.21.15.110:0/4172017332 conn(0x7f45a806e5c0 msgr2=0x7f45a8154e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.014+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 shutdown_connections 2024-04-21T22:53:55.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.014+0000 7f45af346640 1 -- 172.21.15.110:0/4172017332 wait complete. 2024-04-21T22:53:55.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.022+0000 7fe0927fc640 1 -- 172.21.15.110:0/1198707880 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe08c018020 con 0x7fe09c0c5bc0 2024-04-21T22:53:55.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.022+0000 7fe0927fc640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe080067910 0x7fe080069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.022+0000 7fe0a1838640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe080067910 0x7fe080069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.022+0000 7fe0a1838640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe080067910 0x7fe080069dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0980ae000 tx=0x7fe098008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.3 2024-04-21T22:53:55.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.030+0000 7fe0927fc640 1 -- 172.21.15.110:0/1198707880 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe08c011de0 con 0x7fe09c0c5bc0 2024-04-21T22:53:55.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.062+0000 7fe0927fc640 1 -- 172.21.15.110:0/1198707880 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fe08c01f020 con 0x7fe09c0c5bc0 2024-04-21T22:53:55.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.070+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fedb4005860 con 0x7fedcc151fd0 2024-04-21T22:53:55.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedc27fc640 1 -- 172.21.15.110:0/1255753102 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fedc40569a0 con 0x7fedcc151fd0 2024-04-21T22:53:55.075 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fedb0067910 msgr2=0x7fedb0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fedb0067910 0x7fedb0069dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009670 tx=0x7fedc8006bd0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc151fd0 msgr2=0x7fedcc14ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc151fd0 0x7fedcc14ce90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b970 tx=0x7fedc400be30 comp rx=0 tx=0).stop 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 shutdown_connections 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fedb0067910 0x7fedb0069dd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedcc151fd0 0x7fedcc14ce90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fedcc0ca2a0 0x7fedcc1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 --2- 172.21.15.110:0/1255753102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedcc072810 0x7fedcc0cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 >> 172.21.15.110:0/1255753102 conn(0x7fedcc06e590 msgr2=0x7fedcc150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 shutdown_connections 2024-04-21T22:53:55.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.078+0000 7fedd412d640 1 -- 172.21.15.110:0/1255753102 wait complete. 2024-04-21T22:53:55.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.6 2024-04-21T22:53:55.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.226+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe09c0c5430 con 0x7fe09c0c5bc0 2024-04-21T22:53:55.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0927fc640 1 -- 172.21.15.110:0/1198707880 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe08c00f2e0 con 0x7fe09c0c5bc0 2024-04-21T22:53:55.231 INFO:teuthology.orchestra.run.smithi110.stdout:60129542158 2024-04-21T22:53:55.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe080067910 msgr2=0x7fe080069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe080067910 0x7fe080069dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0980ae000 tx=0x7fe098008040 comp rx=0 tx=0).stop 2024-04-21T22:53:55.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 msgr2=0x7fe09c1f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c1f32c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00b3f0 tx=0x7fe08c00b8b0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 shutdown_connections 2024-04-21T22:53:55.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe080067910 0x7fe080069dd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c0c5fa0 0x7fe09c0c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe09c0c5bc0 0x7fe09c1f32c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 --2- 172.21.15.110:0/1198707880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c061c30 0x7fe09c13ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 >> 172.21.15.110:0/1198707880 conn(0x7fe09c0cc250 msgr2=0x7fe09c1571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 shutdown_connections 2024-04-21T22:53:55.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.234+0000 7fe0a3a9c640 1 -- 172.21.15.110:0/1198707880 wait complete. 2024-04-21T22:53:55.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542159 got 60129542158 for osd.5 2024-04-21T22:53:55.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.258+0000 7f39167fc640 1 -- 172.21.15.110:0/4256955763 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f391801d060 con 0x7f3920152b90 2024-04-21T22:53:55.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.274+0000 7fdacbfff640 1 -- 172.21.15.110:0/1939389932 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdadc0f1910 con 0x7fdae41619d0 2024-04-21T22:53:55.275 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:55.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdad0067940 msgr2=0x7fdad0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdad0067940 0x7fdad0069e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdad4007fd0 tx=0x7fdad40079a0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 msgr2=0x7fdae41453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae41453a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0af040 tx=0x7fdadc019790 comp rx=0 tx=0).stop 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 shutdown_connections 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fdad0067940 0x7fdad0069e00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae41619d0 0x7fdae41453a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdae4152520 0x7fdae4160e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 --2- 172.21.15.110:0/1939389932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae40727a0 0x7fdae4163ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 >> 172.21.15.110:0/1939389932 conn(0x7fdae406e5c0 msgr2=0x7fdae4158820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 shutdown_connections 2024-04-21T22:53:55.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.278+0000 7fdae9970640 1 -- 172.21.15.110:0/1939389932 wait complete. 2024-04-21T22:53:55.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.1 2024-04-21T22:53:55.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.434+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3920157c50 con 0x7f3920152b90 2024-04-21T22:53:55.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-21T22:53:55.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.454+0000 7f39167fc640 1 -- 172.21.15.110:0/4256955763 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39180596f0 con 0x7f3920152b90 2024-04-21T22:53:55.453 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:55.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3904067910 msgr2=0x7f3904069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3904067910 0x7f3904069dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f391c0aa000 tx=0x7f391c000fc0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3920152b90 msgr2=0x7f3920153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3920152b90 0x7f3920153010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3920061f80 tx=0x7f391800ff00 comp rx=0 tx=0).stop 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 shutdown_connections 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3904067910 0x7f3904069dd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3920152b90 0x7f3920153010 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39201f1530 0x7f39201f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 --2- 172.21.15.110:0/4256955763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f390c003a10 0x7f39200c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 >> 172.21.15.110:0/4256955763 conn(0x7f39200cc250 msgr2=0x7f392006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 shutdown_connections 2024-04-21T22:53:55.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.458+0000 7f3927ef3640 1 -- 172.21.15.110:0/4256955763 wait complete. 2024-04-21T22:53:55.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.2 2024-04-21T22:53:55.473 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:55.482 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-21T22:53:55.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.570+0000 7f2c13813640 1 Processor -- start 2024-04-21T22:53:55.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.570+0000 7f2c13813640 1 -- start start 2024-04-21T22:53:55.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c13813640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c0c154790 0x7f2c0c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c13813640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c061fc0 0x7f2c0c06de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c13813640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c0c06b430 con 0x7f2c0c1543b0 2024-04-21T22:53:55.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c13813640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2c0c0c7720 con 0x7f2c0c154790 2024-04-21T22:53:55.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c13813640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0c06b1e0 con 0x7f2c0c061fc0 2024-04-21T22:53:55.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c10dae640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c0c154790 0x7f2c0c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c10dae640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c0c154790 0x7f2c0c15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60520/0 (socket says 172.21.15.110:60520) 2024-04-21T22:53:55.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c10dae640 1 -- 172.21.15.110:0/4206765387 learned_addr learned my addr 172.21.15.110:0/4206765387 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:55.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c11db0640 1 --2- 172.21.15.110:0/4206765387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c061fc0 0x7f2c0c06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c10dae640 1 -- 172.21.15.110:0/4206765387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c061fc0 msgr2=0x7f2c0c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:55.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c10dae640 1 --2- 172.21.15.110:0/4206765387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c061fc0 0x7f2c0c06de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c10dae640 1 -- 172.21.15.110:0/4206765387 >> v1:172.21.15.154:6789/0 conn(0x7f2c0c1543b0 legacy=0x7f2c0c0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.574+0000 7f2c10dae640 1 -- 172.21.15.110:0/4206765387 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c06b710 con 0x7f2c0c154790 2024-04-21T22:53:55.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.578+0000 7f2c10dae640 1 --2- 172.21.15.110:0/4206765387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c154790 0x7f2c0c15acd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009870 tx=0x7f2c0001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a69a0904fb65f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c0bfff640 1 -- 172.21.15.110:0/4206765387 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000ab650 con 0x7f2c0c154790 2024-04-21T22:53:55.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c0bfff640 1 -- 172.21.15.110:0/4206765387 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c000b0070 con 0x7f2c0c154790 2024-04-21T22:53:55.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c0bfff640 1 -- 172.21.15.110:0/4206765387 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000aba10 con 0x7f2c0c154790 2024-04-21T22:53:55.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- 172.21.15.110:0/4206765387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c154790 msgr2=0x7f2c0c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 --2- 172.21.15.110:0/4206765387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c154790 0x7f2c0c15acd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009870 tx=0x7f2c0001c560 comp rx=0 tx=0).stop 2024-04-21T22:53:55.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- 172.21.15.110:0/4206765387 shutdown_connections 2024-04-21T22:53:55.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 --2- 172.21.15.110:0/4206765387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c061fc0 0x7f2c0c06de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 --2- 172.21.15.110:0/4206765387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c154790 0x7f2c0c15acd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- 172.21.15.110:0/4206765387 >> 172.21.15.110:0/4206765387 conn(0x7f2c0c0cc250 msgr2=0x7f2c0c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- 172.21.15.110:0/4206765387 shutdown_connections 2024-04-21T22:53:55.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- 172.21.15.110:0/4206765387 wait complete. 2024-04-21T22:53:55.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 Processor -- start 2024-04-21T22:53:55.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- start start 2024-04-21T22:53:55.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c061fc0 0x7f2c0c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c1543b0 0x7f2c0c149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c154790 0x7f2c0c14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1675c0 con 0x7f2c0c061fc0 2024-04-21T22:53:55.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c167440 con 0x7f2c0c154790 2024-04-21T22:53:55.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.586+0000 7f2c13813640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0c167740 con 0x7f2c0c1543b0 2024-04-21T22:53:55.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c061fc0 0x7f2c0c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c061fc0 0x7f2c0c157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60524/0 (socket says 172.21.15.110:60524) 2024-04-21T22:53:55.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 -- 172.21.15.110:0/601119510 learned_addr learned my addr 172.21.15.110:0/601119510 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:55.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c10dae640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c1543b0 0x7f2c0c149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c11db0640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c154790 0x7f2c0c14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 -- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c1543b0 msgr2=0x7f2c0c149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c1543b0 0x7f2c0c149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 -- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c154790 msgr2=0x7f2c0c14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c154790 0x7f2c0c14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.590+0000 7f2c115af640 1 -- 172.21.15.110:0/601119510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c147c10 con 0x7f2c0c061fc0 2024-04-21T22:53:55.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.594+0000 7f2c115af640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c061fc0 0x7f2c0c157370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c7f0 tx=0x7f2c0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.598+0000 7f2c09ffb640 1 -- 172.21.15.110:0/601119510 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04003b80 con 0x7f2c0c061fc0 2024-04-21T22:53:55.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.598+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c150480 con 0x7f2c0c061fc0 2024-04-21T22:53:55.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.598+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1f7030 con 0x7f2c0c061fc0 2024-04-21T22:53:55.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.598+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0c04f510 con 0x7f2c0c061fc0 2024-04-21T22:53:55.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.598+0000 7f2c09ffb640 1 -- 172.21.15.110:0/601119510 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04003d20 con 0x7f2c0c061fc0 2024-04-21T22:53:55.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.598+0000 7f2c09ffb640 1 -- 172.21.15.110:0/601119510 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c040018c0 con 0x7f2c0c061fc0 2024-04-21T22:53:55.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91db46b640 1 Processor -- start 2024-04-21T22:53:55.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91db46b640 1 -- start start 2024-04-21T22:53:55.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91db46b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91d41573b0 0x7f91d406de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91db46b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91d4159d30 0x7f91d406c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91db46b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d406e520 con 0x7f91d4150a80 2024-04-21T22:53:55.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91db46b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f91d406cac0 con 0x7f91d41573b0 2024-04-21T22:53:55.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91db46b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f91d406e800 con 0x7f91d4159d30 2024-04-21T22:53:55.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.642+0000 7f91d9a08640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91d4159d30 0x7f91d406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.646+0000 7f91d9a08640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91d4159d30 0x7f91d406c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47790/0 (socket says 172.21.15.110:47790) 2024-04-21T22:53:55.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.646+0000 7f91d9a08640 1 -- 172.21.15.110:0/2200275958 learned_addr learned my addr 172.21.15.110:0/2200275958 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:55.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.650+0000 7f91d9a08640 1 -- 172.21.15.110:0/2200275958 >> v2:172.21.15.110:3300/0 conn(0x7f91d41573b0 msgr2=0x7f91d406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:55.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.650+0000 7f91d9a08640 1 --2- 172.21.15.110:0/2200275958 >> v2:172.21.15.110:3300/0 conn(0x7f91d41573b0 0x7f91d406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.650+0000 7f91d9a08640 1 -- 172.21.15.110:0/2200275958 >> v1:172.21.15.154:6789/0 conn(0x7f91d4150a80 legacy=0x7f91d406edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:55.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.650+0000 7f91d9a08640 1 -- 172.21.15.110:0/2200275958 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d406eae0 con 0x7f91d4159d30 2024-04-21T22:53:55.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.658+0000 7f91d9a08640 1 --2- 172.21.15.110:0/2200275958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d4159d30 0x7f91d406c580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91d406d790 tx=0x7f91c401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b0ddb42e943227 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91d3fff640 1 -- 172.21.15.110:0/2200275958 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c40a5670 con 0x7f91d4159d30 2024-04-21T22:53:55.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91d3fff640 1 -- 172.21.15.110:0/2200275958 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c40a5810 con 0x7f91d4159d30 2024-04-21T22:53:55.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91d3fff640 1 -- 172.21.15.110:0/2200275958 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c40a5be0 con 0x7f91d4159d30 2024-04-21T22:53:55.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 -- 172.21.15.110:0/2200275958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d4159d30 msgr2=0x7f91d406c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 --2- 172.21.15.110:0/2200275958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d4159d30 0x7f91d406c580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91d406d790 tx=0x7f91c401c920 comp rx=0 tx=0).stop 2024-04-21T22:53:55.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 -- 172.21.15.110:0/2200275958 shutdown_connections 2024-04-21T22:53:55.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 --2- 172.21.15.110:0/2200275958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d4159d30 0x7f91d406c580 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 --2- 172.21.15.110:0/2200275958 >> v2:172.21.15.110:3300/0 conn(0x7f91d41573b0 0x7f91d406de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 -- 172.21.15.110:0/2200275958 >> 172.21.15.110:0/2200275958 conn(0x7f91d40cc250 msgr2=0x7f91d40cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 -- 172.21.15.110:0/2200275958 shutdown_connections 2024-04-21T22:53:55.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.670+0000 7f91db46b640 1 -- 172.21.15.110:0/2200275958 wait complete. 2024-04-21T22:53:55.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 Processor -- start 2024-04-21T22:53:55.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 -- start start 2024-04-21T22:53:55.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91d4150a80 0x7f91d4147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d41573b0 0x7f91d41488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91d4159d30 0x7f91d41f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f91d4150e60 con 0x7f91d4159d30 2024-04-21T22:53:55.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91d415a140 con 0x7f91d41573b0 2024-04-21T22:53:55.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91db46b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f91d40c3970 con 0x7f91d4150a80 2024-04-21T22:53:55.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91d9207640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91d4150a80 0x7f91d4147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91d9207640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91d4150a80 0x7f91d4147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48510/0 (socket says 172.21.15.110:48510) 2024-04-21T22:53:55.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91d9207640 1 -- 172.21.15.110:0/3449980105 learned_addr learned my addr 172.21.15.110:0/3449980105 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:55.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.674+0000 7f91d8a06640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d41573b0 0x7f91d41488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.686+0000 7f91d9207640 1 -- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d41573b0 msgr2=0x7f91d41488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.686+0000 7f91d9207640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d41573b0 0x7f91d41488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.686+0000 7f91d9207640 1 -- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91d4159d30 msgr2=0x7f91d41f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.686+0000 7f91d9207640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91d4159d30 0x7f91d41f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.686+0000 7f91d9207640 1 -- 172.21.15.110:0/3449980105 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d40c55f0 con 0x7f91d4150a80 2024-04-21T22:53:55.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.690+0000 7f91d9207640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91d4150a80 0x7f91d4147690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c4c0 tx=0x7f91cc001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.698+0000 7f91d1ffb640 1 -- 172.21.15.110:0/3449980105 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc017070 con 0x7f91d4150a80 2024-04-21T22:53:55.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.698+0000 7f91d1ffb640 1 -- 172.21.15.110:0/3449980105 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91cc003600 con 0x7f91d4150a80 2024-04-21T22:53:55.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.698+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d40ca3f0 con 0x7f91d4150a80 2024-04-21T22:53:55.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.698+0000 7f91d1ffb640 1 -- 172.21.15.110:0/3449980105 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0039f0 con 0x7f91d4150a80 2024-04-21T22:53:55.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.698+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d4149550 con 0x7f91d4150a80 2024-04-21T22:53:55.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.702+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d404f510 con 0x7f91d4150a80 2024-04-21T22:53:55.772 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-21T22:53:55.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.866+0000 7f2c09ffb640 1 -- 172.21.15.110:0/601119510 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c0400aa50 con 0x7f2c0c061fc0 2024-04-21T22:53:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.866+0000 7f2c09ffb640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2bf80678c0 0x7f2bf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.866+0000 7f2c10dae640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2bf80678c0 0x7f2bf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.866+0000 7f2c10dae640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2bf80678c0 0x7f2bf8069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c000af000 tx=0x7f2c000a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.882+0000 7f2c09ffb640 1 -- 172.21.15.110:0/601119510 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c04054b50 con 0x7f2c0c061fc0 2024-04-21T22:53:55.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.882+0000 7f2c09ffb640 1 -- 172.21.15.110:0/601119510 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2c0c147c10 con 0x7f2c0c061fc0 2024-04-21T22:53:55.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.890+0000 7f833ceeb640 1 Processor -- start 2024-04-21T22:53:55.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.890+0000 7f833ceeb640 1 -- start start 2024-04-21T22:53:55.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.894+0000 7f833ceeb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83380c9cb0 0x7f83380c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.894+0000 7f833ceeb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83380c8410 con 0x7f83380c98d0 2024-04-21T22:53:55.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.894+0000 7f833ceeb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8338072d30 con 0x7f8338154980 2024-04-21T22:53:55.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.894+0000 7f833ceeb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f83380c81e0 con 0x7f83380c9cb0 2024-04-21T22:53:55.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.894+0000 7f833659c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f83380c98d0 0x7f8338154270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36162/0 (socket says 172.21.15.110:36162) 2024-04-21T22:53:55.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.894+0000 7f833659c640 1 -- 172.21.15.110:0/3402656002 learned_addr learned my addr 172.21.15.110:0/3402656002 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:55.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.898+0000 7f8336d9d640 1 --2- 172.21.15.110:0/3402656002 >> v2:172.21.15.154:3300/0 conn(0x7f83380c9cb0 0x7f83380c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125345237 0 0) 0x7f83380c8410 con 0x7f83380c98d0 2024-04-21T22:53:55.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8320003530 con 0x7f83380c98d0 2024-04-21T22:53:55.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938894666 0 0) 0x7f8320003530 con 0x7f83380c98d0 2024-04-21T22:53:55.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 >> v2:172.21.15.154:3300/0 conn(0x7f83380c9cb0 msgr2=0x7f83380c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:55.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 --2- 172.21.15.110:0/3402656002 >> v2:172.21.15.154:3300/0 conn(0x7f83380c9cb0 0x7f83380c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 >> v1:172.21.15.154:6789/0 conn(0x7f8338154980 legacy=0x7f833815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:55.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8338073010 con 0x7f83380c98d0 2024-04-21T22:53:55.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f8328001680 con 0x7f83380c98d0 2024-04-21T22:53:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 >> v1:172.21.15.110:6789/0 conn(0x7f83380c98d0 legacy=0x7f8338154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8320003a10 0x7f8320003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f8320004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83200051d0 0x7f832000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f832000c050 con 0x7f8320004810 2024-04-21T22:53:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f832000c200 con 0x7f8320003a10 2024-04-21T22:53:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.902+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f832000c400 con 0x7f83200051d0 2024-04-21T22:53:55.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.906+0000 7f8335d9b640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f8320004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.910+0000 7f8335d9b640 1 -- 172.21.15.110:0/3402656002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83200051d0 msgr2=0x7f832000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:55.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.910+0000 7f8335d9b640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83200051d0 0x7f832000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.910+0000 7f8335d9b640 1 -- 172.21.15.110:0/3402656002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8320003a10 msgr2=0x7f8320003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:55.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.910+0000 7f8335d9b640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8320003a10 0x7f8320003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.910+0000 7f8335d9b640 1 -- 172.21.15.110:0/3402656002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8320003530 con 0x7f8320004810 2024-04-21T22:53:55.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.910+0000 7f8336d9d640 1 -- 172.21.15.110:0/3402656002 reap_dead start 2024-04-21T22:53:55.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.914+0000 7f8335d9b640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f8320004c90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f832c001650 tx=0x7f832c01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c105c24fc0f959 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c001250 con 0x7f8320004810 2024-04-21T22:53:55.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c005270 con 0x7f8320004810 2024-04-21T22:53:55.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833559a640 1 -- 172.21.15.110:0/3402656002 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0054a0 con 0x7f8320004810 2024-04-21T22:53:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833ceeb640 1 -- 172.21.15.110:0/3402656002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 msgr2=0x7f8320004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833ceeb640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f8320004c90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f832c001650 tx=0x7f832c01c300 comp rx=0 tx=0).stop 2024-04-21T22:53:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833ceeb640 1 -- 172.21.15.110:0/3402656002 shutdown_connections 2024-04-21T22:53:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833ceeb640 1 --2- 172.21.15.110:0/3402656002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f8320004c90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833ceeb640 1 -- 172.21.15.110:0/3402656002 >> 172.21.15.110:0/3402656002 conn(0x7f833806ca80 msgr2=0x7f8338070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833ceeb640 1 -- 172.21.15.110:0/3402656002 shutdown_connections 2024-04-21T22:53:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.918+0000 7f833ceeb640 1 -- 172.21.15.110:0/3402656002 wait complete. 2024-04-21T22:53:55.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 Processor -- start 2024-04-21T22:53:55.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 -- start start 2024-04-21T22:53:55.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f83380c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83380c7510 0x7f83380ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83380c7950 0x7f833814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8338072ae0 con 0x7f8320004810 2024-04-21T22:53:55.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8338073620 con 0x7f83380c7950 2024-04-21T22:53:55.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833ceeb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f83380737a0 con 0x7f83380c7510 2024-04-21T22:53:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f8336d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83380c7950 0x7f833814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f83380c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f8336d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83380c7950 0x7f833814f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47824/0 (socket says 172.21.15.110:47824) 2024-04-21T22:53:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f833659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f83380c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60552/0 (socket says 172.21.15.110:60552) 2024-04-21T22:53:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.922+0000 7f8336d9d640 1 -- 172.21.15.110:0/1428572806 learned_addr learned my addr 172.21.15.110:0/1428572806 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.926+0000 7f833659c640 1 -- 172.21.15.110:0/1428572806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83380c7510 msgr2=0x7f83380ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.926+0000 7f833659c640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83380c7510 0x7f83380ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.926+0000 7f833659c640 1 -- 172.21.15.110:0/1428572806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83380c7950 msgr2=0x7f833814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.926+0000 7f833659c640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83380c7950 0x7f833814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.926+0000 7f833659c640 1 -- 172.21.15.110:0/1428572806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83380c5bc0 con 0x7f8320004810 2024-04-21T22:53:55.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.930+0000 7f833659c640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f83380c5680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f832800c730 tx=0x7f832800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:55.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.934+0000 7f8326ffd640 1 -- 172.21.15.110:0/1428572806 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328018070 con 0x7f8320004810 2024-04-21T22:53:55.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.934+0000 7f8326ffd640 1 -- 172.21.15.110:0/1428572806 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83280072f0 con 0x7f8320004810 2024-04-21T22:53:55.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.934+0000 7f8326ffd640 1 -- 172.21.15.110:0/1428572806 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83280047f0 con 0x7f8320004810 2024-04-21T22:53:55.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.934+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83380c5fb0 con 0x7f8320004810 2024-04-21T22:53:55.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.934+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83380c6530 con 0x7f8320004810 2024-04-21T22:53:55.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.934+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833804f510 con 0x7f8320004810 2024-04-21T22:53:55.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.954+0000 7f8326ffd640 1 -- 172.21.15.110:0/1428572806 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f832801b070 con 0x7f8320004810 2024-04-21T22:53:55.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.954+0000 7f8326ffd640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8318067910 0x7f8318069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:55.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.954+0000 7f8335d9b640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8318067910 0x7f8318069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:55.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:55.954+0000 7f8335d9b640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8318067910 0x7f8318069dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f832c0aa000 tx=0x7f832c000fc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.029 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-21T22:53:56.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.042+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2c0c14c410 con 0x7f2c0c061fc0 2024-04-21T22:53:56.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.050+0000 7f91d1ffb640 1 -- 172.21.15.110:0/3449980105 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91cc01a070 con 0x7f91d4150a80 2024-04-21T22:53:56.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.050+0000 7f91d1ffb640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f91c0067910 0x7f91c0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.050+0000 7f91d8a06640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f91c0067910 0x7f91c0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.050+0000 7f91d8a06640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f91c0067910 0x7f91c0069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91d414f110 tx=0x7f91c8009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.058+0000 7f91d1ffb640 1 -- 172.21.15.110:0/3449980105 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f91cc053a40 con 0x7f91d4150a80 2024-04-21T22:53:56.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.086+0000 7f91d1ffb640 1 -- 172.21.15.110:0/3449980105 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f91cc021020 con 0x7f91d4150a80 2024-04-21T22:53:56.102 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-21T22:53:56.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f1774db4640 1 Processor -- start 2024-04-21T22:53:56.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f1774db4640 1 -- start start 2024-04-21T22:53:56.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f1774db4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17700c39b0 0x7f1770150d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f1774db4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f177006f430 0x7f17701512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f1774db4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17700c5a10 con 0x7f17700c6c50 2024-04-21T22:53:56.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f1774db4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f177006cb00 con 0x7f177006f430 2024-04-21T22:53:56.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f1774db4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f17700c7140 con 0x7f17700c39b0 2024-04-21T22:53:56.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.142+0000 7f176e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17700c39b0 0x7f1770150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.146+0000 7f176e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17700c39b0 0x7f1770150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47836/0 (socket says 172.21.15.110:47836) 2024-04-21T22:53:56.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.146+0000 7f176e59c640 1 -- 172.21.15.110:0/1252208914 learned_addr learned my addr 172.21.15.110:0/1252208914 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:56.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.150+0000 7f176e59c640 1 -- 172.21.15.110:0/1252208914 >> v2:172.21.15.110:3300/0 conn(0x7f177006f430 msgr2=0x7f17701512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:56.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.150+0000 7f176e59c640 1 --2- 172.21.15.110:0/1252208914 >> v2:172.21.15.110:3300/0 conn(0x7f177006f430 0x7f17701512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.150+0000 7f176e59c640 1 -- 172.21.15.110:0/1252208914 >> v1:172.21.15.110:6789/0 conn(0x7f17700c6c50 legacy=0x7f1770157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:56.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.150+0000 7f176e59c640 1 -- 172.21.15.110:0/1252208914 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17700c5cd0 con 0x7f17700c39b0 2024-04-21T22:53:56.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.158+0000 7f176e59c640 1 --2- 172.21.15.110:0/1252208914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f1770150d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1770071ac0 tx=0x7f176001ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bdbafb15869f238 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f176d59a640 1 -- 172.21.15.110:0/1252208914 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17600b5070 con 0x7f17700c39b0 2024-04-21T22:53:56.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f176d59a640 1 -- 172.21.15.110:0/1252208914 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17600a89d0 con 0x7f17700c39b0 2024-04-21T22:53:56.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f176d59a640 1 -- 172.21.15.110:0/1252208914 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17600a8da0 con 0x7f17700c39b0 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 -- 172.21.15.110:0/1252208914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 msgr2=0x7f1770150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 --2- 172.21.15.110:0/1252208914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f1770150d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1770071ac0 tx=0x7f176001ecd0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 -- 172.21.15.110:0/1252208914 shutdown_connections 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 --2- 172.21.15.110:0/1252208914 >> v2:172.21.15.110:3300/0 conn(0x7f177006f430 0x7f17701512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 --2- 172.21.15.110:0/1252208914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f1770150d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 -- 172.21.15.110:0/1252208914 >> 172.21.15.110:0/1252208914 conn(0x7f17700cc250 msgr2=0x7f17700cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 -- 172.21.15.110:0/1252208914 shutdown_connections 2024-04-21T22:53:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.166+0000 7f1774db4640 1 -- 172.21.15.110:0/1252208914 wait complete. 2024-04-21T22:53:56.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 Processor -- start 2024-04-21T22:53:56.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 -- start start 2024-04-21T22:53:56.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f177006f430 0x7f1770153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f17701dda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17700c6c50 0x7f17701ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17700c6570 con 0x7f177006f430 2024-04-21T22:53:56.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17700c6290 con 0x7f17700c39b0 2024-04-21T22:53:56.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.170+0000 7f1774db4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17700c4370 con 0x7f17700c6c50 2024-04-21T22:53:56.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.174+0000 7f176dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f17701dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.174+0000 7f176ed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17700c6c50 0x7f17701ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.174+0000 7f176dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f17701dda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:47838/0 (socket says 172.21.15.110:47838) 2024-04-21T22:53:56.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.174+0000 7f176dd9b640 1 -- 172.21.15.110:0/1351251267 learned_addr learned my addr 172.21.15.110:0/1351251267 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:56.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.186+0000 7f176dd9b640 1 -- 172.21.15.110:0/1351251267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17700c6c50 msgr2=0x7f17701ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.186+0000 7f176dd9b640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17700c6c50 0x7f17701ed190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.186+0000 7f176dd9b640 1 -- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f177006f430 msgr2=0x7f1770153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.186+0000 7f176dd9b640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f177006f430 0x7f1770153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.186+0000 7f176dd9b640 1 -- 172.21.15.110:0/1351251267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17701546b0 con 0x7f17700c39b0 2024-04-21T22:53:56.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.194+0000 7f176dd9b640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f17701dda20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f176400b580 tx=0x7f176400ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.202+0000 7f175effd640 1 -- 172.21.15.110:0/1351251267 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764014070 con 0x7f17700c39b0 2024-04-21T22:53:56.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.202+0000 7f175effd640 1 -- 172.21.15.110:0/1351251267 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1764010890 con 0x7f17700c39b0 2024-04-21T22:53:56.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.202+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1770151a40 con 0x7f17700c39b0 2024-04-21T22:53:56.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.202+0000 7f175effd640 1 -- 172.21.15.110:0/1351251267 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764010c80 con 0x7f17700c39b0 2024-04-21T22:53:56.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.202+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1770154320 con 0x7f17700c39b0 2024-04-21T22:53:56.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.202+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177004f510 con 0x7f17700c39b0 2024-04-21T22:53:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7ff6a0dc2640 1 Processor -- start 2024-04-21T22:53:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7ff6a0dc2640 1 -- start start 2024-04-21T22:53:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7ff6a0dc2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c98d0 0x7ff69c0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7ff6a0dc2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c0c8410 con 0x7ff69c154980 2024-04-21T22:53:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7ff6a0dc2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c072d30 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7ff6a0dc2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c0c81e0 con 0x7ff69c0c98d0 2024-04-21T22:53:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7f8326ffd640 1 -- 172.21.15.110:0/1428572806 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8328053ac0 con 0x7f8320004810 2024-04-21T22:53:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7f8326ffd640 1 -- 172.21.15.110:0/1428572806 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f8328055a20 con 0x7f8320004810 2024-04-21T22:53:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.214+0000 7ff69a59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c98d0 0x7ff69c0c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.218+0000 7ff69a59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c98d0 0x7ff69c0c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48560/0 (socket says 172.21.15.110:48560) 2024-04-21T22:53:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.218+0000 7ff69a59c640 1 -- 172.21.15.110:0/3005910275 learned_addr learned my addr 172.21.15.110:0/3005910275 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:56.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.222+0000 7ff69a59c640 1 -- 172.21.15.110:0/3005910275 >> v1:172.21.15.154:6789/0 conn(0x7ff69c0c9cb0 legacy=0x7ff69c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:56.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.222+0000 7ff69a59c640 1 -- 172.21.15.110:0/3005910275 >> v1:172.21.15.110:6789/0 conn(0x7ff69c154980 legacy=0x7ff69c15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:56.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.222+0000 7ff69a59c640 1 -- 172.21.15.110:0/3005910275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c073010 con 0x7ff69c0c98d0 2024-04-21T22:53:56.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.230+0000 7ff69a59c640 1 --2- 172.21.15.110:0/3005910275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c98d0 0x7ff69c0c1bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0ca1c0 tx=0x7ff68c01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733f817d4fa0653d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.230+0000 7f2c09ffb640 1 -- 172.21.15.110:0/601119510 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c04056ab0 con 0x7f2c0c061fc0 2024-04-21T22:53:56.229 INFO:teuthology.orchestra.run.smithi110.stdout:60129542161 2024-04-21T22:53:56.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2bf80678c0 msgr2=0x7f2bf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2bf80678c0 0x7f2bf8069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c000af000 tx=0x7f2c000a7000 comp rx=0 tx=0).stop 2024-04-21T22:53:56.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c061fc0 msgr2=0x7f2c0c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c061fc0 0x7f2c0c157370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c7f0 tx=0x7f2c0400ccb0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 shutdown_connections 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2bf80678c0 0x7f2bf8069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c154790 0x7f2c0c14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c0c1543b0 0x7f2c0c149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 --2- 172.21.15.110:0/601119510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0c061fc0 0x7f2c0c157370 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 >> 172.21.15.110:0/601119510 conn(0x7f2c0c0cc250 msgr2=0x7f2c0c0c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 shutdown_connections 2024-04-21T22:53:56.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.234+0000 7f2c13813640 1 -- 172.21.15.110:0/601119510 wait complete. 2024-04-21T22:53:56.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff699d9b640 1 -- 172.21.15.110:0/3005910275 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0b5070 con 0x7ff69c0c98d0 2024-04-21T22:53:56.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff699d9b640 1 -- 172.21.15.110:0/3005910275 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c0a89b0 con 0x7ff69c0c98d0 2024-04-21T22:53:56.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff699d9b640 1 -- 172.21.15.110:0/3005910275 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0a8d80 con 0x7ff69c0c98d0 2024-04-21T22:53:56.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3005910275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c98d0 msgr2=0x7ff69c0c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3005910275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c98d0 0x7ff69c0c1bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0ca1c0 tx=0x7ff68c01ecf0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3005910275 shutdown_connections 2024-04-21T22:53:56.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3005910275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c98d0 0x7ff69c0c1bb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3005910275 >> 172.21.15.110:0/3005910275 conn(0x7ff69c06ca80 msgr2=0x7ff69c070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3005910275 shutdown_connections 2024-04-21T22:53:56.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3005910275 wait complete. 2024-04-21T22:53:56.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 Processor -- start 2024-04-21T22:53:56.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- start start 2024-04-21T22:53:56.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c0c98d0 0x7ff69c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c9cb0 0x7ff69c1e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff69c154980 0x7ff69c074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c072ae0 con 0x7ff69c154980 2024-04-21T22:53:56.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c073620 con 0x7ff69c0c98d0 2024-04-21T22:53:56.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.242+0000 7ff6a0dc2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c0737a0 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542161 for osd.7 2024-04-21T22:53:56.249 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:56.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-21T22:53:56.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.258+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f91d40cced0 con 0x7f91d4150a80 2024-04-21T22:53:56.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.270+0000 7ff693fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c9cb0 0x7ff69c1e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.270+0000 7ff693fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c9cb0 0x7ff69c1e5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48566/0 (socket says 172.21.15.110:48566) 2024-04-21T22:53:56.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.270+0000 7ff693fff640 1 -- 172.21.15.110:0/3214044504 learned_addr learned my addr 172.21.15.110:0/3214044504 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:56.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.282+0000 7ff693fff640 1 -- 172.21.15.110:0/3214044504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c0c98d0 msgr2=0x7ff69c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.282+0000 7ff693fff640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c0c98d0 0x7ff69c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.282+0000 7ff693fff640 1 -- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff69c154980 msgr2=0x7ff69c074770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.282+0000 7ff693fff640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff69c154980 0x7ff69c074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.282+0000 7ff693fff640 1 -- 172.21.15.110:0/3214044504 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1f3f90 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.296 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-21T22:53:56.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 Processor -- start 2024-04-21T22:53:56.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 -- start start 2024-04-21T22:53:56.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cd0154560 0x7f2cd00c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd00c4240 0x7f2cd00c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2cd006c700 0x7f2cd015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd00c9e70 con 0x7f2cd0154560 2024-04-21T22:53:56.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd00cacd0 con 0x7f2cd006c700 2024-04-21T22:53:56.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd73f0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd00ca0c0 con 0x7f2cd00c4240 2024-04-21T22:53:56.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd518c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cd0154560 0x7f2cd00c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd518c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cd0154560 0x7f2cd00c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60592/0 (socket says 172.21.15.110:60592) 2024-04-21T22:53:56.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.370+0000 7f2cd518c640 1 -- 172.21.15.110:0/1399185105 learned_addr learned my addr 172.21.15.110:0/1399185105 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:56.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91d1ffb640 1 -- 172.21.15.110:0/3449980105 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91cc0559a0 con 0x7f91d4150a80 2024-04-21T22:53:56.372 INFO:teuthology.orchestra.run.smithi110.stdout:64424509454 2024-04-21T22:53:56.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f2cd518c640 1 -- 172.21.15.110:0/1399185105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd00c4240 msgr2=0x7f2cd00c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:56.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f2cd518c640 1 --2- 172.21.15.110:0/1399185105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd00c4240 0x7f2cd00c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f2cd518c640 1 -- 172.21.15.110:0/1399185105 >> v2:172.21.15.154:3300/0 conn(0x7f2cd006c700 msgr2=0x7f2cd015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:56.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f2cd518c640 1 --2- 172.21.15.110:0/1399185105 >> v2:172.21.15.154:3300/0 conn(0x7f2cd006c700 0x7f2cd015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f2cd518c640 1 -- 172.21.15.110:0/1399185105 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd00ca3a0 con 0x7f2cd0154560 2024-04-21T22:53:56.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f91c0067910 msgr2=0x7f91c0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f91c0067910 0x7f91c0069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91d414f110 tx=0x7f91c8009110 comp rx=0 tx=0).stop 2024-04-21T22:53:56.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91d4150a80 msgr2=0x7f91d4147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91d4150a80 0x7f91d4147690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c4c0 tx=0x7f91cc001e80 comp rx=0 tx=0).stop 2024-04-21T22:53:56.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 shutdown_connections 2024-04-21T22:53:56.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f91c0067910 0x7f91c0069dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91d4159d30 0x7f91d41f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91d41573b0 0x7f91d41488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 --2- 172.21.15.110:0/3449980105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91d4150a80 0x7f91d4147690 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 >> 172.21.15.110:0/3449980105 conn(0x7f91d40cc250 msgr2=0x7f91d414f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 shutdown_connections 2024-04-21T22:53:56.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.374+0000 7f91db46b640 1 -- 172.21.15.110:0/3449980105 wait complete. 2024-04-21T22:53:56.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.378+0000 7ff693fff640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c9cb0 0x7ff69c1e5a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c490 tx=0x7ff684001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.378+0000 7f2cd518c640 1 --2- 172.21.15.110:0/1399185105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd0154560 0x7f2cd00c85b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00c49d0 tx=0x7f2ccc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b606e40ca4b31904 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cc7fff640 1 -- 172.21.15.110:0/1399185105 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0b5070 con 0x7f2cd0154560 2024-04-21T22:53:56.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cc7fff640 1 -- 172.21.15.110:0/1399185105 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc0a89d0 con 0x7f2cd0154560 2024-04-21T22:53:56.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cc7fff640 1 -- 172.21.15.110:0/1399185105 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0a8da0 con 0x7f2cd0154560 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- 172.21.15.110:0/1399185105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd0154560 msgr2=0x7f2cd00c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/1399185105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd0154560 0x7f2cd00c85b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00c49d0 tx=0x7f2ccc01ed10 comp rx=0 tx=0).stop 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- 172.21.15.110:0/1399185105 shutdown_connections 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/1399185105 >> v2:172.21.15.154:3300/0 conn(0x7f2cd006c700 0x7f2cd015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/1399185105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd00c4240 0x7f2cd00c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/1399185105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd0154560 0x7f2cd00c85b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- 172.21.15.110:0/1399185105 >> 172.21.15.110:0/1399185105 conn(0x7f2cd0062670 msgr2=0x7f2cd0071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- 172.21.15.110:0/1399185105 shutdown_connections 2024-04-21T22:53:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- 172.21.15.110:0/1399185105 wait complete. 2024-04-21T22:53:56.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8338073400 con 0x7f8320004810 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 Processor -- start 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- start start 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd006c700 0x7f2cd01edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd00c4240 0x7f2cd015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0154560 0x7f2cd015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd00c9b80 con 0x7f2cd00c4240 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd00ca960 con 0x7f2cd0154560 2024-04-21T22:53:56.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.386+0000 7f2cd73f0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd00c9330 con 0x7f2cd006c700 2024-04-21T22:53:56.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f8326ffd640 1 -- 172.21.15.110:0/1428572806 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8328059d20 con 0x7f8320004810 2024-04-21T22:53:56.391 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:56.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509454 for osd.0 2024-04-21T22:53:56.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7ff692ffd640 1 -- 172.21.15.110:0/3214044504 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684017070 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7ff692ffd640 1 -- 172.21.15.110:0/3214044504 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff684003600 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1f4250 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.393 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:56.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f2cd498b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd00c4240 0x7f2cd015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c1f4810 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7ff692ffd640 1 -- 172.21.15.110:0/3214044504 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684003a30 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6800052a0 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8318067910 msgr2=0x7f8318069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8318067910 0x7f8318069dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f832c0aa000 tx=0x7f832c000fc0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 msgr2=0x7f83380c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f83380c5680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f832800c730 tx=0x7f832800cb30 comp rx=0 tx=0).stop 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 shutdown_connections 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8318067910 0x7f8318069dd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83380c7950 0x7f833814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83380c7510 0x7f83380ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 --2- 172.21.15.110:0/1428572806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8320004810 0x7f83380c5680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 >> 172.21.15.110:0/1428572806 conn(0x7f833806ca80 msgr2=0x7f833815a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 shutdown_connections 2024-04-21T22:53:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f833ceeb640 1 -- 172.21.15.110:0/1428572806 wait complete. 2024-04-21T22:53:56.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f2cd498b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd00c4240 0x7f2cd015c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60596/0 (socket says 172.21.15.110:60596) 2024-04-21T22:53:56.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.394+0000 7f2cd498b640 1 -- 172.21.15.110:0/3307950460 learned_addr learned my addr 172.21.15.110:0/3307950460 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.402+0000 7f2cd498b640 1 -- 172.21.15.110:0/3307950460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd006c700 msgr2=0x7f2cd01edd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.402+0000 7f2cd498b640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd006c700 0x7f2cd01edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.402+0000 7f2cd498b640 1 -- 172.21.15.110:0/3307950460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0154560 msgr2=0x7f2cd015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.402+0000 7f2cd498b640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0154560 0x7f2cd015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.402+0000 7f2cd498b640 1 -- 172.21.15.110:0/3307950460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd014f690 con 0x7f2cd00c4240 2024-04-21T22:53:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f2cd498b640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd00c4240 0x7f2cd015c6a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000b480 tx=0x7f2cc000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f57fcf0d640 1 Processor -- start 2024-04-21T22:53:56.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f57fcf0d640 1 -- start start 2024-04-21T22:53:56.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f57fcf0d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57f80c2d00 0x7f57f80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f57fcf0d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f8158a70 0x7f57f806f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f57fcf0d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f80c8a70 con 0x7f57f8152460 2024-04-21T22:53:56.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f57fcf0d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f57f80c8820 con 0x7f57f80c2d00 2024-04-21T22:53:56.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.406+0000 7f57fcf0d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f57f815ba70 con 0x7f57f8158a70 2024-04-21T22:53:56.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.410+0000 7f57f5d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57f80c2d00 0x7f57f80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.410+0000 7f57f659c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f57f8152460 0x7f57f815bf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36180/0 (socket says 172.21.15.110:36180) 2024-04-21T22:53:56.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.410+0000 7f57f659c640 1 -- 172.21.15.110:0/3347408136 learned_addr learned my addr 172.21.15.110:0/3347408136 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f57f5d9b640 1 -- 172.21.15.110:0/3347408136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f8158a70 msgr2=0x7f57f806f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:56.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f57f5d9b640 1 --2- 172.21.15.110:0/3347408136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f8158a70 0x7f57f806f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f57f5d9b640 1 -- 172.21.15.110:0/3347408136 >> v1:172.21.15.110:6789/0 conn(0x7f57f8152460 legacy=0x7f57f815bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f57f5d9b640 1 -- 172.21.15.110:0/3347408136 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f80c8d50 con 0x7f57f80c2d00 2024-04-21T22:53:56.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f2cc5ffb640 1 -- 172.21.15.110:0/3307950460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0014070 con 0x7f2cd00c4240 2024-04-21T22:53:56.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f2cc5ffb640 1 -- 172.21.15.110:0/3307950460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc0010890 con 0x7f2cd00c4240 2024-04-21T22:53:56.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f2cc5ffb640 1 -- 172.21.15.110:0/3307950460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0010c80 con 0x7f2cd00c4240 2024-04-21T22:53:56.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd01f0a80 con 0x7f2cd00c4240 2024-04-21T22:53:56.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd00b1a10 con 0x7f2cd00c4240 2024-04-21T22:53:56.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.414+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd004f510 con 0x7f2cd00c4240 2024-04-21T22:53:56.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.4 2024-04-21T22:53:56.414 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:56.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.418+0000 7f57f5d9b640 1 --2- 172.21.15.110:0/3347408136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f80c2d00 0x7f57f80c98f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0097c0 tx=0x7f57ec01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3598e9973dbcc692 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.522+0000 7f175effd640 1 -- 172.21.15.110:0/1351251267 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1764017070 con 0x7f17700c39b0 2024-04-21T22:53:56.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.522+0000 7f175effd640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f17500678c0 0x7f1750069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.522+0000 7f176e59c640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f17500678c0 0x7f1750069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.526+0000 7f176e59c640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f17500678c0 0x7f1750069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17600b2000 tx=0x7f1760004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.530+0000 7f175effd640 1 -- 172.21.15.110:0/1351251267 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1764054400 con 0x7f17700c39b0 2024-04-21T22:53:56.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.542+0000 7f175effd640 1 -- 172.21.15.110:0/1351251267 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f1764056360 con 0x7f17700c39b0 2024-04-21T22:53:56.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.590+0000 7ff692ffd640 1 -- 172.21.15.110:0/3214044504 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff68401a070 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.590+0000 7ff692ffd640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff67c067910 0x7ff67c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.590+0000 7ff69a59c640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff67c067910 0x7ff67c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.590+0000 7ff69a59c640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff67c067910 0x7ff67c069dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0b2000 tx=0x7ff68c004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.698+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1770151f60 con 0x7f17700c39b0 2024-04-21T22:53:56.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.702+0000 7f175effd640 1 -- 172.21.15.110:0/1351251267 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1764010e20 con 0x7f17700c39b0 2024-04-21T22:53:56.702 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f17500678c0 msgr2=0x7f1750069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f17500678c0 0x7f1750069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17600b2000 tx=0x7f1760004740 comp rx=0 tx=0).stop 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 msgr2=0x7f17701dda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f17701dda20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f176400b580 tx=0x7f176400ba40 comp rx=0 tx=0).stop 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 shutdown_connections 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f17500678c0 0x7f1750069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17700c6c50 0x7f17701ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700c39b0 0x7f17701dda20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 --2- 172.21.15.110:0/1351251267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f177006f430 0x7f1770153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 >> 172.21.15.110:0/1351251267 conn(0x7f17700cc250 msgr2=0x7f1770155370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 shutdown_connections 2024-04-21T22:53:56.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.706+0000 7f1774db4640 1 -- 172.21.15.110:0/1351251267 wait complete. 2024-04-21T22:53:56.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.710+0000 7f2cc5ffb640 1 -- 172.21.15.110:0/3307950460 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2cc0017070 con 0x7f2cd00c4240 2024-04-21T22:53:56.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.710+0000 7f2cc5ffb640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2cb4067910 0x7f2cb4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.710+0000 7f2cd518c640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2cb4067910 0x7f2cb4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.710+0000 7f2cd518c640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2cb4067910 0x7f2cb4069dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0b2000 tx=0x7f2ccc004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.3 2024-04-21T22:53:56.721 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.722+0000 7f2cc5ffb640 1 -- 172.21.15.110:0/3307950460 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2cc0054430 con 0x7f2cd00c4240 2024-04-21T22:53:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.726+0000 7f2cc5ffb640 1 -- 172.21.15.110:0/3307950460 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2cc0056a90 con 0x7f2cd00c4240 2024-04-21T22:53:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.726+0000 7ff692ffd640 1 -- 172.21.15.110:0/3214044504 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff6840539a0 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.762+0000 7ff692ffd640 1 -- 172.21.15.110:0/3214044504 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7ff684021020 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.814+0000 7f57f559a640 1 -- 172.21.15.110:0/3347408136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0b5070 con 0x7f57f80c2d00 2024-04-21T22:53:56.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.814+0000 7f57f559a640 1 -- 172.21.15.110:0/3347408136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ec0a8990 con 0x7f57f80c2d00 2024-04-21T22:53:56.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.814+0000 7f57f559a640 1 -- 172.21.15.110:0/3347408136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0a8d60 con 0x7f57f80c2d00 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 -- 172.21.15.110:0/3347408136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f80c2d00 msgr2=0x7f57f80c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/3347408136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f80c2d00 0x7f57f80c98f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0097c0 tx=0x7f57ec01ec90 comp rx=0 tx=0).stop 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 -- 172.21.15.110:0/3347408136 shutdown_connections 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/3347408136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f8158a70 0x7f57f806f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/3347408136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f80c2d00 0x7f57f80c98f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 -- 172.21.15.110:0/3347408136 >> 172.21.15.110:0/3347408136 conn(0x7f57f8062670 msgr2=0x7f57f8071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 -- 172.21.15.110:0/3347408136 shutdown_connections 2024-04-21T22:53:56.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 -- 172.21.15.110:0/3347408136 wait complete. 2024-04-21T22:53:56.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 Processor -- start 2024-04-21T22:53:56.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.818+0000 7f57fcf0d640 1 -- start start 2024-04-21T22:53:56.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.822+0000 7f57fcf0d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f80c2d00 0x7f57f815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.822+0000 7f57fcf0d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8152460 0x7f57f80c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.822+0000 7f57fcf0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f8158a70 0x7f57f80c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.822+0000 7f57fcf0d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8070070 con 0x7f57f8152460 2024-04-21T22:53:56.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.822+0000 7f57fcf0d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57f806fef0 con 0x7f57f8158a70 2024-04-21T22:53:56.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.822+0000 7f57fcf0d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f57f80701f0 con 0x7f57f80c2d00 2024-04-21T22:53:56.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.826+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8152460 0x7f57f80c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.826+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8152460 0x7f57f80c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60610/0 (socket says 172.21.15.110:60610) 2024-04-21T22:53:56.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.826+0000 7f57f5d9b640 1 -- 172.21.15.110:0/812539465 learned_addr learned my addr 172.21.15.110:0/812539465 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:56.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.830+0000 7f57f5d9b640 1 -- 172.21.15.110:0/812539465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f80c2d00 msgr2=0x7f57f815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.830+0000 7f57f5d9b640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f80c2d00 0x7f57f815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.830+0000 7f57f5d9b640 1 -- 172.21.15.110:0/812539465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f8158a70 msgr2=0x7f57f80c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.830+0000 7f57f5d9b640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f8158a70 0x7f57f80c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.830+0000 7f57f5d9b640 1 -- 172.21.15.110:0/812539465 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f81eda40 con 0x7f57f8152460 2024-04-21T22:53:56.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.834+0000 7f57f5d9b640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8152460 0x7f57f80c6e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57ec01c8c0 tx=0x7f57ec01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.838+0000 7f57e6ffd640 1 -- 172.21.15.110:0/812539465 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0bd020 con 0x7f57f8152460 2024-04-21T22:53:56.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.838+0000 7f57e6ffd640 1 -- 172.21.15.110:0/812539465 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ec0b0920 con 0x7f57f8152460 2024-04-21T22:53:56.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.838+0000 7f57e6ffd640 1 -- 172.21.15.110:0/812539465 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0b5040 con 0x7f57f8152460 2024-04-21T22:53:56.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.838+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f81f1130 con 0x7f57f8152460 2024-04-21T22:53:56.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.838+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f81edfa0 con 0x7f57f8152460 2024-04-21T22:53:56.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.838+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f804f510 con 0x7f57f8152460 2024-04-21T22:53:56.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.866+0000 7f57e6ffd640 1 -- 172.21.15.110:0/812539465 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57ec0c0020 con 0x7f57f8152460 2024-04-21T22:53:56.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.870+0000 7f57e6ffd640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f57d80678c0 0x7f57d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:56.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.870+0000 7f57f659c640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f57d80678c0 0x7f57d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:56.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.870+0000 7f57f659c640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f57d80678c0 0x7f57d8069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57e8000f70 tx=0x7f57e8007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.898+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2cd014ff10 con 0x7f2cd00c4240 2024-04-21T22:53:56.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.934+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff680005860 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.938+0000 7ff692ffd640 1 -- 172.21.15.110:0/3214044504 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff684056000 con 0x7ff69c0c9cb0 2024-04-21T22:53:56.939 INFO:teuthology.orchestra.run.smithi110.stdout:64424509455 2024-04-21T22:53:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff67c067910 msgr2=0x7ff67c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff67c067910 0x7ff67c069dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0b2000 tx=0x7ff68c004740 comp rx=0 tx=0).stop 2024-04-21T22:53:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c9cb0 msgr2=0x7ff69c1e5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c9cb0 0x7ff69c1e5a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c490 tx=0x7ff684001e80 comp rx=0 tx=0).stop 2024-04-21T22:53:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 shutdown_connections 2024-04-21T22:53:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff67c067910 0x7ff67c069dd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff69c154980 0x7ff69c074770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c0c9cb0 0x7ff69c1e5a50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 --2- 172.21.15.110:0/3214044504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c0c98d0 0x7ff69c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 >> 172.21.15.110:0/3214044504 conn(0x7ff69c06ca80 msgr2=0x7ff69c15ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 shutdown_connections 2024-04-21T22:53:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:56.942+0000 7ff6a0dc2640 1 -- 172.21.15.110:0/3214044504 wait complete. 2024-04-21T22:53:56.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.6 2024-04-21T22:53:56.955 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:57.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.166+0000 7f57e6ffd640 1 -- 172.21.15.110:0/812539465 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f57ec0afe60 con 0x7f57f8152460 2024-04-21T22:53:57.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.166+0000 7f57e6ffd640 1 -- 172.21.15.110:0/812539465 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f57ec0c7030 con 0x7f57f8152460 2024-04-21T22:53:57.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.178+0000 7f2cc5ffb640 1 -- 172.21.15.110:0/3307950460 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2cc0010e20 con 0x7f2cd00c4240 2024-04-21T22:53:57.178 INFO:teuthology.orchestra.run.smithi110.stdout:60129542160 2024-04-21T22:53:57.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2cb4067910 msgr2=0x7f2cb4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:57.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2cb4067910 0x7f2cb4069dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0b2000 tx=0x7f2ccc004740 comp rx=0 tx=0).stop 2024-04-21T22:53:57.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd00c4240 msgr2=0x7f2cd015c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:57.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd00c4240 0x7f2cd015c6a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000b480 tx=0x7f2cc000b940 comp rx=0 tx=0).stop 2024-04-21T22:53:57.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 shutdown_connections 2024-04-21T22:53:57.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2cb4067910 0x7f2cb4069dd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0154560 0x7f2cd015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd00c4240 0x7f2cd015c6a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 --2- 172.21.15.110:0/3307950460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd006c700 0x7f2cd01edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 >> 172.21.15.110:0/3307950460 conn(0x7f2cd0062670 msgr2=0x7f2cd0152150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 shutdown_connections 2024-04-21T22:53:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.182+0000 7f2cd73f0640 1 -- 172.21.15.110:0/3307950460 wait complete. 2024-04-21T22:53:57.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542159 got 60129542160 for osd.5 2024-04-21T22:53:57.203 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:57.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.350+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f57f80c9160 con 0x7f57f8152460 2024-04-21T22:53:57.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.354+0000 7f57e6ffd640 1 -- 172.21.15.110:0/812539465 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f57f80c9160 con 0x7f57f8152460 2024-04-21T22:53:57.355 INFO:teuthology.orchestra.run.smithi110.stdout:64424509456 2024-04-21T22:53:57.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f57d80678c0 msgr2=0x7f57d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:57.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f57d80678c0 0x7f57d8069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57e8000f70 tx=0x7f57e8007a90 comp rx=0 tx=0).stop 2024-04-21T22:53:57.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8152460 msgr2=0x7f57f80c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:57.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8152460 0x7f57f80c6e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57ec01c8c0 tx=0x7f57ec01ba30 comp rx=0 tx=0).stop 2024-04-21T22:53:57.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 shutdown_connections 2024-04-21T22:53:57.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f57d80678c0 0x7f57d8069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f8158a70 0x7f57f80c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8152460 0x7f57f80c6e50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 --2- 172.21.15.110:0/812539465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57f80c2d00 0x7f57f815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 >> 172.21.15.110:0/812539465 conn(0x7f57f8062670 msgr2=0x7f57f80b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:57.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 shutdown_connections 2024-04-21T22:53:57.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.358+0000 7f57fcf0d640 1 -- 172.21.15.110:0/812539465 wait complete. 2024-04-21T22:53:57.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.1 2024-04-21T22:53:57.373 DEBUG:teuthology.parallel:result is None 2024-04-21T22:53:57.373 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-21T22:53:57.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:53:57.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff896cc4640 1 Processor -- start 2024-04-21T22:53:57.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff896cc4640 1 -- start start 2024-04-21T22:53:57.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff896cc4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff890154550 0x7ff89006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:57.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff896cc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89006f390 0x7ff8900c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:57.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff896cc4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff890154930 con 0x7ff890061ff0 2024-04-21T22:53:57.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff896cc4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff8900c8020 con 0x7ff890154550 2024-04-21T22:53:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff896cc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8900c89f0 con 0x7ff89006f390 2024-04-21T22:53:57.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff894a60640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff890154550 0x7ff89006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:57.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff895261640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89006f390 0x7ff8900c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:57.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff895261640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89006f390 0x7ff8900c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48634/0 (socket says 172.21.15.110:48634) 2024-04-21T22:53:57.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.486+0000 7ff895261640 1 -- 172.21.15.110:0/3639515038 learned_addr learned my addr 172.21.15.110:0/3639515038 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:57.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.494+0000 7ff895261640 1 -- 172.21.15.110:0/3639515038 >> v2:172.21.15.154:3300/0 conn(0x7ff890154550 msgr2=0x7ff89006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:57.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.494+0000 7ff895261640 1 --2- 172.21.15.110:0/3639515038 >> v2:172.21.15.154:3300/0 conn(0x7ff890154550 0x7ff89006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.494+0000 7ff895261640 1 -- 172.21.15.110:0/3639515038 >> v1:172.21.15.154:6789/0 conn(0x7ff890061ff0 legacy=0x7ff89006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:57.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.494+0000 7ff895261640 1 -- 172.21.15.110:0/3639515038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89015ae30 con 0x7ff89006f390 2024-04-21T22:53:57.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.498+0000 7ff895261640 1 --2- 172.21.15.110:0/3639515038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89006f390 0x7ff8900c84b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff888009e50 tx=0x7ff88801f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2dd9f4e3c984eeb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:57.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff88f7fe640 1 -- 172.21.15.110:0/3639515038 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880b4070 con 0x7ff89006f390 2024-04-21T22:53:57.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff88f7fe640 1 -- 172.21.15.110:0/3639515038 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8880af400 con 0x7ff89006f390 2024-04-21T22:53:57.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff88f7fe640 1 -- 172.21.15.110:0/3639515038 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880af7d0 con 0x7ff89006f390 2024-04-21T22:53:57.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 -- 172.21.15.110:0/3639515038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89006f390 msgr2=0x7ff8900c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:57.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3639515038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89006f390 0x7ff8900c84b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff888009e50 tx=0x7ff88801f1e0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 -- 172.21.15.110:0/3639515038 shutdown_connections 2024-04-21T22:53:57.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3639515038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89006f390 0x7ff8900c84b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3639515038 >> v2:172.21.15.154:3300/0 conn(0x7ff890154550 0x7ff89006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 -- 172.21.15.110:0/3639515038 >> 172.21.15.110:0/3639515038 conn(0x7ff8900cc250 msgr2=0x7ff8900cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:57.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 -- 172.21.15.110:0/3639515038 shutdown_connections 2024-04-21T22:53:57.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 -- 172.21.15.110:0/3639515038 wait complete. 2024-04-21T22:53:57.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 Processor -- start 2024-04-21T22:53:57.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.514+0000 7ff896cc4640 1 -- start start 2024-04-21T22:53:57.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff896cc4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff890061ff0 0x7ff8901527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:57.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff896cc4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff89006f390 0x7ff890155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:57.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff896cc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff890154550 0x7ff890146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:57.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff896cc4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff8900c79d0 con 0x7ff89006f390 2024-04-21T22:53:57.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff896cc4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8900c76f0 con 0x7ff890061ff0 2024-04-21T22:53:57.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff896cc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8900c7cb0 con 0x7ff890154550 2024-04-21T22:53:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff88ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff89006f390 0x7ff890155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff88ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff89006f390 0x7ff890155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60618/0 (socket says 172.21.15.110:60618) 2024-04-21T22:53:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.518+0000 7ff88ffff640 1 -- 172.21.15.110:0/3982282375 learned_addr learned my addr 172.21.15.110:0/3982282375 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:57.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.522+0000 7ff894a60640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff890061ff0 0x7ff8901527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:57.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.522+0000 7ff88ffff640 1 -- 172.21.15.110:0/3982282375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff890154550 msgr2=0x7ff890146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:57.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.522+0000 7ff88ffff640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff890154550 0x7ff890146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.522+0000 7ff88ffff640 1 -- 172.21.15.110:0/3982282375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff890061ff0 msgr2=0x7ff8901527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.522+0000 7ff88ffff640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff890061ff0 0x7ff8901527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.522+0000 7ff88ffff640 1 -- 172.21.15.110:0/3982282375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8900cabe0 con 0x7ff89006f390 2024-04-21T22:53:57.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.526+0000 7ff88ffff640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff89006f390 0x7ff890155ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c4c0 tx=0x7ff884001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.530+0000 7ff88d7fa640 1 -- 172.21.15.110:0/3982282375 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884017070 con 0x7ff89006f390 2024-04-21T22:53:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.530+0000 7ff88d7fa640 1 -- 172.21.15.110:0/3982282375 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff884003600 con 0x7ff89006f390 2024-04-21T22:53:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.530+0000 7ff88d7fa640 1 -- 172.21.15.110:0/3982282375 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840039f0 con 0x7ff89006f390 2024-04-21T22:53:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.530+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8901531e0 con 0x7ff89006f390 2024-04-21T22:53:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.530+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8900caea0 con 0x7ff89006f390 2024-04-21T22:53:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.530+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89004f510 con 0x7ff89006f390 2024-04-21T22:53:57.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.822+0000 7ff88d7fa640 1 -- 172.21.15.110:0/3982282375 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff88401a070 con 0x7ff89006f390 2024-04-21T22:53:57.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.822+0000 7ff88d7fa640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff874067910 0x7ff874069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:57.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.822+0000 7ff894a60640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff874067910 0x7ff874069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:57.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.822+0000 7ff894a60640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff874067910 0x7ff874069dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009990 tx=0x7ff87c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:57.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.858+0000 7ff88d7fa640 1 -- 172.21.15.110:0/3982282375 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff884053890 con 0x7ff89006f390 2024-04-21T22:53:57.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:57.862+0000 7ff88d7fa640 1 -- 172.21.15.110:0/3982282375 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7ff884021080 con 0x7ff89006f390 2024-04-21T22:53:58.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.030+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff890157c50 con 0x7ff874067910 2024-04-21T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.046+0000 7ff88d7fa640 1 -- 172.21.15.110:0/3982282375 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251901 (secure 0 0 0) 0x7ff890157c50 con 0x7ff874067910 2024-04-21T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff874067910 msgr2=0x7ff874069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff874067910 0x7ff874069dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009990 tx=0x7ff87c008040 comp rx=0 tx=0).stop 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff89006f390 msgr2=0x7ff890155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff89006f390 0x7ff890155ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c4c0 tx=0x7ff884001e80 comp rx=0 tx=0).stop 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 shutdown_connections 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff874067910 0x7ff874069dd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff890154550 0x7ff890146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff89006f390 0x7ff890155ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 --2- 172.21.15.110:0/3982282375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff890061ff0 0x7ff8901527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 >> 172.21.15.110:0/3982282375 conn(0x7ff8900cc250 msgr2=0x7ff8900c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 shutdown_connections 2024-04-21T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.050+0000 7ff896cc4640 1 -- 172.21.15.110:0/3982282375 wait complete. 2024-04-21T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-21T22:53:57.359256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234804,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739916,"statfs":{"total":773094113280,"available":772853673984,"internally_reserved":0,"allocated":2064384,"data_stored":1839116,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003431"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757459+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-21T22:53:39.757459+0000","last_peered":"2024-04-21T22:53:39.757459+0000","last_clean":"2024-04-21T22:53:39.757459+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-21T22:53:39.757459+0000","last_undegraded":"2024-04-21T22:53:39.757459+0000","last_fullsized":"2024-04-21T22:53:39.757459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757842+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-21T22:53:39.757842+0000","last_peered":"2024-04-21T22:53:39.757842+0000","last_clean":"2024-04-21T22:53:39.757842+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-21T22:53:39.757842+0000","last_undegraded":"2024-04-21T22:53:39.757842+0000","last_fullsized":"2024-04-21T22:53:39.757842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:25:19.748728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:27:16.978980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704596+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-21T22:53:39.704596+0000","last_peered":"2024-04-21T22:53:39.704596+0000","last_clean":"2024-04-21T22:53:39.704596+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-21T22:53:39.704596+0000","last_undegraded":"2024-04-21T22:53:39.704596+0000","last_fullsized":"2024-04-21T22:53:39.704596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756734+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-21T22:53:39.756734+0000","last_peered":"2024-04-21T22:53:39.756734+0000","last_clean":"2024-04-21T22:53:39.756734+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-21T22:53:39.756734+0000","last_undegraded":"2024-04-21T22:53:39.756734+0000","last_fullsized":"2024-04-21T22:53:39.756734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:26:22.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704812+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-21T22:53:39.704812+0000","last_peered":"2024-04-21T22:53:39.704812+0000","last_clean":"2024-04-21T22:53:39.704812+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-21T22:53:39.704812+0000","last_undegraded":"2024-04-21T22:53:39.704812+0000","last_fullsized":"2024-04-21T22:53:39.704812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756017+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-21T22:53:39.756017+0000","last_peered":"2024-04-21T22:53:39.756017+0000","last_clean":"2024-04-21T22:53:39.756017+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-21T22:53:39.756017+0000","last_undegraded":"2024-04-21T22:53:39.756017+0000","last_fullsized":"2024-04-21T22:53:39.756017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761187+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-21T22:53:39.761187+0000","last_peered":"2024-04-21T22:53:39.761187+0000","last_clean":"2024-04-21T22:53:39.761187+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-21T22:53:39.761187+0000","last_undegraded":"2024-04-21T22:53:39.761187+0000","last_fullsized":"2024-04-21T22:53:39.761187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:40:03.621192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755669+0000","last_change":"2024-04-21T22:53:38.576571+0000","last_active":"2024-04-21T22:53:39.755669+0000","last_peered":"2024-04-21T22:53:39.755669+0000","last_clean":"2024-04-21T22:53:39.755669+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-21T22:53:39.755669+0000","last_undegraded":"2024-04-21T22:53:39.755669+0000","last_fullsized":"2024-04-21T22:53:39.755669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757319+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-21T22:53:39.757319+0000","last_peered":"2024-04-21T22:53:39.757319+0000","last_clean":"2024-04-21T22:53:39.757319+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-21T22:53:39.757319+0000","last_undegraded":"2024-04-21T22:53:39.757319+0000","last_fullsized":"2024-04-21T22:53:39.757319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:26.176484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757851+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-21T22:53:39.757851+0000","last_peered":"2024-04-21T22:53:39.757851+0000","last_clean":"2024-04-21T22:53:39.757851+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-21T22:53:39.757851+0000","last_undegraded":"2024-04-21T22:53:39.757851+0000","last_fullsized":"2024-04-21T22:53:39.757851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757122+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-21T22:53:39.757122+0000","last_peered":"2024-04-21T22:53:39.757122+0000","last_clean":"2024-04-21T22:53:39.757122+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-21T22:53:39.757122+0000","last_undegraded":"2024-04-21T22:53:39.757122+0000","last_fullsized":"2024-04-21T22:53:39.757122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:51:01.311466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757254+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-21T22:53:39.757254+0000","last_peered":"2024-04-21T22:53:39.757254+0000","last_clean":"2024-04-21T22:53:39.757254+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-21T22:53:39.757254+0000","last_undegraded":"2024-04-21T22:53:39.757254+0000","last_fullsized":"2024-04-21T22:53:39.757254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757697+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-21T22:53:39.757697+0000","last_peered":"2024-04-21T22:53:39.757697+0000","last_clean":"2024-04-21T22:53:39.757697+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-21T22:53:39.757697+0000","last_undegraded":"2024-04-21T22:53:39.757697+0000","last_fullsized":"2024-04-21T22:53:39.757697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759126+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-21T22:53:39.759126+0000","last_peered":"2024-04-21T22:53:39.759126+0000","last_clean":"2024-04-21T22:53:39.759126+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-21T22:53:39.759126+0000","last_undegraded":"2024-04-21T22:53:39.759126+0000","last_fullsized":"2024-04-21T22:53:39.759126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:52:43.706899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721436+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-21T22:53:39.721436+0000","last_peered":"2024-04-21T22:53:39.721436+0000","last_clean":"2024-04-21T22:53:39.721436+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-21T22:53:39.721436+0000","last_undegraded":"2024-04-21T22:53:39.721436+0000","last_fullsized":"2024-04-21T22:53:39.721436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723468+0000","last_change":"2024-04-21T22:53:38.601841+0000","last_active":"2024-04-21T22:53:39.723468+0000","last_peered":"2024-04-21T22:53:39.723468+0000","last_clean":"2024-04-21T22:53:39.723468+0000","last_became_active":"2024-04-21T22:53:38.601086+0000","last_became_peered":"2024-04-21T22:53:38.601086+0000","last_unstale":"2024-04-21T22:53:39.723468+0000","last_undegraded":"2024-04-21T22:53:39.723468+0000","last_fullsized":"2024-04-21T22:53:39.723468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:45:23.058986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.762282+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-21T22:53:39.762282+0000","last_peered":"2024-04-21T22:53:39.762282+0000","last_clean":"2024-04-21T22:53:39.762282+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-21T22:53:39.762282+0000","last_undegraded":"2024-04-21T22:53:39.762282+0000","last_fullsized":"2024-04-21T22:53:39.762282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723205+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-21T22:53:39.723205+0000","last_peered":"2024-04-21T22:53:39.723205+0000","last_clean":"2024-04-21T22:53:39.723205+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-21T22:53:39.723205+0000","last_undegraded":"2024-04-21T22:53:39.723205+0000","last_fullsized":"2024-04-21T22:53:39.723205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:37:06.081826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757282+0000","last_change":"2024-04-21T22:53:38.610862+0000","last_active":"2024-04-21T22:53:39.757282+0000","last_peered":"2024-04-21T22:53:39.757282+0000","last_clean":"2024-04-21T22:53:39.757282+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-21T22:53:39.757282+0000","last_undegraded":"2024-04-21T22:53:39.757282+0000","last_fullsized":"2024-04-21T22:53:39.757282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:51.748240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745760+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-21T22:53:39.745760+0000","last_peered":"2024-04-21T22:53:39.745760+0000","last_clean":"2024-04-21T22:53:39.745760+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-21T22:53:39.745760+0000","last_undegraded":"2024-04-21T22:53:39.745760+0000","last_fullsized":"2024-04-21T22:53:39.745760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755353+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-21T22:53:39.755353+0000","last_peered":"2024-04-21T22:53:39.755353+0000","last_clean":"2024-04-21T22:53:39.755353+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-21T22:53:39.755353+0000","last_undegraded":"2024-04-21T22:53:39.755353+0000","last_fullsized":"2024-04-21T22:53:39.755353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759590+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-21T22:53:39.759590+0000","last_peered":"2024-04-21T22:53:39.759590+0000","last_clean":"2024-04-21T22:53:39.759590+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-21T22:53:39.759590+0000","last_undegraded":"2024-04-21T22:53:39.759590+0000","last_fullsized":"2024-04-21T22:53:39.759590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:47:54.239652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721864+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-21T22:53:39.721864+0000","last_peered":"2024-04-21T22:53:39.721864+0000","last_clean":"2024-04-21T22:53:39.721864+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-21T22:53:39.721864+0000","last_undegraded":"2024-04-21T22:53:39.721864+0000","last_fullsized":"2024-04-21T22:53:39.721864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758853+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-21T22:53:39.758853+0000","last_peered":"2024-04-21T22:53:39.758853+0000","last_clean":"2024-04-21T22:53:39.758853+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-21T22:53:39.758853+0000","last_undegraded":"2024-04-21T22:53:39.758853+0000","last_fullsized":"2024-04-21T22:53:39.758853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:25:42.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705131+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-21T22:53:39.705131+0000","last_peered":"2024-04-21T22:53:39.705131+0000","last_clean":"2024-04-21T22:53:39.705131+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-21T22:53:39.705131+0000","last_undegraded":"2024-04-21T22:53:39.705131+0000","last_fullsized":"2024-04-21T22:53:39.705131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757428+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-21T22:53:39.757428+0000","last_peered":"2024-04-21T22:53:39.757428+0000","last_clean":"2024-04-21T22:53:39.757428+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-21T22:53:39.757428+0000","last_undegraded":"2024-04-21T22:53:39.757428+0000","last_fullsized":"2024-04-21T22:53:39.757428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757859+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-21T22:53:39.757859+0000","last_peered":"2024-04-21T22:53:39.757859+0000","last_clean":"2024-04-21T22:53:39.757859+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-21T22:53:39.757859+0000","last_undegraded":"2024-04-21T22:53:39.757859+0000","last_fullsized":"2024-04-21T22:53:39.757859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759786+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-21T22:53:39.759786+0000","last_peered":"2024-04-21T22:53:39.759786+0000","last_clean":"2024-04-21T22:53:39.759786+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-21T22:53:39.759786+0000","last_undegraded":"2024-04-21T22:53:39.759786+0000","last_fullsized":"2024-04-21T22:53:39.759786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:43:35.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722003+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-21T22:53:39.722003+0000","last_peered":"2024-04-21T22:53:39.722003+0000","last_clean":"2024-04-21T22:53:39.722003+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-21T22:53:39.722003+0000","last_undegraded":"2024-04-21T22:53:39.722003+0000","last_fullsized":"2024-04-21T22:53:39.722003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761458+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-21T22:53:39.761458+0000","last_peered":"2024-04-21T22:53:39.761458+0000","last_clean":"2024-04-21T22:53:39.761458+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-21T22:53:39.761458+0000","last_undegraded":"2024-04-21T22:53:39.761458+0000","last_fullsized":"2024-04-21T22:53:39.761458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704355+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-21T22:53:39.704355+0000","last_peered":"2024-04-21T22:53:39.704355+0000","last_clean":"2024-04-21T22:53:39.704355+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-21T22:53:39.704355+0000","last_undegraded":"2024-04-21T22:53:39.704355+0000","last_fullsized":"2024-04-21T22:53:39.704355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755367+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-21T22:53:39.755367+0000","last_peered":"2024-04-21T22:53:39.755367+0000","last_clean":"2024-04-21T22:53:39.755367+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-21T22:53:39.755367+0000","last_undegraded":"2024-04-21T22:53:39.755367+0000","last_fullsized":"2024-04-21T22:53:39.755367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746430+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-21T22:53:39.746430+0000","last_peered":"2024-04-21T22:53:39.746430+0000","last_clean":"2024-04-21T22:53:39.746430+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-21T22:53:39.746430+0000","last_undegraded":"2024-04-21T22:53:39.746430+0000","last_fullsized":"2024-04-21T22:53:39.746430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050038+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-21T22:53:40.050038+0000","last_peered":"2024-04-21T22:53:40.050038+0000","last_clean":"2024-04-21T22:53:40.050038+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-21T22:53:40.050038+0000","last_undegraded":"2024-04-21T22:53:40.050038+0000","last_fullsized":"2024-04-21T22:53:40.050038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:31.566421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757473+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-21T22:53:39.757473+0000","last_peered":"2024-04-21T22:53:39.757473+0000","last_clean":"2024-04-21T22:53:39.757473+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-21T22:53:39.757473+0000","last_undegraded":"2024-04-21T22:53:39.757473+0000","last_fullsized":"2024-04-21T22:53:39.757473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758930+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-21T22:53:39.758930+0000","last_peered":"2024-04-21T22:53:39.758930+0000","last_clean":"2024-04-21T22:53:39.758930+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-21T22:53:39.758930+0000","last_undegraded":"2024-04-21T22:53:39.758930+0000","last_fullsized":"2024-04-21T22:53:39.758930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:38:02.541775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721605+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-21T22:53:39.721605+0000","last_peered":"2024-04-21T22:53:39.721605+0000","last_clean":"2024-04-21T22:53:39.721605+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-21T22:53:39.721605+0000","last_undegraded":"2024-04-21T22:53:39.721605+0000","last_fullsized":"2024-04-21T22:53:39.721605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746093+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-21T22:53:39.746093+0000","last_peered":"2024-04-21T22:53:39.746093+0000","last_clean":"2024-04-21T22:53:39.746093+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-21T22:53:39.746093+0000","last_undegraded":"2024-04-21T22:53:39.746093+0000","last_fullsized":"2024-04-21T22:53:39.746093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755825+0000","last_change":"2024-04-21T22:53:37.185089+0000","last_active":"2024-04-21T22:53:39.755825+0000","last_peered":"2024-04-21T22:53:39.755825+0000","last_clean":"2024-04-21T22:53:39.755825+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-21T22:53:39.755825+0000","last_undegraded":"2024-04-21T22:53:39.755825+0000","last_fullsized":"2024-04-21T22:53:39.755825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705229+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-21T22:53:39.705229+0000","last_peered":"2024-04-21T22:53:39.705229+0000","last_clean":"2024-04-21T22:53:39.705229+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-21T22:53:39.705229+0000","last_undegraded":"2024-04-21T22:53:39.705229+0000","last_fullsized":"2024-04-21T22:53:39.705229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:09.983320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757753+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-21T22:53:39.757753+0000","last_peered":"2024-04-21T22:53:39.757753+0000","last_clean":"2024-04-21T22:53:39.757753+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-21T22:53:39.757753+0000","last_undegraded":"2024-04-21T22:53:39.757753+0000","last_fullsized":"2024-04-21T22:53:39.757753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759728+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-21T22:53:39.759728+0000","last_peered":"2024-04-21T22:53:39.759728+0000","last_clean":"2024-04-21T22:53:39.759728+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-21T22:53:39.759728+0000","last_undegraded":"2024-04-21T22:53:39.759728+0000","last_fullsized":"2024-04-21T22:53:39.759728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:13.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047461+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-21T22:53:40.047461+0000","last_peered":"2024-04-21T22:53:40.047461+0000","last_clean":"2024-04-21T22:53:40.047461+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-21T22:53:40.047461+0000","last_undegraded":"2024-04-21T22:53:40.047461+0000","last_fullsized":"2024-04-21T22:53:40.047461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722381+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-21T22:53:39.722381+0000","last_peered":"2024-04-21T22:53:39.722381+0000","last_clean":"2024-04-21T22:53:39.722381+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-21T22:53:39.722381+0000","last_undegraded":"2024-04-21T22:53:39.722381+0000","last_fullsized":"2024-04-21T22:53:39.722381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:50.140041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.280055+0000","last_change":"2024-04-21T22:53:37.134021+0000","last_active":"2024-04-21T22:53:40.280055+0000","last_peered":"2024-04-21T22:53:40.280055+0000","last_clean":"2024-04-21T22:53:40.280055+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-21T22:53:40.280055+0000","last_undegraded":"2024-04-21T22:53:40.280055+0000","last_fullsized":"2024-04-21T22:53:40.280055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:57.000042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757466+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-21T22:53:39.757466+0000","last_peered":"2024-04-21T22:53:39.757466+0000","last_clean":"2024-04-21T22:53:39.757466+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-21T22:53:39.757466+0000","last_undegraded":"2024-04-21T22:53:39.757466+0000","last_fullsized":"2024-04-21T22:53:39.757466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.045806+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-21T22:53:40.045806+0000","last_peered":"2024-04-21T22:53:40.045806+0000","last_clean":"2024-04-21T22:53:40.045806+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-21T22:53:40.045806+0000","last_undegraded":"2024-04-21T22:53:40.045806+0000","last_fullsized":"2024-04-21T22:53:40.045806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757940+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-21T22:53:39.757940+0000","last_peered":"2024-04-21T22:53:39.757940+0000","last_clean":"2024-04-21T22:53:39.757940+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-21T22:53:39.757940+0000","last_undegraded":"2024-04-21T22:53:39.757940+0000","last_fullsized":"2024-04-21T22:53:39.757940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722866+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-21T22:53:39.722866+0000","last_peered":"2024-04-21T22:53:39.722866+0000","last_clean":"2024-04-21T22:53:39.722866+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-21T22:53:39.722866+0000","last_undegraded":"2024-04-21T22:53:39.722866+0000","last_fullsized":"2024-04-21T22:53:39.722866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:52.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722199+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-21T22:53:39.722199+0000","last_peered":"2024-04-21T22:53:39.722199+0000","last_clean":"2024-04-21T22:53:39.722199+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-21T22:53:39.722199+0000","last_undegraded":"2024-04-21T22:53:39.722199+0000","last_fullsized":"2024-04-21T22:53:39.722199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:27.631111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756116+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-21T22:53:39.756116+0000","last_peered":"2024-04-21T22:53:39.756116+0000","last_clean":"2024-04-21T22:53:39.756116+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-21T22:53:39.756116+0000","last_undegraded":"2024-04-21T22:53:39.756116+0000","last_fullsized":"2024-04-21T22:53:39.756116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754875+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-21T22:53:39.754875+0000","last_peered":"2024-04-21T22:53:39.754875+0000","last_clean":"2024-04-21T22:53:39.754875+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-21T22:53:39.754875+0000","last_undegraded":"2024-04-21T22:53:39.754875+0000","last_fullsized":"2024-04-21T22:53:39.754875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.228676+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-21T22:53:40.228676+0000","last_peered":"2024-04-21T22:53:40.228676+0000","last_clean":"2024-04-21T22:53:40.228676+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-21T22:53:40.228676+0000","last_undegraded":"2024-04-21T22:53:40.228676+0000","last_fullsized":"2024-04-21T22:53:40.228676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721602+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-21T22:53:39.721602+0000","last_peered":"2024-04-21T22:53:39.721602+0000","last_clean":"2024-04-21T22:53:39.721602+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-21T22:53:39.721602+0000","last_undegraded":"2024-04-21T22:53:39.721602+0000","last_fullsized":"2024-04-21T22:53:39.721602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758292+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-21T22:53:39.758292+0000","last_peered":"2024-04-21T22:53:39.758292+0000","last_clean":"2024-04-21T22:53:39.758292+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-21T22:53:39.758292+0000","last_undegraded":"2024-04-21T22:53:39.758292+0000","last_fullsized":"2024-04-21T22:53:39.758292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705317+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-21T22:53:39.705317+0000","last_peered":"2024-04-21T22:53:39.705317+0000","last_clean":"2024-04-21T22:53:39.705317+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-21T22:53:39.705317+0000","last_undegraded":"2024-04-21T22:53:39.705317+0000","last_fullsized":"2024-04-21T22:53:39.705317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.164673+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-21T22:53:40.164673+0000","last_peered":"2024-04-21T22:53:40.164673+0000","last_clean":"2024-04-21T22:53:40.164673+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-21T22:53:40.164673+0000","last_undegraded":"2024-04-21T22:53:40.164673+0000","last_fullsized":"2024-04-21T22:53:40.164673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757835+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-21T22:53:39.757835+0000","last_peered":"2024-04-21T22:53:39.757835+0000","last_clean":"2024-04-21T22:53:39.757835+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-21T22:53:39.757835+0000","last_undegraded":"2024-04-21T22:53:39.757835+0000","last_fullsized":"2024-04-21T22:53:39.757835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760485+0000","last_change":"2024-04-21T22:53:37.253316+0000","last_active":"2024-04-21T22:53:39.760485+0000","last_peered":"2024-04-21T22:53:39.760485+0000","last_clean":"2024-04-21T22:53:39.760485+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-21T22:53:39.760485+0000","last_undegraded":"2024-04-21T22:53:39.760485+0000","last_fullsized":"2024-04-21T22:53:39.760485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:45:21.383363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757430+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-21T22:53:39.757430+0000","last_peered":"2024-04-21T22:53:39.757430+0000","last_clean":"2024-04-21T22:53:39.757430+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-21T22:53:39.757430+0000","last_undegraded":"2024-04-21T22:53:39.757430+0000","last_fullsized":"2024-04-21T22:53:39.757430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758514+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-21T22:53:39.758514+0000","last_peered":"2024-04-21T22:53:39.758514+0000","last_clean":"2024-04-21T22:53:39.758514+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-21T22:53:39.758514+0000","last_undegraded":"2024-04-21T22:53:39.758514+0000","last_fullsized":"2024-04-21T22:53:39.758514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722910+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-21T22:53:39.722910+0000","last_peered":"2024-04-21T22:53:39.722910+0000","last_clean":"2024-04-21T22:53:39.722910+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-21T22:53:39.722910+0000","last_undegraded":"2024-04-21T22:53:39.722910+0000","last_fullsized":"2024-04-21T22:53:39.722910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:03.405030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754772+0000","last_change":"2024-04-21T22:52:58.454152+0000","last_active":"2024-04-21T22:53:39.754772+0000","last_peered":"2024-04-21T22:53:39.754772+0000","last_clean":"2024-04-21T22:53:39.754772+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-21T22:53:39.754772+0000","last_undegraded":"2024-04-21T22:53:39.754772+0000","last_fullsized":"2024-04-21T22:53:39.754772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_clean_scrub_stamp":"2024-04-21T22:52:55.145387+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:11:10.808812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722531+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-21T22:53:39.722531+0000","last_peered":"2024-04-21T22:53:39.722531+0000","last_clean":"2024-04-21T22:53:39.722531+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-21T22:53:39.722531+0000","last_undegraded":"2024-04-21T22:53:39.722531+0000","last_fullsized":"2024-04-21T22:53:39.722531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:29.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746081+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-21T22:53:39.746081+0000","last_peered":"2024-04-21T22:53:39.746081+0000","last_clean":"2024-04-21T22:53:39.746081+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-21T22:53:39.746081+0000","last_undegraded":"2024-04-21T22:53:39.746081+0000","last_fullsized":"2024-04-21T22:53:39.746081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721802+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-21T22:53:39.721802+0000","last_peered":"2024-04-21T22:53:39.721802+0000","last_clean":"2024-04-21T22:53:39.721802+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-21T22:53:39.721802+0000","last_undegraded":"2024-04-21T22:53:39.721802+0000","last_fullsized":"2024-04-21T22:53:39.721802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757228+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-21T22:53:39.757228+0000","last_peered":"2024-04-21T22:53:39.757228+0000","last_clean":"2024-04-21T22:53:39.757228+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-21T22:53:39.757228+0000","last_undegraded":"2024-04-21T22:53:39.757228+0000","last_fullsized":"2024-04-21T22:53:39.757228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761321+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-21T22:53:39.761321+0000","last_peered":"2024-04-21T22:53:39.761321+0000","last_clean":"2024-04-21T22:53:39.761321+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-21T22:53:39.761321+0000","last_undegraded":"2024-04-21T22:53:39.761321+0000","last_fullsized":"2024-04-21T22:53:39.761321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758128+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-21T22:53:39.758128+0000","last_peered":"2024-04-21T22:53:39.758128+0000","last_clean":"2024-04-21T22:53:39.758128+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-21T22:53:39.758128+0000","last_undegraded":"2024-04-21T22:53:39.758128+0000","last_fullsized":"2024-04-21T22:53:39.758128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:23.439754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722969+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-21T22:53:39.722969+0000","last_peered":"2024-04-21T22:53:39.722969+0000","last_clean":"2024-04-21T22:53:39.722969+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-21T22:53:39.722969+0000","last_undegraded":"2024-04-21T22:53:39.722969+0000","last_fullsized":"2024-04-21T22:53:39.722969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756576+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-21T22:53:39.756576+0000","last_peered":"2024-04-21T22:53:39.756576+0000","last_clean":"2024-04-21T22:53:39.756576+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-21T22:53:39.756576+0000","last_undegraded":"2024-04-21T22:53:39.756576+0000","last_fullsized":"2024-04-21T22:53:39.756576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760419+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-21T22:53:39.760419+0000","last_peered":"2024-04-21T22:53:39.760419+0000","last_clean":"2024-04-21T22:53:39.760419+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-21T22:53:39.760419+0000","last_undegraded":"2024-04-21T22:53:39.760419+0000","last_fullsized":"2024-04-21T22:53:39.760419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704674+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-21T22:53:39.704674+0000","last_peered":"2024-04-21T22:53:39.704674+0000","last_clean":"2024-04-21T22:53:39.704674+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-21T22:53:39.704674+0000","last_undegraded":"2024-04-21T22:53:39.704674+0000","last_fullsized":"2024-04-21T22:53:39.704674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723164+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-21T22:53:39.723164+0000","last_peered":"2024-04-21T22:53:39.723164+0000","last_clean":"2024-04-21T22:53:39.723164+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-21T22:53:39.723164+0000","last_undegraded":"2024-04-21T22:53:39.723164+0000","last_fullsized":"2024-04-21T22:53:39.723164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:56.447185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758199+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-21T22:53:39.758199+0000","last_peered":"2024-04-21T22:53:39.758199+0000","last_clean":"2024-04-21T22:53:39.758199+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-21T22:53:39.758199+0000","last_undegraded":"2024-04-21T22:53:39.758199+0000","last_fullsized":"2024-04-21T22:53:39.758199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746156+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-21T22:53:39.746156+0000","last_peered":"2024-04-21T22:53:39.746156+0000","last_clean":"2024-04-21T22:53:39.746156+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-21T22:53:39.746156+0000","last_undegraded":"2024-04-21T22:53:39.746156+0000","last_fullsized":"2024-04-21T22:53:39.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745957+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-21T22:53:39.745957+0000","last_peered":"2024-04-21T22:53:39.745957+0000","last_clean":"2024-04-21T22:53:39.745957+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-21T22:53:39.745957+0000","last_undegraded":"2024-04-21T22:53:39.745957+0000","last_fullsized":"2024-04-21T22:53:39.745957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050396+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-21T22:53:40.050396+0000","last_peered":"2024-04-21T22:53:40.050396+0000","last_clean":"2024-04-21T22:53:40.050396+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-21T22:53:40.050396+0000","last_undegraded":"2024-04-21T22:53:40.050396+0000","last_fullsized":"2024-04-21T22:53:40.050396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745835+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-21T22:53:39.745835+0000","last_peered":"2024-04-21T22:53:39.745835+0000","last_clean":"2024-04-21T22:53:39.745835+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-21T22:53:39.745835+0000","last_undegraded":"2024-04-21T22:53:39.745835+0000","last_fullsized":"2024-04-21T22:53:39.745835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755887+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-21T22:53:39.755887+0000","last_peered":"2024-04-21T22:53:39.755887+0000","last_clean":"2024-04-21T22:53:39.755887+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-21T22:53:39.755887+0000","last_undegraded":"2024-04-21T22:53:39.755887+0000","last_fullsized":"2024-04-21T22:53:39.755887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721729+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-21T22:53:39.721729+0000","last_peered":"2024-04-21T22:53:39.721729+0000","last_clean":"2024-04-21T22:53:39.721729+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-21T22:53:39.721729+0000","last_undegraded":"2024-04-21T22:53:39.721729+0000","last_fullsized":"2024-04-21T22:53:39.721729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746329+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-21T22:53:39.746329+0000","last_peered":"2024-04-21T22:53:39.746329+0000","last_clean":"2024-04-21T22:53:39.746329+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-21T22:53:39.746329+0000","last_undegraded":"2024-04-21T22:53:39.746329+0000","last_fullsized":"2024-04-21T22:53:39.746329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745442+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-21T22:53:39.745442+0000","last_peered":"2024-04-21T22:53:39.745442+0000","last_clean":"2024-04-21T22:53:39.745442+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-21T22:53:39.745442+0000","last_undegraded":"2024-04-21T22:53:39.745442+0000","last_fullsized":"2024-04-21T22:53:39.745442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758163+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-21T22:53:39.758163+0000","last_peered":"2024-04-21T22:53:39.758163+0000","last_clean":"2024-04-21T22:53:39.758163+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-21T22:53:39.758163+0000","last_undegraded":"2024-04-21T22:53:39.758163+0000","last_fullsized":"2024-04-21T22:53:39.758163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761803+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-21T22:53:39.761803+0000","last_peered":"2024-04-21T22:53:39.761803+0000","last_clean":"2024-04-21T22:53:39.761803+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-21T22:53:39.761803+0000","last_undegraded":"2024-04-21T22:53:39.761803+0000","last_fullsized":"2024-04-21T22:53:39.761803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050273+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-21T22:53:40.050273+0000","last_peered":"2024-04-21T22:53:40.050273+0000","last_clean":"2024-04-21T22:53:40.050273+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-21T22:53:40.050273+0000","last_undegraded":"2024-04-21T22:53:40.050273+0000","last_fullsized":"2024-04-21T22:53:40.050273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722321+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-21T22:53:39.722321+0000","last_peered":"2024-04-21T22:53:39.722321+0000","last_clean":"2024-04-21T22:53:39.722321+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-21T22:53:39.722321+0000","last_undegraded":"2024-04-21T22:53:39.722321+0000","last_fullsized":"2024-04-21T22:53:39.722321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:24:31.689158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722538+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-21T22:53:39.722538+0000","last_peered":"2024-04-21T22:53:39.722538+0000","last_clean":"2024-04-21T22:53:39.722538+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-21T22:53:39.722538+0000","last_undegraded":"2024-04-21T22:53:39.722538+0000","last_fullsized":"2024-04-21T22:53:39.722538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:05.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047053+0000","last_change":"2024-04-21T22:53:37.189530+0000","last_active":"2024-04-21T22:53:40.047053+0000","last_peered":"2024-04-21T22:53:40.047053+0000","last_clean":"2024-04-21T22:53:40.047053+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-21T22:53:40.047053+0000","last_undegraded":"2024-04-21T22:53:40.047053+0000","last_fullsized":"2024-04-21T22:53:40.047053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:16.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755277+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-21T22:53:39.755277+0000","last_peered":"2024-04-21T22:53:39.755277+0000","last_clean":"2024-04-21T22:53:39.755277+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-21T22:53:39.755277+0000","last_undegraded":"2024-04-21T22:53:39.755277+0000","last_fullsized":"2024-04-21T22:53:39.755277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047082+0000","last_change":"2024-04-21T22:53:37.187992+0000","last_active":"2024-04-21T22:53:40.047082+0000","last_peered":"2024-04-21T22:53:40.047082+0000","last_clean":"2024-04-21T22:53:40.047082+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-21T22:53:40.047082+0000","last_undegraded":"2024-04-21T22:53:40.047082+0000","last_fullsized":"2024-04-21T22:53:40.047082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:24.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759204+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-21T22:53:39.759204+0000","last_peered":"2024-04-21T22:53:39.759204+0000","last_clean":"2024-04-21T22:53:39.759204+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-21T22:53:39.759204+0000","last_undegraded":"2024-04-21T22:53:39.759204+0000","last_fullsized":"2024-04-21T22:53:39.759204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:59:51.600148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758563+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-21T22:53:39.758563+0000","last_peered":"2024-04-21T22:53:39.758563+0000","last_clean":"2024-04-21T22:53:39.758563+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-21T22:53:39.758563+0000","last_undegraded":"2024-04-21T22:53:39.758563+0000","last_fullsized":"2024-04-21T22:53:39.758563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:31:56.768493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758249+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-21T22:53:39.758249+0000","last_peered":"2024-04-21T22:53:39.758249+0000","last_clean":"2024-04-21T22:53:39.758249+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-21T22:53:39.758249+0000","last_undegraded":"2024-04-21T22:53:39.758249+0000","last_fullsized":"2024-04-21T22:53:39.758249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:49.627279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.229937+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-21T22:53:40.229937+0000","last_peered":"2024-04-21T22:53:40.229937+0000","last_clean":"2024-04-21T22:53:40.229937+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-21T22:53:40.229937+0000","last_undegraded":"2024-04-21T22:53:40.229937+0000","last_fullsized":"2024-04-21T22:53:40.229937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":83307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":672133,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":81751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":672155,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:53:58.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:53:58.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.230+0000 7f423d97d640 1 Processor -- start 2024-04-21T22:53:58.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f423d97d640 1 -- start start 2024-04-21T22:53:58.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f423d97d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f42380cae60 0x7f423815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f423d97d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f423806c8b0 0x7f423806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f423d97d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f423815e8b0 con 0x7f42380c4890 2024-04-21T22:53:58.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f423d97d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f423806d250 con 0x7f423806c8b0 2024-04-21T22:53:58.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f423d97d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f423815b390 con 0x7f42380cae60 2024-04-21T22:53:58.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f42377fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f423806c8b0 0x7f423806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f4236ffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f42380c4890 0x7f42380713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36196/0 (socket says 172.21.15.110:36196) 2024-04-21T22:53:58.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f4236ffd640 1 -- 172.21.15.110:0/2029910304 learned_addr learned my addr 172.21.15.110:0/2029910304 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:58.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.234+0000 7f422ffff640 1 --2- 172.21.15.110:0/2029910304 >> v2:172.21.15.154:3300/0 conn(0x7f42380cae60 0x7f423815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.238+0000 7f42377fe640 1 -- 172.21.15.110:0/2029910304 >> v2:172.21.15.154:3300/0 conn(0x7f42380cae60 msgr2=0x7f423815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.238+0000 7f42377fe640 1 --2- 172.21.15.110:0/2029910304 >> v2:172.21.15.154:3300/0 conn(0x7f42380cae60 0x7f423815ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.238+0000 7f42377fe640 1 -- 172.21.15.110:0/2029910304 >> v1:172.21.15.110:6789/0 conn(0x7f42380c4890 legacy=0x7f42380713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.238+0000 7f42377fe640 1 -- 172.21.15.110:0/2029910304 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423815dd30 con 0x7f423806c8b0 2024-04-21T22:53:58.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.246+0000 7f42377fe640 1 --2- 172.21.15.110:0/2029910304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f423806cd10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42380cec40 tx=0x7f423001f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2838f256c65846 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:58.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f42367fc640 1 -- 172.21.15.110:0/2029910304 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300b4070 con 0x7f423806c8b0 2024-04-21T22:53:58.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f42367fc640 1 -- 172.21.15.110:0/2029910304 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300af600 con 0x7f423806c8b0 2024-04-21T22:53:58.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f42367fc640 1 -- 172.21.15.110:0/2029910304 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300af9d0 con 0x7f423806c8b0 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 -- 172.21.15.110:0/2029910304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 msgr2=0x7f423806cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 --2- 172.21.15.110:0/2029910304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f423806cd10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42380cec40 tx=0x7f423001f120 comp rx=0 tx=0).stop 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 -- 172.21.15.110:0/2029910304 shutdown_connections 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 --2- 172.21.15.110:0/2029910304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f423806cd10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 --2- 172.21.15.110:0/2029910304 >> v2:172.21.15.154:3300/0 conn(0x7f42380cae60 0x7f423815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 -- 172.21.15.110:0/2029910304 >> 172.21.15.110:0/2029910304 conn(0x7f423806fc90 msgr2=0x7f4238070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 -- 172.21.15.110:0/2029910304 shutdown_connections 2024-04-21T22:53:58.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 -- 172.21.15.110:0/2029910304 wait complete. 2024-04-21T22:53:58.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 Processor -- start 2024-04-21T22:53:58.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 -- start start 2024-04-21T22:53:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f4238159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42380c4890 0x7f42381e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380cae60 0x7f42380c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.250+0000 7f423d97d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f423815e5d0 con 0x7f423806c8b0 2024-04-21T22:53:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.254+0000 7f423d97d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f423815e2f0 con 0x7f42380cae60 2024-04-21T22:53:58.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.254+0000 7f423d97d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f423806c390 con 0x7f42380c4890 2024-04-21T22:53:58.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.254+0000 7f42377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380cae60 0x7f42380c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.254+0000 7f422ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42380c4890 0x7f42381e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.254+0000 7f422ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42380c4890 0x7f42381e4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:48648/0 (socket says 172.21.15.110:48648) 2024-04-21T22:53:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.254+0000 7f422ffff640 1 -- 172.21.15.110:0/1652976591 learned_addr learned my addr 172.21.15.110:0/1652976591 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:58.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.254+0000 7f4236ffd640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f4238159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.262+0000 7f4236ffd640 1 -- 172.21.15.110:0/1652976591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42380c4890 msgr2=0x7f42381e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.262+0000 7f4236ffd640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42380c4890 0x7f42381e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.262+0000 7f4236ffd640 1 -- 172.21.15.110:0/1652976591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380cae60 msgr2=0x7f42380c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.262+0000 7f4236ffd640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380cae60 0x7f42380c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.262+0000 7f4236ffd640 1 -- 172.21.15.110:0/1652976591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42381effd0 con 0x7f423806c8b0 2024-04-21T22:53:58.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.262+0000 7f4236ffd640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f4238159370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f422800c3c0 tx=0x7f422800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:58.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.266+0000 7f4234ff9640 1 -- 172.21.15.110:0/1652976591 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228017070 con 0x7f423806c8b0 2024-04-21T22:53:58.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.266+0000 7f4234ff9640 1 -- 172.21.15.110:0/1652976591 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4228005cf0 con 0x7f423806c8b0 2024-04-21T22:53:58.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.266+0000 7f4234ff9640 1 -- 172.21.15.110:0/1652976591 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280072f0 con 0x7f423806c8b0 2024-04-21T22:53:58.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.266+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42381e65f0 con 0x7f423806c8b0 2024-04-21T22:53:58.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.266+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4238159fc0 con 0x7f423806c8b0 2024-04-21T22:53:58.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.270+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423804f510 con 0x7f423806c8b0 2024-04-21T22:53:58.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.290+0000 7f4234ff9640 1 -- 172.21.15.110:0/1652976591 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f422801a070 con 0x7f423806c8b0 2024-04-21T22:53:58.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.290+0000 7f4234ff9640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4218067910 0x7f4218069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.294+0000 7f422ffff640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4218067910 0x7f4218069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.294+0000 7f422ffff640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4218067910 0x7f4218069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42380c41c0 tx=0x7f4220009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:58.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.298+0000 7f4234ff9640 1 -- 172.21.15.110:0/1652976591 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f42280538e0 con 0x7f423806c8b0 2024-04-21T22:53:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.582+0000 7f4234ff9640 1 -- 172.21.15.110:0/1652976591 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f4228021020 con 0x7f423806c8b0 2024-04-21T22:53:58.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.750+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42380cb470 con 0x7f4218067910 2024-04-21T22:53:58.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.754+0000 7f4234ff9640 1 -- 172.21.15.110:0/1652976591 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251901 (secure 0 0 0) 0x7f42380cb470 con 0x7f4218067910 2024-04-21T22:53:58.756 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:58.758 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4218067910 msgr2=0x7f4218069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4218067910 0x7f4218069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42380c41c0 tx=0x7f4220009190 comp rx=0 tx=0).stop 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 msgr2=0x7f4238159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f4238159370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f422800c3c0 tx=0x7f422800c880 comp rx=0 tx=0).stop 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 shutdown_connections 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4218067910 0x7f4218069dd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380cae60 0x7f42380c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42380c4890 0x7f42381e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 --2- 172.21.15.110:0/1652976591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f423806c8b0 0x7f4238159370 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 >> 172.21.15.110:0/1652976591 conn(0x7f423806fc90 msgr2=0x7f4238153740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:58.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 shutdown_connections 2024-04-21T22:53:58.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.758+0000 7f423d97d640 1 -- 172.21.15.110:0/1652976591 wait complete. 2024-04-21T22:53:58.776 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-21T22:53:57.359256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234804,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739916,"statfs":{"total":773094113280,"available":772853673984,"internally_reserved":0,"allocated":2064384,"data_stored":1839116,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003431"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757459+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-21T22:53:39.757459+0000","last_peered":"2024-04-21T22:53:39.757459+0000","last_clean":"2024-04-21T22:53:39.757459+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-21T22:53:39.757459+0000","last_undegraded":"2024-04-21T22:53:39.757459+0000","last_fullsized":"2024-04-21T22:53:39.757459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757842+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-21T22:53:39.757842+0000","last_peered":"2024-04-21T22:53:39.757842+0000","last_clean":"2024-04-21T22:53:39.757842+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-21T22:53:39.757842+0000","last_undegraded":"2024-04-21T22:53:39.757842+0000","last_fullsized":"2024-04-21T22:53:39.757842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:25:19.748728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:27:16.978980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704596+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-21T22:53:39.704596+0000","last_peered":"2024-04-21T22:53:39.704596+0000","last_clean":"2024-04-21T22:53:39.704596+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-21T22:53:39.704596+0000","last_undegraded":"2024-04-21T22:53:39.704596+0000","last_fullsized":"2024-04-21T22:53:39.704596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756734+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-21T22:53:39.756734+0000","last_peered":"2024-04-21T22:53:39.756734+0000","last_clean":"2024-04-21T22:53:39.756734+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-21T22:53:39.756734+0000","last_undegraded":"2024-04-21T22:53:39.756734+0000","last_fullsized":"2024-04-21T22:53:39.756734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:26:22.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704812+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-21T22:53:39.704812+0000","last_peered":"2024-04-21T22:53:39.704812+0000","last_clean":"2024-04-21T22:53:39.704812+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-21T22:53:39.704812+0000","last_undegraded":"2024-04-21T22:53:39.704812+0000","last_fullsized":"2024-04-21T22:53:39.704812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756017+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-21T22:53:39.756017+0000","last_peered":"2024-04-21T22:53:39.756017+0000","last_clean":"2024-04-21T22:53:39.756017+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-21T22:53:39.756017+0000","last_undegraded":"2024-04-21T22:53:39.756017+0000","last_fullsized":"2024-04-21T22:53:39.756017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761187+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-21T22:53:39.761187+0000","last_peered":"2024-04-21T22:53:39.761187+0000","last_clean":"2024-04-21T22:53:39.761187+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-21T22:53:39.761187+0000","last_undegraded":"2024-04-21T22:53:39.761187+0000","last_fullsized":"2024-04-21T22:53:39.761187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:40:03.621192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755669+0000","last_change":"2024-04-21T22:53:38.576571+0000","last_active":"2024-04-21T22:53:39.755669+0000","last_peered":"2024-04-21T22:53:39.755669+0000","last_clean":"2024-04-21T22:53:39.755669+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-21T22:53:39.755669+0000","last_undegraded":"2024-04-21T22:53:39.755669+0000","last_fullsized":"2024-04-21T22:53:39.755669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757319+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-21T22:53:39.757319+0000","last_peered":"2024-04-21T22:53:39.757319+0000","last_clean":"2024-04-21T22:53:39.757319+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-21T22:53:39.757319+0000","last_undegraded":"2024-04-21T22:53:39.757319+0000","last_fullsized":"2024-04-21T22:53:39.757319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:26.176484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757851+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-21T22:53:39.757851+0000","last_peered":"2024-04-21T22:53:39.757851+0000","last_clean":"2024-04-21T22:53:39.757851+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-21T22:53:39.757851+0000","last_undegraded":"2024-04-21T22:53:39.757851+0000","last_fullsized":"2024-04-21T22:53:39.757851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757122+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-21T22:53:39.757122+0000","last_peered":"2024-04-21T22:53:39.757122+0000","last_clean":"2024-04-21T22:53:39.757122+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-21T22:53:39.757122+0000","last_undegraded":"2024-04-21T22:53:39.757122+0000","last_fullsized":"2024-04-21T22:53:39.757122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:51:01.311466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757254+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-21T22:53:39.757254+0000","last_peered":"2024-04-21T22:53:39.757254+0000","last_clean":"2024-04-21T22:53:39.757254+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-21T22:53:39.757254+0000","last_undegraded":"2024-04-21T22:53:39.757254+0000","last_fullsized":"2024-04-21T22:53:39.757254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757697+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-21T22:53:39.757697+0000","last_peered":"2024-04-21T22:53:39.757697+0000","last_clean":"2024-04-21T22:53:39.757697+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-21T22:53:39.757697+0000","last_undegraded":"2024-04-21T22:53:39.757697+0000","last_fullsized":"2024-04-21T22:53:39.757697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759126+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-21T22:53:39.759126+0000","last_peered":"2024-04-21T22:53:39.759126+0000","last_clean":"2024-04-21T22:53:39.759126+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-21T22:53:39.759126+0000","last_undegraded":"2024-04-21T22:53:39.759126+0000","last_fullsized":"2024-04-21T22:53:39.759126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:52:43.706899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721436+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-21T22:53:39.721436+0000","last_peered":"2024-04-21T22:53:39.721436+0000","last_clean":"2024-04-21T22:53:39.721436+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-21T22:53:39.721436+0000","last_undegraded":"2024-04-21T22:53:39.721436+0000","last_fullsized":"2024-04-21T22:53:39.721436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723468+0000","last_change":"2024-04-21T22:53:38.601841+0000","last_active":"2024-04-21T22:53:39.723468+0000","last_peered":"2024-04-21T22:53:39.723468+0000","last_clean":"2024-04-21T22:53:39.723468+0000","last_became_active":"2024-04-21T22:53:38.601086+0000","last_became_peered":"2024-04-21T22:53:38.601086+0000","last_unstale":"2024-04-21T22:53:39.723468+0000","last_undegraded":"2024-04-21T22:53:39.723468+0000","last_fullsized":"2024-04-21T22:53:39.723468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:45:23.058986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.762282+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-21T22:53:39.762282+0000","last_peered":"2024-04-21T22:53:39.762282+0000","last_clean":"2024-04-21T22:53:39.762282+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-21T22:53:39.762282+0000","last_undegraded":"2024-04-21T22:53:39.762282+0000","last_fullsized":"2024-04-21T22:53:39.762282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723205+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-21T22:53:39.723205+0000","last_peered":"2024-04-21T22:53:39.723205+0000","last_clean":"2024-04-21T22:53:39.723205+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-21T22:53:39.723205+0000","last_undegraded":"2024-04-21T22:53:39.723205+0000","last_fullsized":"2024-04-21T22:53:39.723205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:37:06.081826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757282+0000","last_change":"2024-04-21T22:53:38.610862+0000","last_active":"2024-04-21T22:53:39.757282+0000","last_peered":"2024-04-21T22:53:39.757282+0000","last_clean":"2024-04-21T22:53:39.757282+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-21T22:53:39.757282+0000","last_undegraded":"2024-04-21T22:53:39.757282+0000","last_fullsized":"2024-04-21T22:53:39.757282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:51.748240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745760+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-21T22:53:39.745760+0000","last_peered":"2024-04-21T22:53:39.745760+0000","last_clean":"2024-04-21T22:53:39.745760+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-21T22:53:39.745760+0000","last_undegraded":"2024-04-21T22:53:39.745760+0000","last_fullsized":"2024-04-21T22:53:39.745760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755353+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-21T22:53:39.755353+0000","last_peered":"2024-04-21T22:53:39.755353+0000","last_clean":"2024-04-21T22:53:39.755353+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-21T22:53:39.755353+0000","last_undegraded":"2024-04-21T22:53:39.755353+0000","last_fullsized":"2024-04-21T22:53:39.755353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759590+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-21T22:53:39.759590+0000","last_peered":"2024-04-21T22:53:39.759590+0000","last_clean":"2024-04-21T22:53:39.759590+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-21T22:53:39.759590+0000","last_undegraded":"2024-04-21T22:53:39.759590+0000","last_fullsized":"2024-04-21T22:53:39.759590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:47:54.239652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721864+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-21T22:53:39.721864+0000","last_peered":"2024-04-21T22:53:39.721864+0000","last_clean":"2024-04-21T22:53:39.721864+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-21T22:53:39.721864+0000","last_undegraded":"2024-04-21T22:53:39.721864+0000","last_fullsized":"2024-04-21T22:53:39.721864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758853+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-21T22:53:39.758853+0000","last_peered":"2024-04-21T22:53:39.758853+0000","last_clean":"2024-04-21T22:53:39.758853+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-21T22:53:39.758853+0000","last_undegraded":"2024-04-21T22:53:39.758853+0000","last_fullsized":"2024-04-21T22:53:39.758853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:25:42.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705131+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-21T22:53:39.705131+0000","last_peered":"2024-04-21T22:53:39.705131+0000","last_clean":"2024-04-21T22:53:39.705131+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-21T22:53:39.705131+0000","last_undegraded":"2024-04-21T22:53:39.705131+0000","last_fullsized":"2024-04-21T22:53:39.705131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757428+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-21T22:53:39.757428+0000","last_peered":"2024-04-21T22:53:39.757428+0000","last_clean":"2024-04-21T22:53:39.757428+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-21T22:53:39.757428+0000","last_undegraded":"2024-04-21T22:53:39.757428+0000","last_fullsized":"2024-04-21T22:53:39.757428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757859+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-21T22:53:39.757859+0000","last_peered":"2024-04-21T22:53:39.757859+0000","last_clean":"2024-04-21T22:53:39.757859+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-21T22:53:39.757859+0000","last_undegraded":"2024-04-21T22:53:39.757859+0000","last_fullsized":"2024-04-21T22:53:39.757859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759786+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-21T22:53:39.759786+0000","last_peered":"2024-04-21T22:53:39.759786+0000","last_clean":"2024-04-21T22:53:39.759786+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-21T22:53:39.759786+0000","last_undegraded":"2024-04-21T22:53:39.759786+0000","last_fullsized":"2024-04-21T22:53:39.759786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:43:35.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722003+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-21T22:53:39.722003+0000","last_peered":"2024-04-21T22:53:39.722003+0000","last_clean":"2024-04-21T22:53:39.722003+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-21T22:53:39.722003+0000","last_undegraded":"2024-04-21T22:53:39.722003+0000","last_fullsized":"2024-04-21T22:53:39.722003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761458+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-21T22:53:39.761458+0000","last_peered":"2024-04-21T22:53:39.761458+0000","last_clean":"2024-04-21T22:53:39.761458+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-21T22:53:39.761458+0000","last_undegraded":"2024-04-21T22:53:39.761458+0000","last_fullsized":"2024-04-21T22:53:39.761458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704355+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-21T22:53:39.704355+0000","last_peered":"2024-04-21T22:53:39.704355+0000","last_clean":"2024-04-21T22:53:39.704355+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-21T22:53:39.704355+0000","last_undegraded":"2024-04-21T22:53:39.704355+0000","last_fullsized":"2024-04-21T22:53:39.704355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755367+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-21T22:53:39.755367+0000","last_peered":"2024-04-21T22:53:39.755367+0000","last_clean":"2024-04-21T22:53:39.755367+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-21T22:53:39.755367+0000","last_undegraded":"2024-04-21T22:53:39.755367+0000","last_fullsized":"2024-04-21T22:53:39.755367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760120+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-21T22:53:39.760120+0000","last_peered":"2024-04-21T22:53:39.760120+0000","last_clean":"2024-04-21T22:53:39.760120+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-21T22:53:39.760120+0000","last_undegraded":"2024-04-21T22:53:39.760120+0000","last_fullsized":"2024-04-21T22:53:39.760120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746430+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-21T22:53:39.746430+0000","last_peered":"2024-04-21T22:53:39.746430+0000","last_clean":"2024-04-21T22:53:39.746430+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-21T22:53:39.746430+0000","last_undegraded":"2024-04-21T22:53:39.746430+0000","last_fullsized":"2024-04-21T22:53:39.746430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050038+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-21T22:53:40.050038+0000","last_peered":"2024-04-21T22:53:40.050038+0000","last_clean":"2024-04-21T22:53:40.050038+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-21T22:53:40.050038+0000","last_undegraded":"2024-04-21T22:53:40.050038+0000","last_fullsized":"2024-04-21T22:53:40.050038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:31.566421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757473+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-21T22:53:39.757473+0000","last_peered":"2024-04-21T22:53:39.757473+0000","last_clean":"2024-04-21T22:53:39.757473+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-21T22:53:39.757473+0000","last_undegraded":"2024-04-21T22:53:39.757473+0000","last_fullsized":"2024-04-21T22:53:39.757473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758930+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-21T22:53:39.758930+0000","last_peered":"2024-04-21T22:53:39.758930+0000","last_clean":"2024-04-21T22:53:39.758930+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-21T22:53:39.758930+0000","last_undegraded":"2024-04-21T22:53:39.758930+0000","last_fullsized":"2024-04-21T22:53:39.758930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:38:02.541775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721605+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-21T22:53:39.721605+0000","last_peered":"2024-04-21T22:53:39.721605+0000","last_clean":"2024-04-21T22:53:39.721605+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-21T22:53:39.721605+0000","last_undegraded":"2024-04-21T22:53:39.721605+0000","last_fullsized":"2024-04-21T22:53:39.721605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746093+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-21T22:53:39.746093+0000","last_peered":"2024-04-21T22:53:39.746093+0000","last_clean":"2024-04-21T22:53:39.746093+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-21T22:53:39.746093+0000","last_undegraded":"2024-04-21T22:53:39.746093+0000","last_fullsized":"2024-04-21T22:53:39.746093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755825+0000","last_change":"2024-04-21T22:53:37.185089+0000","last_active":"2024-04-21T22:53:39.755825+0000","last_peered":"2024-04-21T22:53:39.755825+0000","last_clean":"2024-04-21T22:53:39.755825+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-21T22:53:39.755825+0000","last_undegraded":"2024-04-21T22:53:39.755825+0000","last_fullsized":"2024-04-21T22:53:39.755825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705229+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-21T22:53:39.705229+0000","last_peered":"2024-04-21T22:53:39.705229+0000","last_clean":"2024-04-21T22:53:39.705229+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-21T22:53:39.705229+0000","last_undegraded":"2024-04-21T22:53:39.705229+0000","last_fullsized":"2024-04-21T22:53:39.705229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:09.983320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757753+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-21T22:53:39.757753+0000","last_peered":"2024-04-21T22:53:39.757753+0000","last_clean":"2024-04-21T22:53:39.757753+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-21T22:53:39.757753+0000","last_undegraded":"2024-04-21T22:53:39.757753+0000","last_fullsized":"2024-04-21T22:53:39.757753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759728+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-21T22:53:39.759728+0000","last_peered":"2024-04-21T22:53:39.759728+0000","last_clean":"2024-04-21T22:53:39.759728+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-21T22:53:39.759728+0000","last_undegraded":"2024-04-21T22:53:39.759728+0000","last_fullsized":"2024-04-21T22:53:39.759728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:13.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047461+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-21T22:53:40.047461+0000","last_peered":"2024-04-21T22:53:40.047461+0000","last_clean":"2024-04-21T22:53:40.047461+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-21T22:53:40.047461+0000","last_undegraded":"2024-04-21T22:53:40.047461+0000","last_fullsized":"2024-04-21T22:53:40.047461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722381+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-21T22:53:39.722381+0000","last_peered":"2024-04-21T22:53:39.722381+0000","last_clean":"2024-04-21T22:53:39.722381+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-21T22:53:39.722381+0000","last_undegraded":"2024-04-21T22:53:39.722381+0000","last_fullsized":"2024-04-21T22:53:39.722381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:50.140041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.280055+0000","last_change":"2024-04-21T22:53:37.134021+0000","last_active":"2024-04-21T22:53:40.280055+0000","last_peered":"2024-04-21T22:53:40.280055+0000","last_clean":"2024-04-21T22:53:40.280055+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-21T22:53:40.280055+0000","last_undegraded":"2024-04-21T22:53:40.280055+0000","last_fullsized":"2024-04-21T22:53:40.280055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:57.000042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757466+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-21T22:53:39.757466+0000","last_peered":"2024-04-21T22:53:39.757466+0000","last_clean":"2024-04-21T22:53:39.757466+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-21T22:53:39.757466+0000","last_undegraded":"2024-04-21T22:53:39.757466+0000","last_fullsized":"2024-04-21T22:53:39.757466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.045806+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-21T22:53:40.045806+0000","last_peered":"2024-04-21T22:53:40.045806+0000","last_clean":"2024-04-21T22:53:40.045806+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-21T22:53:40.045806+0000","last_undegraded":"2024-04-21T22:53:40.045806+0000","last_fullsized":"2024-04-21T22:53:40.045806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757940+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-21T22:53:39.757940+0000","last_peered":"2024-04-21T22:53:39.757940+0000","last_clean":"2024-04-21T22:53:39.757940+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-21T22:53:39.757940+0000","last_undegraded":"2024-04-21T22:53:39.757940+0000","last_fullsized":"2024-04-21T22:53:39.757940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722866+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-21T22:53:39.722866+0000","last_peered":"2024-04-21T22:53:39.722866+0000","last_clean":"2024-04-21T22:53:39.722866+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-21T22:53:39.722866+0000","last_undegraded":"2024-04-21T22:53:39.722866+0000","last_fullsized":"2024-04-21T22:53:39.722866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:52.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722199+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-21T22:53:39.722199+0000","last_peered":"2024-04-21T22:53:39.722199+0000","last_clean":"2024-04-21T22:53:39.722199+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-21T22:53:39.722199+0000","last_undegraded":"2024-04-21T22:53:39.722199+0000","last_fullsized":"2024-04-21T22:53:39.722199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:27.631111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756116+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-21T22:53:39.756116+0000","last_peered":"2024-04-21T22:53:39.756116+0000","last_clean":"2024-04-21T22:53:39.756116+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-21T22:53:39.756116+0000","last_undegraded":"2024-04-21T22:53:39.756116+0000","last_fullsized":"2024-04-21T22:53:39.756116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754875+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-21T22:53:39.754875+0000","last_peered":"2024-04-21T22:53:39.754875+0000","last_clean":"2024-04-21T22:53:39.754875+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-21T22:53:39.754875+0000","last_undegraded":"2024-04-21T22:53:39.754875+0000","last_fullsized":"2024-04-21T22:53:39.754875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.228676+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-21T22:53:40.228676+0000","last_peered":"2024-04-21T22:53:40.228676+0000","last_clean":"2024-04-21T22:53:40.228676+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-21T22:53:40.228676+0000","last_undegraded":"2024-04-21T22:53:40.228676+0000","last_fullsized":"2024-04-21T22:53:40.228676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721602+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-21T22:53:39.721602+0000","last_peered":"2024-04-21T22:53:39.721602+0000","last_clean":"2024-04-21T22:53:39.721602+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-21T22:53:39.721602+0000","last_undegraded":"2024-04-21T22:53:39.721602+0000","last_fullsized":"2024-04-21T22:53:39.721602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758292+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-21T22:53:39.758292+0000","last_peered":"2024-04-21T22:53:39.758292+0000","last_clean":"2024-04-21T22:53:39.758292+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-21T22:53:39.758292+0000","last_undegraded":"2024-04-21T22:53:39.758292+0000","last_fullsized":"2024-04-21T22:53:39.758292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.705317+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-21T22:53:39.705317+0000","last_peered":"2024-04-21T22:53:39.705317+0000","last_clean":"2024-04-21T22:53:39.705317+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-21T22:53:39.705317+0000","last_undegraded":"2024-04-21T22:53:39.705317+0000","last_fullsized":"2024-04-21T22:53:39.705317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.164673+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-21T22:53:40.164673+0000","last_peered":"2024-04-21T22:53:40.164673+0000","last_clean":"2024-04-21T22:53:40.164673+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-21T22:53:40.164673+0000","last_undegraded":"2024-04-21T22:53:40.164673+0000","last_fullsized":"2024-04-21T22:53:40.164673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757835+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-21T22:53:39.757835+0000","last_peered":"2024-04-21T22:53:39.757835+0000","last_clean":"2024-04-21T22:53:39.757835+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-21T22:53:39.757835+0000","last_undegraded":"2024-04-21T22:53:39.757835+0000","last_fullsized":"2024-04-21T22:53:39.757835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760485+0000","last_change":"2024-04-21T22:53:37.253316+0000","last_active":"2024-04-21T22:53:39.760485+0000","last_peered":"2024-04-21T22:53:39.760485+0000","last_clean":"2024-04-21T22:53:39.760485+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-21T22:53:39.760485+0000","last_undegraded":"2024-04-21T22:53:39.760485+0000","last_fullsized":"2024-04-21T22:53:39.760485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:45:21.383363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757430+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-21T22:53:39.757430+0000","last_peered":"2024-04-21T22:53:39.757430+0000","last_clean":"2024-04-21T22:53:39.757430+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-21T22:53:39.757430+0000","last_undegraded":"2024-04-21T22:53:39.757430+0000","last_fullsized":"2024-04-21T22:53:39.757430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758514+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-21T22:53:39.758514+0000","last_peered":"2024-04-21T22:53:39.758514+0000","last_clean":"2024-04-21T22:53:39.758514+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-21T22:53:39.758514+0000","last_undegraded":"2024-04-21T22:53:39.758514+0000","last_fullsized":"2024-04-21T22:53:39.758514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722910+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-21T22:53:39.722910+0000","last_peered":"2024-04-21T22:53:39.722910+0000","last_clean":"2024-04-21T22:53:39.722910+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-21T22:53:39.722910+0000","last_undegraded":"2024-04-21T22:53:39.722910+0000","last_fullsized":"2024-04-21T22:53:39.722910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:03.405030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.754772+0000","last_change":"2024-04-21T22:52:58.454152+0000","last_active":"2024-04-21T22:53:39.754772+0000","last_peered":"2024-04-21T22:53:39.754772+0000","last_clean":"2024-04-21T22:53:39.754772+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-21T22:53:39.754772+0000","last_undegraded":"2024-04-21T22:53:39.754772+0000","last_fullsized":"2024-04-21T22:53:39.754772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_clean_scrub_stamp":"2024-04-21T22:52:55.145387+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:11:10.808812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722531+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-21T22:53:39.722531+0000","last_peered":"2024-04-21T22:53:39.722531+0000","last_clean":"2024-04-21T22:53:39.722531+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-21T22:53:39.722531+0000","last_undegraded":"2024-04-21T22:53:39.722531+0000","last_fullsized":"2024-04-21T22:53:39.722531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:29.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746081+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-21T22:53:39.746081+0000","last_peered":"2024-04-21T22:53:39.746081+0000","last_clean":"2024-04-21T22:53:39.746081+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-21T22:53:39.746081+0000","last_undegraded":"2024-04-21T22:53:39.746081+0000","last_fullsized":"2024-04-21T22:53:39.746081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721802+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-21T22:53:39.721802+0000","last_peered":"2024-04-21T22:53:39.721802+0000","last_clean":"2024-04-21T22:53:39.721802+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-21T22:53:39.721802+0000","last_undegraded":"2024-04-21T22:53:39.721802+0000","last_fullsized":"2024-04-21T22:53:39.721802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.757228+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-21T22:53:39.757228+0000","last_peered":"2024-04-21T22:53:39.757228+0000","last_clean":"2024-04-21T22:53:39.757228+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-21T22:53:39.757228+0000","last_undegraded":"2024-04-21T22:53:39.757228+0000","last_fullsized":"2024-04-21T22:53:39.757228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761321+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-21T22:53:39.761321+0000","last_peered":"2024-04-21T22:53:39.761321+0000","last_clean":"2024-04-21T22:53:39.761321+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-21T22:53:39.761321+0000","last_undegraded":"2024-04-21T22:53:39.761321+0000","last_fullsized":"2024-04-21T22:53:39.761321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758128+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-21T22:53:39.758128+0000","last_peered":"2024-04-21T22:53:39.758128+0000","last_clean":"2024-04-21T22:53:39.758128+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-21T22:53:39.758128+0000","last_undegraded":"2024-04-21T22:53:39.758128+0000","last_fullsized":"2024-04-21T22:53:39.758128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:23.439754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722969+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-21T22:53:39.722969+0000","last_peered":"2024-04-21T22:53:39.722969+0000","last_clean":"2024-04-21T22:53:39.722969+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-21T22:53:39.722969+0000","last_undegraded":"2024-04-21T22:53:39.722969+0000","last_fullsized":"2024-04-21T22:53:39.722969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.756576+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-21T22:53:39.756576+0000","last_peered":"2024-04-21T22:53:39.756576+0000","last_clean":"2024-04-21T22:53:39.756576+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-21T22:53:39.756576+0000","last_undegraded":"2024-04-21T22:53:39.756576+0000","last_fullsized":"2024-04-21T22:53:39.756576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.760419+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-21T22:53:39.760419+0000","last_peered":"2024-04-21T22:53:39.760419+0000","last_clean":"2024-04-21T22:53:39.760419+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-21T22:53:39.760419+0000","last_undegraded":"2024-04-21T22:53:39.760419+0000","last_fullsized":"2024-04-21T22:53:39.760419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.704674+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-21T22:53:39.704674+0000","last_peered":"2024-04-21T22:53:39.704674+0000","last_clean":"2024-04-21T22:53:39.704674+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-21T22:53:39.704674+0000","last_undegraded":"2024-04-21T22:53:39.704674+0000","last_fullsized":"2024-04-21T22:53:39.704674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.723164+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-21T22:53:39.723164+0000","last_peered":"2024-04-21T22:53:39.723164+0000","last_clean":"2024-04-21T22:53:39.723164+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-21T22:53:39.723164+0000","last_undegraded":"2024-04-21T22:53:39.723164+0000","last_fullsized":"2024-04-21T22:53:39.723164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:56.447185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758199+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-21T22:53:39.758199+0000","last_peered":"2024-04-21T22:53:39.758199+0000","last_clean":"2024-04-21T22:53:39.758199+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-21T22:53:39.758199+0000","last_undegraded":"2024-04-21T22:53:39.758199+0000","last_fullsized":"2024-04-21T22:53:39.758199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746156+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-21T22:53:39.746156+0000","last_peered":"2024-04-21T22:53:39.746156+0000","last_clean":"2024-04-21T22:53:39.746156+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-21T22:53:39.746156+0000","last_undegraded":"2024-04-21T22:53:39.746156+0000","last_fullsized":"2024-04-21T22:53:39.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745957+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-21T22:53:39.745957+0000","last_peered":"2024-04-21T22:53:39.745957+0000","last_clean":"2024-04-21T22:53:39.745957+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-21T22:53:39.745957+0000","last_undegraded":"2024-04-21T22:53:39.745957+0000","last_fullsized":"2024-04-21T22:53:39.745957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050396+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-21T22:53:40.050396+0000","last_peered":"2024-04-21T22:53:40.050396+0000","last_clean":"2024-04-21T22:53:40.050396+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-21T22:53:40.050396+0000","last_undegraded":"2024-04-21T22:53:40.050396+0000","last_fullsized":"2024-04-21T22:53:40.050396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745835+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-21T22:53:39.745835+0000","last_peered":"2024-04-21T22:53:39.745835+0000","last_clean":"2024-04-21T22:53:39.745835+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-21T22:53:39.745835+0000","last_undegraded":"2024-04-21T22:53:39.745835+0000","last_fullsized":"2024-04-21T22:53:39.745835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755887+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-21T22:53:39.755887+0000","last_peered":"2024-04-21T22:53:39.755887+0000","last_clean":"2024-04-21T22:53:39.755887+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-21T22:53:39.755887+0000","last_undegraded":"2024-04-21T22:53:39.755887+0000","last_fullsized":"2024-04-21T22:53:39.755887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.721729+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-21T22:53:39.721729+0000","last_peered":"2024-04-21T22:53:39.721729+0000","last_clean":"2024-04-21T22:53:39.721729+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-21T22:53:39.721729+0000","last_undegraded":"2024-04-21T22:53:39.721729+0000","last_fullsized":"2024-04-21T22:53:39.721729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.746329+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-21T22:53:39.746329+0000","last_peered":"2024-04-21T22:53:39.746329+0000","last_clean":"2024-04-21T22:53:39.746329+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-21T22:53:39.746329+0000","last_undegraded":"2024-04-21T22:53:39.746329+0000","last_fullsized":"2024-04-21T22:53:39.746329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.745442+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-21T22:53:39.745442+0000","last_peered":"2024-04-21T22:53:39.745442+0000","last_clean":"2024-04-21T22:53:39.745442+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-21T22:53:39.745442+0000","last_undegraded":"2024-04-21T22:53:39.745442+0000","last_fullsized":"2024-04-21T22:53:39.745442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758163+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-21T22:53:39.758163+0000","last_peered":"2024-04-21T22:53:39.758163+0000","last_clean":"2024-04-21T22:53:39.758163+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-21T22:53:39.758163+0000","last_undegraded":"2024-04-21T22:53:39.758163+0000","last_fullsized":"2024-04-21T22:53:39.758163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.761803+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-21T22:53:39.761803+0000","last_peered":"2024-04-21T22:53:39.761803+0000","last_clean":"2024-04-21T22:53:39.761803+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-21T22:53:39.761803+0000","last_undegraded":"2024-04-21T22:53:39.761803+0000","last_fullsized":"2024-04-21T22:53:39.761803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.050273+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-21T22:53:40.050273+0000","last_peered":"2024-04-21T22:53:40.050273+0000","last_clean":"2024-04-21T22:53:40.050273+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-21T22:53:40.050273+0000","last_undegraded":"2024-04-21T22:53:40.050273+0000","last_fullsized":"2024-04-21T22:53:40.050273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722321+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-21T22:53:39.722321+0000","last_peered":"2024-04-21T22:53:39.722321+0000","last_clean":"2024-04-21T22:53:39.722321+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-21T22:53:39.722321+0000","last_undegraded":"2024-04-21T22:53:39.722321+0000","last_fullsized":"2024-04-21T22:53:39.722321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:24:31.689158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.722538+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-21T22:53:39.722538+0000","last_peered":"2024-04-21T22:53:39.722538+0000","last_clean":"2024-04-21T22:53:39.722538+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-21T22:53:39.722538+0000","last_undegraded":"2024-04-21T22:53:39.722538+0000","last_fullsized":"2024-04-21T22:53:39.722538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:05.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047053+0000","last_change":"2024-04-21T22:53:37.189530+0000","last_active":"2024-04-21T22:53:40.047053+0000","last_peered":"2024-04-21T22:53:40.047053+0000","last_clean":"2024-04-21T22:53:40.047053+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-21T22:53:40.047053+0000","last_undegraded":"2024-04-21T22:53:40.047053+0000","last_fullsized":"2024-04-21T22:53:40.047053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:16.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.755277+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-21T22:53:39.755277+0000","last_peered":"2024-04-21T22:53:39.755277+0000","last_clean":"2024-04-21T22:53:39.755277+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-21T22:53:39.755277+0000","last_undegraded":"2024-04-21T22:53:39.755277+0000","last_fullsized":"2024-04-21T22:53:39.755277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.047082+0000","last_change":"2024-04-21T22:53:37.187992+0000","last_active":"2024-04-21T22:53:40.047082+0000","last_peered":"2024-04-21T22:53:40.047082+0000","last_clean":"2024-04-21T22:53:40.047082+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-21T22:53:40.047082+0000","last_undegraded":"2024-04-21T22:53:40.047082+0000","last_fullsized":"2024-04-21T22:53:40.047082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:24.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.759204+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-21T22:53:39.759204+0000","last_peered":"2024-04-21T22:53:39.759204+0000","last_clean":"2024-04-21T22:53:39.759204+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-21T22:53:39.759204+0000","last_undegraded":"2024-04-21T22:53:39.759204+0000","last_fullsized":"2024-04-21T22:53:39.759204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:59:51.600148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758563+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-21T22:53:39.758563+0000","last_peered":"2024-04-21T22:53:39.758563+0000","last_clean":"2024-04-21T22:53:39.758563+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-21T22:53:39.758563+0000","last_undegraded":"2024-04-21T22:53:39.758563+0000","last_fullsized":"2024-04-21T22:53:39.758563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:31:56.768493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:39.758249+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-21T22:53:39.758249+0000","last_peered":"2024-04-21T22:53:39.758249+0000","last_clean":"2024-04-21T22:53:39.758249+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-21T22:53:39.758249+0000","last_undegraded":"2024-04-21T22:53:39.758249+0000","last_fullsized":"2024-04-21T22:53:39.758249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:49.627279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-21T22:53:40.229937+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-21T22:53:40.229937+0000","last_peered":"2024-04-21T22:53:40.229937+0000","last_clean":"2024-04-21T22:53:40.229937+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-21T22:53:40.229937+0000","last_undegraded":"2024-04-21T22:53:40.229937+0000","last_fullsized":"2024-04-21T22:53:40.229937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":83307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":672133,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":81751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":672155,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:53:58.780 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-21T22:53:58.780 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-21T22:53:58.781 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-21T22:53:58.781 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-21T22:53:58.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.946+0000 7f67f73cb640 1 Processor -- start 2024-04-21T22:53:58.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.946+0000 7f67f73cb640 1 -- start start 2024-04-21T22:53:58.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.946+0000 7f67f73cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cf250 0x7f67f006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.946+0000 7f67f73cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f00cd9b0 con 0x7f67f006c380 2024-04-21T22:53:58.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.946+0000 7f67f73cb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f015a5d0 con 0x7f67f00cde60 2024-04-21T22:53:58.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.946+0000 7f67f73cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f67f015a8b0 con 0x7f67f00cf250 2024-04-21T22:53:58.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.950+0000 7f67f5167640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f67f006c380 0x7f67f00ceb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36202/0 (socket says 172.21.15.110:36202) 2024-04-21T22:53:58.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.950+0000 7f67f5167640 1 -- 172.21.15.110:0/1237834027 learned_addr learned my addr 172.21.15.110:0/1237834027 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:53:58.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.950+0000 7f67f4966640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cf250 0x7f67f006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.950+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825900007 0 0) 0x7f67f00cd9b0 con 0x7f67f006c380 2024-04-21T22:53:58.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.950+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67dc003530 con 0x7f67f006c380 2024-04-21T22:53:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219741660 0 0) 0x7f67f015a5d0 con 0x7f67f00cde60 2024-04-21T22:53:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67f00cd9b0 con 0x7f67f00cde60 2024-04-21T22:53:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 591176927 0 0) 0x7f67dc003530 con 0x7f67f006c380 2024-04-21T22:53:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cf250 msgr2=0x7f67f006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cf250 0x7f67f006c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 >> v1:172.21.15.154:6789/0 conn(0x7f67f00cde60 legacy=0x7f67f00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f015ab90 con 0x7f67f006c380 2024-04-21T22:53:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f67ec001680 con 0x7f67f006c380 2024-04-21T22:53:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 >> v1:172.21.15.110:6789/0 conn(0x7f67f006c380 legacy=0x7f67f00ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc003b80 0x7f67dc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc004810 0x7f67dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cf250 0x7f67dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f67f015a8b0 con 0x7f67dc003b80 2024-04-21T22:53:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc00ba80 con 0x7f67dc004810 2024-04-21T22:53:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.954+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f67dc00bc80 con 0x7f67f00cf250 2024-04-21T22:53:58.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.958+0000 7f67f5167640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc003b80 0x7f67dc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.962+0000 7f67f5167640 1 -- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cf250 msgr2=0x7f67dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:58.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.962+0000 7f67f5167640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cf250 0x7f67dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.962+0000 7f67f5167640 1 -- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc004810 msgr2=0x7f67dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:58.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.962+0000 7f67f5167640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc004810 0x7f67dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.962+0000 7f67f5167640 1 -- 172.21.15.110:0/1237834027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc003530 con 0x7f67dc003b80 2024-04-21T22:53:58.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.966+0000 7f67f5167640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc003b80 0x7f67dc003f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00c0e0 tx=0x7f67ec01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349a4c04a981000e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:58.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.966+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec007c50 con 0x7f67dc003b80 2024-04-21T22:53:58.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ec0a9070 con 0x7f67dc003b80 2024-04-21T22:53:58.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67e7fff640 1 -- 172.21.15.110:0/1237834027 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec005d60 con 0x7f67dc003b80 2024-04-21T22:53:58.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 -- 172.21.15.110:0/1237834027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc003b80 msgr2=0x7f67dc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 --2- 172.21.15.110:0/1237834027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc003b80 0x7f67dc003f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00c0e0 tx=0x7f67ec01cb80 comp rx=0 tx=0).stop 2024-04-21T22:53:58.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f5968640 1 -- 172.21.15.110:0/1237834027 reap_dead start 2024-04-21T22:53:58.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 -- 172.21.15.110:0/1237834027 shutdown_connections 2024-04-21T22:53:58.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 -- 172.21.15.110:0/1237834027 >> 172.21.15.110:0/1237834027 conn(0x7f67f00b1640 msgr2=0x7f67f00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:58.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 -- 172.21.15.110:0/1237834027 shutdown_connections 2024-04-21T22:53:58.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 -- 172.21.15.110:0/1237834027 wait complete. 2024-04-21T22:53:58.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 Processor -- start 2024-04-21T22:53:58.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.970+0000 7f67f73cb640 1 -- start start 2024-04-21T22:53:58.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f73cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cb2b0 0x7f67f00cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f73cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67f014bc50 0x7f67f01f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f73cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f01f4210 0x7f67f01f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:58.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f73cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f67f015a2a0 con 0x7f67f014bc50 2024-04-21T22:53:58.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f73cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67f00cb130 con 0x7f67f01f4210 2024-04-21T22:53:58.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f73cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f67f015b150 con 0x7f67f00cb2b0 2024-04-21T22:53:58.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f4966640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67f014bc50 0x7f67f01f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f4966640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67f014bc50 0x7f67f01f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60664/0 (socket says 172.21.15.110:60664) 2024-04-21T22:53:58.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f4966640 1 -- 172.21.15.110:0/2232749785 learned_addr learned my addr 172.21.15.110:0/2232749785 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:58.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f5167640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cb2b0 0x7f67f00cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.974+0000 7f67f5968640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f01f4210 0x7f67f01f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:58.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.978+0000 7f67f4966640 1 -- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cb2b0 msgr2=0x7f67f00cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.978+0000 7f67f4966640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cb2b0 0x7f67f00cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.978+0000 7f67f4966640 1 -- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f01f4210 msgr2=0x7f67f01f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:58.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.978+0000 7f67f4966640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f01f4210 0x7f67f01f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:58.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.978+0000 7f67f4966640 1 -- 172.21.15.110:0/2232749785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f014c520 con 0x7f67f014bc50 2024-04-21T22:53:58.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.978+0000 7f67f4966640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67f014bc50 0x7f67f01f3cd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67e000e8f0 tx=0x7f67e000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.982+0000 7f67e5ffb640 1 -- 172.21.15.110:0/2232749785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0017070 con 0x7f67f014bc50 2024-04-21T22:53:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.982+0000 7f67e5ffb640 1 -- 172.21.15.110:0/2232749785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e000c940 con 0x7f67f014bc50 2024-04-21T22:53:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.982+0000 7f67e5ffb640 1 -- 172.21.15.110:0/2232749785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e000cd30 con 0x7f67f014bc50 2024-04-21T22:53:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.982+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f00b3c90 con 0x7f67f014bc50 2024-04-21T22:53:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.982+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f00b4210 con 0x7f67f014bc50 2024-04-21T22:53:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:58.986+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f00cbbd0 con 0x7f67f014bc50 2024-04-21T22:53:59.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.006+0000 7f67e5ffb640 1 -- 172.21.15.110:0/2232749785 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67e001a070 con 0x7f67f014bc50 2024-04-21T22:53:59.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.006+0000 7f67e5ffb640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67d40678f0 0x7f67d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.006+0000 7f67f5167640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67d40678f0 0x7f67d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.006+0000 7f67f5167640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67d40678f0 0x7f67d4069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0ab000 tx=0x7f67ec0a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:59.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.006+0000 7f67e5ffb640 1 -- 172.21.15.110:0/2232749785 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f67e0054910 con 0x7f67f014bc50 2024-04-21T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.278+0000 7f67e5ffb640 1 -- 172.21.15.110:0/2232749785 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f67e0056870 con 0x7f67f014bc50 2024-04-21T22:53:59.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.478+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f67f004f510 con 0x7f67f014bc50 2024-04-21T22:53:59.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.494+0000 7f67e5ffb640 1 -- 172.21.15.110:0/2232749785 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f67e005ab70 con 0x7f67f014bc50 2024-04-21T22:53:59.493 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:53:59.493 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-21T22:53:59.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.494+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67d40678f0 msgr2=0x7f67d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:59.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.494+0000 7f67f73cb640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67d40678f0 0x7f67d4069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0ab000 tx=0x7f67ec0a7070 comp rx=0 tx=0).stop 2024-04-21T22:53:59.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.494+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67f014bc50 msgr2=0x7f67f01f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:59.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.494+0000 7f67f73cb640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67f014bc50 0x7f67f01f3cd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67e000e8f0 tx=0x7f67e000edb0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 shutdown_connections 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f67d40678f0 0x7f67d4069db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f01f4210 0x7f67f01f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67f014bc50 0x7f67f01f3cd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 --2- 172.21.15.110:0/2232749785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f00cb2b0 0x7f67f00cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 >> 172.21.15.110:0/2232749785 conn(0x7f67f00b1640 msgr2=0x7f67f00c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 shutdown_connections 2024-04-21T22:53:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.498+0000 7f67f73cb640 1 -- 172.21.15.110:0/2232749785 wait complete. 2024-04-21T22:53:59.512 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-21T22:53:59.513 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:53:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.622+0000 7f7deabdc640 1 Processor -- start 2024-04-21T22:53:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.622+0000 7f7deabdc640 1 -- start start 2024-04-21T22:53:59.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7deabdc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7de4152180 0x7f7de40c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7deabdc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152560 0x7f7de4158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7deabdc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7de4072460 0x7f7de406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7deabdc640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7de41592e0 con 0x7f7de4072460 2024-04-21T22:53:59.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7deabdc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7de4070040 con 0x7f7de4152180 2024-04-21T22:53:59.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7deabdc640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7de40c6110 con 0x7f7de4152560 2024-04-21T22:53:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7de9179640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7de4072460 0x7f7de406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7de9179640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7de4072460 0x7f7de406fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42962/0 (socket says 172.21.15.110:42962) 2024-04-21T22:53:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7de9179640 1 -- 172.21.15.110:0/4213378439 learned_addr learned my addr 172.21.15.110:0/4213378439 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7de3fff640 1 --2- 172.21.15.110:0/4213378439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152560 0x7f7de4158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7de8978640 1 --2- 172.21.15.110:0/4213378439 >> v2:172.21.15.154:3300/0 conn(0x7f7de4152180 0x7f7de40c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.626+0000 7f7de9179640 1 -- 172.21.15.110:0/4213378439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152560 msgr2=0x7f7de4158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:59.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.630+0000 7f7de9179640 1 --2- 172.21.15.110:0/4213378439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152560 0x7f7de4158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.630+0000 7f7de9179640 1 -- 172.21.15.110:0/4213378439 >> v2:172.21.15.154:3300/0 conn(0x7f7de4152180 msgr2=0x7f7de40c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:53:59.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.630+0000 7f7de9179640 1 --2- 172.21.15.110:0/4213378439 >> v2:172.21.15.154:3300/0 conn(0x7f7de4152180 0x7f7de40c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.630+0000 7f7de9179640 1 -- 172.21.15.110:0/4213378439 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de40716c0 con 0x7f7de4072460 2024-04-21T22:53:59.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.634+0000 7f7de9179640 1 --2- 172.21.15.110:0/4213378439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de406fb00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7de4070270 tx=0x7f7ddc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0ff8223298d7f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:59.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.634+0000 7f7de37fe640 1 -- 172.21.15.110:0/4213378439 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0b4070 con 0x7f7de4072460 2024-04-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.634+0000 7f7de37fe640 1 -- 172.21.15.110:0/4213378439 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ddc0af400 con 0x7f7de4072460 2024-04-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.634+0000 7f7de37fe640 1 -- 172.21.15.110:0/4213378439 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0af7d0 con 0x7f7de4072460 2024-04-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- 172.21.15.110:0/4213378439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 msgr2=0x7f7de406fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 --2- 172.21.15.110:0/4213378439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de406fb00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7de4070270 tx=0x7f7ddc01f1e0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- 172.21.15.110:0/4213378439 shutdown_connections 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 --2- 172.21.15.110:0/4213378439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de406fb00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 --2- 172.21.15.110:0/4213378439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152560 0x7f7de4158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 --2- 172.21.15.110:0/4213378439 >> v2:172.21.15.154:3300/0 conn(0x7f7de4152180 0x7f7de40c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- 172.21.15.110:0/4213378439 >> 172.21.15.110:0/4213378439 conn(0x7f7de40cb710 msgr2=0x7f7de40cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- 172.21.15.110:0/4213378439 shutdown_connections 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- 172.21.15.110:0/4213378439 wait complete. 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 Processor -- start 2024-04-21T22:53:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- start start 2024-04-21T22:53:59.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de4149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152180 0x7f7de4144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de4152560 0x7f7de40ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4071980 con 0x7f7de4072460 2024-04-21T22:53:59.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7de40c66b0 con 0x7f7de4152560 2024-04-21T22:53:59.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7deabdc640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7de4071c60 con 0x7f7de4152180 2024-04-21T22:53:59.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7de8978640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de4149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7de8978640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de4149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42966/0 (socket says 172.21.15.110:42966) 2024-04-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7de8978640 1 -- 172.21.15.110:0/1853143713 learned_addr learned my addr 172.21.15.110:0/1853143713 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7de9179640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de4152560 0x7f7de40ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.638+0000 7f7de3fff640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152180 0x7f7de4144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.642+0000 7f7de8978640 1 -- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152180 msgr2=0x7f7de4144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.642+0000 7f7de8978640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152180 0x7f7de4144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.642+0000 7f7de8978640 1 -- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de4152560 msgr2=0x7f7de40ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:53:59.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.642+0000 7f7de8978640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de4152560 0x7f7de40ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:53:59.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.642+0000 7f7de8978640 1 -- 172.21.15.110:0/1853143713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de4146df0 con 0x7f7de4072460 2024-04-21T22:53:59.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.646+0000 7f7de8978640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de4149510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400d830 tx=0x7f7dd400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:59.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.650+0000 7f7de17fa640 1 -- 172.21.15.110:0/1853143713 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400b6c0 con 0x7f7de4072460 2024-04-21T22:53:59.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.650+0000 7f7de17fa640 1 -- 172.21.15.110:0/1853143713 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4019070 con 0x7f7de4072460 2024-04-21T22:53:59.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.650+0000 7f7de17fa640 1 -- 172.21.15.110:0/1853143713 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400ba60 con 0x7f7de4072460 2024-04-21T22:53:59.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.650+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de4149ba0 con 0x7f7de4072460 2024-04-21T22:53:59.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.650+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de41f37e0 con 0x7f7de4072460 2024-04-21T22:53:59.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.650+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de404f510 con 0x7f7de4072460 2024-04-21T22:53:59.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.666+0000 7f7de17fa640 1 -- 172.21.15.110:0/1853143713 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7dd401e460 con 0x7f7de4072460 2024-04-21T22:53:59.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.666+0000 7f7de17fa640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7dc40678f0 0x7f7dc4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:53:59.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.666+0000 7f7de3fff640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7dc40678f0 0x7f7dc4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:53:59.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.666+0000 7f7de3fff640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7dc40678f0 0x7f7dc4069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7de4068760 tx=0x7f7dcc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:53:59.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.670+0000 7f7de17fa640 1 -- 172.21.15.110:0/1853143713 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7dd4055250 con 0x7f7de4072460 2024-04-21T22:53:59.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:53:59.954+0000 7f7de17fa640 1 -- 172.21.15.110:0/1853143713 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f7dd40571b0 con 0x7f7de4072460 2024-04-21T22:54:00.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.122+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7de414f4e0 con 0x7f7de4072460 2024-04-21T22:54:00.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.230+0000 7f7de17fa640 1 -- 172.21.15.110:0/1853143713 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f7dd405b4b0 con 0x7f7de4072460 2024-04-21T22:54:00.230 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:54:00.230 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:54:00.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7dc40678f0 msgr2=0x7f7dc4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7dc40678f0 0x7f7dc4069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7de4068760 tx=0x7f7dcc008040 comp rx=0 tx=0).stop 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 msgr2=0x7f7de4149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de4149510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400d830 tx=0x7f7dd400dcf0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 shutdown_connections 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7dc40678f0 0x7f7dc4069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de4152560 0x7f7de40ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7de4152180 0x7f7de4144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 --2- 172.21.15.110:0/1853143713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7de4072460 0x7f7de4149510 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 >> 172.21.15.110:0/1853143713 conn(0x7f7de40cb710 msgr2=0x7f7de414fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 shutdown_connections 2024-04-21T22:54:00.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.234+0000 7f7deabdc640 1 -- 172.21.15.110:0/1853143713 wait complete. 2024-04-21T22:54:00.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:52:54.296733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:53:35.338548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:53:36.666246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:54:00.254 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:54:00.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe854c82640 1 Processor -- start 2024-04-21T22:54:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe854c82640 1 -- start start 2024-04-21T22:54:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe854c82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe8500ce570 0x7fe85006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe854c82640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8500cd9b0 con 0x7fe8500cf250 2024-04-21T22:54:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe854c82640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe85015a5d0 con 0x7fe85006c380 2024-04-21T22:54:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe854c82640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe85015a8b0 con 0x7fe8500ce570 2024-04-21T22:54:00.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe84ed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe8500ce570 0x7fe85006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:00.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe84dd9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe8500cf250 0x7fe8500cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45400/0 (socket says 172.21.15.110:45400) 2024-04-21T22:54:00.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.386+0000 7fe84dd9b640 1 -- 172.21.15.110:0/850423744 learned_addr learned my addr 172.21.15.110:0/850423744 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:00.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.390+0000 7fe84ed9d640 1 -- 172.21.15.110:0/850423744 >> v1:172.21.15.154:6789/0 conn(0x7fe85006c380 legacy=0x7fe8500ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.390+0000 7fe84ed9d640 1 -- 172.21.15.110:0/850423744 >> v1:172.21.15.110:6789/0 conn(0x7fe8500cf250 legacy=0x7fe8500cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.390+0000 7fe84ed9d640 1 -- 172.21.15.110:0/850423744 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85015ab90 con 0x7fe8500ce570 2024-04-21T22:54:00.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.398+0000 7fe84ed9d640 1 --2- 172.21.15.110:0/850423744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8500ce570 0x7fe85006c760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe848009d90 tx=0x7fe84801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a13483ea7c8632 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:00.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe84d59a640 1 -- 172.21.15.110:0/850423744 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8480b4070 con 0x7fe8500ce570 2024-04-21T22:54:00.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe84d59a640 1 -- 172.21.15.110:0/850423744 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8480af600 con 0x7fe8500ce570 2024-04-21T22:54:00.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe84d59a640 1 -- 172.21.15.110:0/850423744 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8480af9d0 con 0x7fe8500ce570 2024-04-21T22:54:00.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- 172.21.15.110:0/850423744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8500ce570 msgr2=0x7fe85006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 --2- 172.21.15.110:0/850423744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8500ce570 0x7fe85006c760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe848009d90 tx=0x7fe84801f150 comp rx=0 tx=0).stop 2024-04-21T22:54:00.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- 172.21.15.110:0/850423744 shutdown_connections 2024-04-21T22:54:00.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 --2- 172.21.15.110:0/850423744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8500ce570 0x7fe85006c760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- 172.21.15.110:0/850423744 >> 172.21.15.110:0/850423744 conn(0x7fe8500b1640 msgr2=0x7fe8500b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:00.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- 172.21.15.110:0/850423744 shutdown_connections 2024-04-21T22:54:00.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- 172.21.15.110:0/850423744 wait complete. 2024-04-21T22:54:00.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 Processor -- start 2024-04-21T22:54:00.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- start start 2024-04-21T22:54:00.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85006c380 0x7fe85015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:00.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8500ce570 0x7fe8501595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:00.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8500cf250 0x7fe8501f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:00.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe85015a2a0 con 0x7fe85006c380 2024-04-21T22:54:00.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8500cb130 con 0x7fe8500cf250 2024-04-21T22:54:00.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.402+0000 7fe854c82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe85015b150 con 0x7fe8500ce570 2024-04-21T22:54:00.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.406+0000 7fe84dd9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8500ce570 0x7fe8501595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:00.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.406+0000 7fe84e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85006c380 0x7fe85015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:00.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.406+0000 7fe84e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85006c380 0x7fe85015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42992/0 (socket says 172.21.15.110:42992) 2024-04-21T22:54:00.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.406+0000 7fe84e59c640 1 -- 172.21.15.110:0/2763765417 learned_addr learned my addr 172.21.15.110:0/2763765417 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:00.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.406+0000 7fe84ed9d640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8500cf250 0x7fe8501f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:00.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.410+0000 7fe84e59c640 1 -- 172.21.15.110:0/2763765417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8500ce570 msgr2=0x7fe8501595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.410+0000 7fe84e59c640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8500ce570 0x7fe8501595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.410+0000 7fe84e59c640 1 -- 172.21.15.110:0/2763765417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8500cf250 msgr2=0x7fe8501f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.410+0000 7fe84e59c640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8500cf250 0x7fe8501f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.410+0000 7fe84e59c640 1 -- 172.21.15.110:0/2763765417 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85015e420 con 0x7fe85006c380 2024-04-21T22:54:00.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.414+0000 7fe84e59c640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85006c380 0x7fe85015dee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe84000c370 tx=0x7fe84000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:00.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.418+0000 7fe83effd640 1 -- 172.21.15.110:0/2763765417 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8400052d0 con 0x7fe85006c380 2024-04-21T22:54:00.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.418+0000 7fe83effd640 1 -- 172.21.15.110:0/2763765417 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe840005470 con 0x7fe85006c380 2024-04-21T22:54:00.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.418+0000 7fe83effd640 1 -- 172.21.15.110:0/2763765417 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840007260 con 0x7fe85006c380 2024-04-21T22:54:00.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.418+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8501f1660 con 0x7fe85006c380 2024-04-21T22:54:00.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.418+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8501f1c20 con 0x7fe85006c380 2024-04-21T22:54:00.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.418+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85004f510 con 0x7fe85006c380 2024-04-21T22:54:00.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.438+0000 7fe83effd640 1 -- 172.21.15.110:0/2763765417 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe840007400 con 0x7fe85006c380 2024-04-21T22:54:00.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.438+0000 7fe83effd640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe830067940 0x7fe830069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:00.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.438+0000 7fe84dd9b640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe830067940 0x7fe830069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:00.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.438+0000 7fe84dd9b640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe830067940 0x7fe830069e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8500b1500 tx=0x7fe844009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:00.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.714+0000 7fe83effd640 1 -- 172.21.15.110:0/2763765417 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe840053a80 con 0x7fe85006c380 2024-04-21T22:54:00.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.714+0000 7fe83effd640 1 -- 172.21.15.110:0/2763765417 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fe8400559e0 con 0x7fe85006c380 2024-04-21T22:54:00.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.882+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe8500d0930 con 0x7fe85006c380 2024-04-21T22:54:00.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.922+0000 7fe83effd640 1 -- 172.21.15.110:0/2763765417 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fe840059ce0 con 0x7fe85006c380 2024-04-21T22:54:00.922 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-04-21T22:54:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe830067940 msgr2=0x7fe830069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe830067940 0x7fe830069e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8500b1500 tx=0x7fe844009040 comp rx=0 tx=0).stop 2024-04-21T22:54:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85006c380 msgr2=0x7fe85015dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85006c380 0x7fe85015dee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe84000c370 tx=0x7fe84000c830 comp rx=0 tx=0).stop 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 shutdown_connections 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe830067940 0x7fe830069e00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8500cf250 0x7fe8501f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8500ce570 0x7fe8501595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 --2- 172.21.15.110:0/2763765417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85006c380 0x7fe85015dee0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 >> 172.21.15.110:0/2763765417 conn(0x7fe8500b1640 msgr2=0x7fe85006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 shutdown_connections 2024-04-21T22:54:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:00.926+0000 7fe854c82640 1 -- 172.21.15.110:0/2763765417 wait complete. 2024-04-21T22:54:00.942 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:54:01.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.066+0000 7f16ab262640 1 Processor -- start 2024-04-21T22:54:01.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.070+0000 7f16ab262640 1 -- start start 2024-04-21T22:54:01.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.070+0000 7f16ab262640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16a4061ff0 0x7f16a406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.070+0000 7f16ab262640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16a406f390 0x7f16a40c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.070+0000 7f16ab262640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a4154930 con 0x7f16a4154550 2024-04-21T22:54:01.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.070+0000 7f16ab262640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f16a40c8020 con 0x7f16a4061ff0 2024-04-21T22:54:01.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.070+0000 7f16ab262640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f16a40c89f0 con 0x7f16a406f390 2024-04-21T22:54:01.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.106+0000 7f16a8ffe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f16a4154550 0x7f16a406de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45414/0 (socket says 172.21.15.110:45414) 2024-04-21T22:54:01.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.106+0000 7f16a8ffe640 1 -- 172.21.15.110:0/2400714549 learned_addr learned my addr 172.21.15.110:0/2400714549 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:01.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.106+0000 7f16a3fff640 1 --2- 172.21.15.110:0/2400714549 >> v2:172.21.15.110:3300/0 conn(0x7f16a4061ff0 0x7f16a406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.114+0000 7f16a3fff640 1 -- 172.21.15.110:0/2400714549 >> v2:172.21.15.154:3300/0 conn(0x7f16a406f390 msgr2=0x7f16a40c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:01.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.114+0000 7f16a3fff640 1 --2- 172.21.15.110:0/2400714549 >> v2:172.21.15.154:3300/0 conn(0x7f16a406f390 0x7f16a40c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.114+0000 7f16a3fff640 1 -- 172.21.15.110:0/2400714549 >> v1:172.21.15.110:6789/0 conn(0x7f16a4154550 legacy=0x7f16a406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.114+0000 7f16a3fff640 1 -- 172.21.15.110:0/2400714549 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a415ae30 con 0x7f16a4061ff0 2024-04-21T22:54:01.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.126+0000 7f16a3fff640 1 --2- 172.21.15.110:0/2400714549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a4061ff0 0x7f16a406b1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16a406d770 tx=0x7f169001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4454871501c6f89 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:01.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16a37fe640 1 -- 172.21.15.110:0/2400714549 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b5070 con 0x7f16a4061ff0 2024-04-21T22:54:01.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16a37fe640 1 -- 172.21.15.110:0/2400714549 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900a8970 con 0x7f16a4061ff0 2024-04-21T22:54:01.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16a37fe640 1 -- 172.21.15.110:0/2400714549 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900a8d40 con 0x7f16a4061ff0 2024-04-21T22:54:01.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 -- 172.21.15.110:0/2400714549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a4061ff0 msgr2=0x7f16a406b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 --2- 172.21.15.110:0/2400714549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a4061ff0 0x7f16a406b1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16a406d770 tx=0x7f169001ec70 comp rx=0 tx=0).stop 2024-04-21T22:54:01.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 -- 172.21.15.110:0/2400714549 shutdown_connections 2024-04-21T22:54:01.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 --2- 172.21.15.110:0/2400714549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a4061ff0 0x7f16a406b1e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 --2- 172.21.15.110:0/2400714549 >> v2:172.21.15.154:3300/0 conn(0x7f16a406f390 0x7f16a40c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 -- 172.21.15.110:0/2400714549 >> 172.21.15.110:0/2400714549 conn(0x7f16a40cc250 msgr2=0x7f16a40cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:01.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 -- 172.21.15.110:0/2400714549 shutdown_connections 2024-04-21T22:54:01.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.142+0000 7f16ab262640 1 -- 172.21.15.110:0/2400714549 wait complete. 2024-04-21T22:54:01.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 Processor -- start 2024-04-21T22:54:01.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 -- start start 2024-04-21T22:54:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a4061ff0 0x7f16a40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a406f390 0x7f16a406e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a4154550 0x7f16a40ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40c79d0 con 0x7f16a406f390 2024-04-21T22:54:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40c76f0 con 0x7f16a4154550 2024-04-21T22:54:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.146+0000 7f16ab262640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f16a40c7cb0 con 0x7f16a4061ff0 2024-04-21T22:54:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.150+0000 7f16a3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a406f390 0x7f16a406e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.150+0000 7f16a3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a406f390 0x7f16a406e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43008/0 (socket says 172.21.15.110:43008) 2024-04-21T22:54:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.150+0000 7f16a3fff640 1 -- 172.21.15.110:0/1635989450 learned_addr learned my addr 172.21.15.110:0/1635989450 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.150+0000 7f16a97ff640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a4154550 0x7f16a40ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.150+0000 7f16a8ffe640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a4061ff0 0x7f16a40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.154+0000 7f16a3fff640 1 -- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a4061ff0 msgr2=0x7f16a40cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.154+0000 7f16a3fff640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a4061ff0 0x7f16a40cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.154+0000 7f16a3fff640 1 -- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a4154550 msgr2=0x7f16a40ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.154+0000 7f16a3fff640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a4154550 0x7f16a40ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.154+0000 7f16a3fff640 1 -- 172.21.15.110:0/1635989450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a41f3b70 con 0x7f16a406f390 2024-04-21T22:54:01.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.154+0000 7f16a3fff640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a406f390 0x7f16a406e0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f169001b880 tx=0x7f169001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.158+0000 7f16a17fa640 1 -- 172.21.15.110:0/1635989450 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900bf070 con 0x7f16a406f390 2024-04-21T22:54:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.158+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a41f3e50 con 0x7f16a406f390 2024-04-21T22:54:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.158+0000 7f16a17fa640 1 -- 172.21.15.110:0/1635989450 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900b0900 con 0x7f16a406f390 2024-04-21T22:54:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.158+0000 7f16a17fa640 1 -- 172.21.15.110:0/1635989450 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b5040 con 0x7f16a406f390 2024-04-21T22:54:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.158+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a41f4410 con 0x7f16a406f390 2024-04-21T22:54:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.158+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a404f510 con 0x7f16a406f390 2024-04-21T22:54:01.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.442+0000 7f16a17fa640 1 -- 172.21.15.110:0/1635989450 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16900c2070 con 0x7f16a406f390 2024-04-21T22:54:01.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.442+0000 7f16a17fa640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1688067940 0x7f1688069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.442+0000 7f16a8ffe640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1688067940 0x7f1688069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.442+0000 7f16a8ffe640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1688067940 0x7f1688069e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1698000f70 tx=0x7f1698007e90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.470+0000 7f16a17fa640 1 -- 172.21.15.110:0/1635989450 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f16900f0f40 con 0x7f16a406f390 2024-04-21T22:54:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.470+0000 7f16a17fa640 1 -- 172.21.15.110:0/1635989450 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f16900c9080 con 0x7f16a406f390 2024-04-21T22:54:01.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.650+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f16a406f180 con 0x7f16a406f390 2024-04-21T22:54:01.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16a17fa640 1 -- 172.21.15.110:0/1635989450 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f16900187d0 con 0x7f16a406f390 2024-04-21T22:54:01.663 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1688067940 msgr2=0x7f1688069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1688067940 0x7f1688069e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1698000f70 tx=0x7f1698007e90 comp rx=0 tx=0).stop 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a406f390 msgr2=0x7f16a406e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a406f390 0x7f16a406e0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f169001b880 tx=0x7f169001ba10 comp rx=0 tx=0).stop 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 shutdown_connections 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1688067940 0x7f1688069e00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a4154550 0x7f16a40ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a406f390 0x7f16a406e0d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 --2- 172.21.15.110:0/1635989450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a4061ff0 0x7f16a40cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 >> 172.21.15.110:0/1635989450 conn(0x7f16a40cc250 msgr2=0x7f16a415a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:01.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 shutdown_connections 2024-04-21T22:54:01.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.666+0000 7f16ab262640 1 -- 172.21.15.110:0/1635989450 wait complete. 2024-04-21T22:54:01.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f254ddb4640 1 Processor -- start 2024-04-21T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f254ddb4640 1 -- start start 2024-04-21T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f254ddb4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2548151200 0x7f25480c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f254ddb4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2548071980 0x7f25480c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f254ddb4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2548071770 con 0x7f25481515e0 2024-04-21T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f254ddb4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2548157420 con 0x7f2548151200 2024-04-21T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f254ddb4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2548072b50 con 0x7f2548071980 2024-04-21T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.806+0000 7f2546ffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f25481515e0 0x7f25481578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45420/0 (socket says 172.21.15.110:45420) 2024-04-21T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.810+0000 7f2546ffd640 1 -- 172.21.15.110:0/183885037 learned_addr learned my addr 172.21.15.110:0/183885037 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.810+0000 7f2547fff640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2548071980 0x7f25480c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.810+0000 7f25477fe640 1 --2- 172.21.15.110:0/183885037 >> v2:172.21.15.154:3300/0 conn(0x7f2548151200 0x7f25480c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.810+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342031090 0 0) 0x7f2548071770 con 0x7f25481515e0 2024-04-21T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.810+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f252c003530 con 0x7f25481515e0 2024-04-21T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 899996153 0 0) 0x7f252c003530 con 0x7f25481515e0 2024-04-21T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2548071980 msgr2=0x7f25480c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2548071980 0x7f25480c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 >> v2:172.21.15.154:3300/0 conn(0x7f2548151200 msgr2=0x7f25480c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 --2- 172.21.15.110:0/183885037 >> v2:172.21.15.154:3300/0 conn(0x7f2548151200 0x7f25480c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25480c7f40 con 0x7f25481515e0 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f2534001680 con 0x7f25481515e0 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 >> v1:172.21.15.110:6789/0 conn(0x7f25481515e0 legacy=0x7f25481578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c0039c0 0x7f252c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c004810 0x7f252c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2548071980 0x7f252c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2548157420 con 0x7f252c0039c0 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2548072b50 con 0x7f252c004810 2024-04-21T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.814+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f252c00b9d0 con 0x7f2548071980 2024-04-21T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.818+0000 7f25477fe640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c0039c0 0x7f252c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.818+0000 7f25477fe640 1 -- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2548071980 msgr2=0x7f252c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.818+0000 7f25477fe640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2548071980 0x7f252c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.818+0000 7f25477fe640 1 -- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c004810 msgr2=0x7f252c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.818+0000 7f25477fe640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c004810 0x7f252c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.818+0000 7f25477fe640 1 -- 172.21.15.110:0/183885037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c003530 con 0x7f252c0039c0 2024-04-21T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.822+0000 7f25477fe640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c0039c0 0x7f252c003de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2538009ae0 tx=0x7f253801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742bb20770bd0c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25380096b0 con 0x7f252c0039c0 2024-04-21T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25380a8410 con 0x7f252c0039c0 2024-04-21T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f25467fc640 1 -- 172.21.15.110:0/183885037 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25380a8840 con 0x7f252c0039c0 2024-04-21T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f254ddb4640 1 -- 172.21.15.110:0/183885037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c0039c0 msgr2=0x7f252c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f254ddb4640 1 --2- 172.21.15.110:0/183885037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c0039c0 0x7f252c003de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2538009ae0 tx=0x7f253801ca50 comp rx=0 tx=0).stop 2024-04-21T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f2547fff640 1 -- 172.21.15.110:0/183885037 reap_dead start 2024-04-21T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f254ddb4640 1 -- 172.21.15.110:0/183885037 shutdown_connections 2024-04-21T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f254ddb4640 1 -- 172.21.15.110:0/183885037 >> 172.21.15.110:0/183885037 conn(0x7f25480cb710 msgr2=0x7f25480cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f254ddb4640 1 -- 172.21.15.110:0/183885037 shutdown_connections 2024-04-21T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.826+0000 7f254ddb4640 1 -- 172.21.15.110:0/183885037 wait complete. 2024-04-21T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 Processor -- start 2024-04-21T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 -- start start 2024-04-21T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2548156700 0x7f25481583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254815af20 0x7f2548156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2548158d80 0x7f2548159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2548158140 con 0x7f2548158d80 2024-04-21T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2548157fc0 con 0x7f2548156700 2024-04-21T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f254ddb4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2548161b70 con 0x7f254815af20 2024-04-21T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f2547fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2548158d80 0x7f2548159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f2547fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2548158d80 0x7f2548159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43022/0 (socket says 172.21.15.110:43022) 2024-04-21T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f2547fff640 1 -- 172.21.15.110:0/778279517 learned_addr learned my addr 172.21.15.110:0/778279517 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.830+0000 7f2546ffd640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254815af20 0x7f2548156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.834+0000 7f25477fe640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2548156700 0x7f25481583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.834+0000 7f2547fff640 1 -- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254815af20 msgr2=0x7f2548156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.834+0000 7f2547fff640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254815af20 0x7f2548156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.834+0000 7f2547fff640 1 -- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2548156700 msgr2=0x7f25481583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.834+0000 7f2547fff640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2548156700 0x7f25481583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.834+0000 7f2547fff640 1 -- 172.21.15.110:0/778279517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25481553f0 con 0x7f2548158d80 2024-04-21T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.834+0000 7f2547fff640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2548158d80 0x7f2548159200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f254000ede0 tx=0x7f254000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.838+0000 7f253ffff640 1 -- 172.21.15.110:0/778279517 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254000bcb0 con 0x7f2548158d80 2024-04-21T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.838+0000 7f253ffff640 1 -- 172.21.15.110:0/778279517 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254001a070 con 0x7f2548158d80 2024-04-21T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.838+0000 7f253ffff640 1 -- 172.21.15.110:0/778279517 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540014640 con 0x7f2548158d80 2024-04-21T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.838+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25481f1e10 con 0x7f2548158d80 2024-04-21T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.838+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2548155970 con 0x7f2548158d80 2024-04-21T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:01.842+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254804f510 con 0x7f2548158d80 2024-04-21T22:54:02.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.110+0000 7f253ffff640 1 -- 172.21.15.110:0/778279517 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2540013070 con 0x7f2548158d80 2024-04-21T22:54:02.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.110+0000 7f253ffff640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2530067940 0x7f2530069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:02.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.110+0000 7f25477fe640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2530067940 0x7f2530069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:02.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.110+0000 7f25477fe640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2530067940 0x7f2530069e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f25380af000 tx=0x7f2538008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:02.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.142+0000 7f253ffff640 1 -- 172.21.15.110:0/778279517 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2540054d00 con 0x7f2548158d80 2024-04-21T22:54:02.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.142+0000 7f253ffff640 1 -- 172.21.15.110:0/778279517 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2540057360 con 0x7f2548158d80 2024-04-21T22:54:02.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.318+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f254815abd0 con 0x7f2548158d80 2024-04-21T22:54:02.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.334+0000 7f253ffff640 1 -- 172.21.15.110:0/778279517 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f2540056c60 con 0x7f2548158d80 2024-04-21T22:54:02.334 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-04-21T22:54:02.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2530067940 msgr2=0x7f2530069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2530067940 0x7f2530069e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f25380af000 tx=0x7f2538008040 comp rx=0 tx=0).stop 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2548158d80 msgr2=0x7f2548159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2548158d80 0x7f2548159200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f254000ede0 tx=0x7f254000b480 comp rx=0 tx=0).stop 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 shutdown_connections 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2530067940 0x7f2530069e00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2548158d80 0x7f2548159200 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254815af20 0x7f2548156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 --2- 172.21.15.110:0/778279517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2548156700 0x7f25481583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 >> 172.21.15.110:0/778279517 conn(0x7f25480cb710 msgr2=0x7f25480c4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:02.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 shutdown_connections 2024-04-21T22:54:02.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.338+0000 7f254ddb4640 1 -- 172.21.15.110:0/778279517 wait complete. 2024-04-21T22:54:02.354 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:54:02.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c77ef640 1 Processor -- start 2024-04-21T22:54:02.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c77ef640 1 -- start start 2024-04-21T22:54:02.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c77ef640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c00c75e0 0x7f18c00c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:02.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c77ef640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18c00c3410 0x7f18c00c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:02.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c77ef640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c0157e50 con 0x7f18c014dad0 2024-04-21T22:54:02.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c77ef640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00727a0 con 0x7f18c00c3410 2024-04-21T22:54:02.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c77ef640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f18c0156f60 con 0x7f18c00c75e0 2024-04-21T22:54:02.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c4d8a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c00c75e0 0x7f18c00c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:02.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c5d8c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18c00c3410 0x7f18c00c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:02.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c5d8c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18c00c3410 0x7f18c00c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:52144/0 (socket says 172.21.15.110:52144) 2024-04-21T22:54:02.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.478+0000 7f18c5d8c640 1 -- 172.21.15.110:0/1016015546 learned_addr learned my addr 172.21.15.110:0/1016015546 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.482+0000 7f18c4d8a640 1 -- 172.21.15.110:0/1016015546 >> v2:172.21.15.154:3300/0 conn(0x7f18c00c3410 msgr2=0x7f18c00c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:02.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.482+0000 7f18c4d8a640 1 --2- 172.21.15.110:0/1016015546 >> v2:172.21.15.154:3300/0 conn(0x7f18c00c3410 0x7f18c00c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.482+0000 7f18c4d8a640 1 -- 172.21.15.110:0/1016015546 >> v1:172.21.15.154:6789/0 conn(0x7f18c014dad0 legacy=0x7f18c0157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:02.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.482+0000 7f18c4d8a640 1 -- 172.21.15.110:0/1016015546 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c0073700 con 0x7f18c00c75e0 2024-04-21T22:54:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.486+0000 7f18c4d8a640 1 --2- 172.21.15.110:0/1016015546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c00c75e0 0x7f18c00c1b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f18c0072920 tx=0x7f18b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac904563b53f20b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:02.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18b7fff640 1 -- 172.21.15.110:0/1016015546 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b0070 con 0x7f18c00c75e0 2024-04-21T22:54:02.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18b7fff640 1 -- 172.21.15.110:0/1016015546 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00ab600 con 0x7f18c00c75e0 2024-04-21T22:54:02.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18b7fff640 1 -- 172.21.15.110:0/1016015546 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00ab9d0 con 0x7f18c00c75e0 2024-04-21T22:54:02.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- 172.21.15.110:0/1016015546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c00c75e0 msgr2=0x7f18c00c1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:02.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 --2- 172.21.15.110:0/1016015546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c00c75e0 0x7f18c00c1b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f18c0072920 tx=0x7f18b001c4a0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- 172.21.15.110:0/1016015546 shutdown_connections 2024-04-21T22:54:02.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 --2- 172.21.15.110:0/1016015546 >> v2:172.21.15.154:3300/0 conn(0x7f18c00c3410 0x7f18c00c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 --2- 172.21.15.110:0/1016015546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c00c75e0 0x7f18c00c1b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- 172.21.15.110:0/1016015546 >> 172.21.15.110:0/1016015546 conn(0x7f18c006e5c0 msgr2=0x7f18c006e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:02.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- 172.21.15.110:0/1016015546 shutdown_connections 2024-04-21T22:54:02.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- 172.21.15.110:0/1016015546 wait complete. 2024-04-21T22:54:02.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 Processor -- start 2024-04-21T22:54:02.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- start start 2024-04-21T22:54:02.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c00c3410 0x7f18c0148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:02.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c00c75e0 0x7f18c01438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:02.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c014dad0 0x7f18c01f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:02.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00732c0 con 0x7f18c00c75e0 2024-04-21T22:54:02.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00ca4e0 con 0x7f18c00c3410 2024-04-21T22:54:02.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c77ef640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f18c0073440 con 0x7f18c014dad0 2024-04-21T22:54:02.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c4d8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c00c75e0 0x7f18c01438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:02.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.494+0000 7f18c4d8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c00c75e0 0x7f18c01438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43034/0 (socket says 172.21.15.110:43034) 2024-04-21T22:54:02.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c4d8a640 1 -- 172.21.15.110:0/3176733821 learned_addr learned my addr 172.21.15.110:0/3176733821 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:02.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c5d8c640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c014dad0 0x7f18c01f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:02.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c558b640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c00c3410 0x7f18c0148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:02.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c4d8a640 1 -- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c014dad0 msgr2=0x7f18c01f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:02.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c4d8a640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c014dad0 0x7f18c01f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c4d8a640 1 -- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c00c3410 msgr2=0x7f18c0148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:02.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c4d8a640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c00c3410 0x7f18c0148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:02.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.498+0000 7f18c4d8a640 1 -- 172.21.15.110:0/3176733821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c0150030 con 0x7f18c00c75e0 2024-04-21T22:54:02.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.502+0000 7f18c4d8a640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c00c75e0 0x7f18c01438c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f18b001ab50 tx=0x7f18b0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:02.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.506+0000 7f18b5ffb640 1 -- 172.21.15.110:0/3176733821 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b0040 con 0x7f18c00c75e0 2024-04-21T22:54:02.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.506+0000 7f18b5ffb640 1 -- 172.21.15.110:0/3176733821 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00b9070 con 0x7f18c00c75e0 2024-04-21T22:54:02.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.506+0000 7f18b5ffb640 1 -- 172.21.15.110:0/3176733821 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b4650 con 0x7f18c00c75e0 2024-04-21T22:54:02.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.506+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c00cc1d0 con 0x7f18c00c75e0 2024-04-21T22:54:02.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.506+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c00cc790 con 0x7f18c00c75e0 2024-04-21T22:54:02.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.506+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c004f510 con 0x7f18c00c75e0 2024-04-21T22:54:02.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.526+0000 7f18b5ffb640 1 -- 172.21.15.110:0/3176733821 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18b00b47f0 con 0x7f18c00c75e0 2024-04-21T22:54:02.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.526+0000 7f18b5ffb640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f18a40678c0 0x7f18a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:02.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.526+0000 7f18c558b640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f18a40678c0 0x7f18a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:02.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.526+0000 7f18c558b640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f18a40678c0 0x7f18a4069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18bc001770 tx=0x7f18bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:02.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.530+0000 7f18b5ffb640 1 -- 172.21.15.110:0/3176733821 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f18b00ee9f0 con 0x7f18c00c75e0 2024-04-21T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:02.814+0000 7f18b5ffb640 1 -- 172.21.15.110:0/3176733821 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f18b0016090 con 0x7f18c00c75e0 2024-04-21T22:54:03.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.018+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18c0156d40 con 0x7f18c00c75e0 2024-04-21T22:54:03.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18b5ffb640 1 -- 172.21.15.110:0/3176733821 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6842 (secure 0 0 0) 0x7f18b00f0950 con 0x7f18c00c75e0 2024-04-21T22:54:03.036 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:54:03.036 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3272126146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3272126146},{"type":"v1","addr":"172.21.15.154:6835","nonce":3272126146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1335792720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1335792720},{"type":"v1","addr":"172.21.15.110:6839","nonce":1335792720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1521497243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1521497243},{"type":"v1","addr":"172.21.15.154:6833","nonce":1521497243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1669982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1669982495},{"type":"v1","addr":"172.21.15.154:6837","nonce":1669982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T22:53:38.095934+0000","modified":"2024-04-21T22:53:44.722732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/1034856927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1034856927},{"type":"v1","addr":"172.21.15.110:6837","nonce":1034856927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-21T22:54:03.036 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2024-04-21T22:54:03.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f18a40678c0 msgr2=0x7f18a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f18a40678c0 0x7f18a4069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18bc001770 tx=0x7f18bc009040 comp rx=0 tx=0).stop 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c00c75e0 msgr2=0x7f18c01438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c00c75e0 0x7f18c01438c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f18b001ab50 tx=0x7f18b0019240 comp rx=0 tx=0).stop 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 shutdown_connections 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f18a40678c0 0x7f18a4069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c014dad0 0x7f18c01f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c00c75e0 0x7f18c01438c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 --2- 172.21.15.110:0/3176733821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c00c3410 0x7f18c0148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 >> 172.21.15.110:0/3176733821 conn(0x7f18c006e5c0 msgr2=0x7f18c01554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 shutdown_connections 2024-04-21T22:54:03.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.038+0000 7f18c77ef640 1 -- 172.21.15.110:0/3176733821 wait complete. 2024-04-21T22:54:03.055 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:54:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.174+0000 7f5d05565640 1 Processor -- start 2024-04-21T22:54:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.174+0000 7f5d05565640 1 -- start start 2024-04-21T22:54:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5d05565640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d00158170 0x7f5d00151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5d05565640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d00152480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5d05565640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d00159140 con 0x7f5d00071640 2024-04-21T22:54:03.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5d05565640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5d00158640 con 0x7f5d00158170 2024-04-21T22:54:03.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5d05565640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5d001588e0 con 0x7f5d00071a20 2024-04-21T22:54:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5cfe7fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d00158170 0x7f5d00151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5cfe7fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d00158170 0x7f5d00151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43046/0 (socket says 172.21.15.110:43046) 2024-04-21T22:54:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5cfe7fc640 1 -- 172.21.15.110:0/1357757100 learned_addr learned my addr 172.21.15.110:0/1357757100 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.178+0000 7f5cff7fe640 1 --2- 172.21.15.110:0/1357757100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d00152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.182+0000 7f5cfe7fc640 1 -- 172.21.15.110:0/1357757100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 msgr2=0x7f5d00152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.182+0000 7f5cfe7fc640 1 --2- 172.21.15.110:0/1357757100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d00152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.182+0000 7f5cfe7fc640 1 -- 172.21.15.110:0/1357757100 >> v1:172.21.15.154:6789/0 conn(0x7f5d00071640 legacy=0x7f5d0015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.182+0000 7f5cfe7fc640 1 -- 172.21.15.110:0/1357757100 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000c2cf0 con 0x7f5d00158170 2024-04-21T22:54:03.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.186+0000 7f5cfe7fc640 1 --2- 172.21.15.110:0/1357757100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00158170 0x7f5d00151f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009870 tx=0x7f5cf401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e17d68ec5e6634 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5cfdffb640 1 -- 172.21.15.110:0/1357757100 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40aa600 con 0x7f5d00158170 2024-04-21T22:54:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5cfdffb640 1 -- 172.21.15.110:0/1357757100 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40af070 con 0x7f5d00158170 2024-04-21T22:54:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5cfdffb640 1 -- 172.21.15.110:0/1357757100 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40aa9c0 con 0x7f5d00158170 2024-04-21T22:54:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 -- 172.21.15.110:0/1357757100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00158170 msgr2=0x7f5d00151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 --2- 172.21.15.110:0/1357757100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00158170 0x7f5d00151f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009870 tx=0x7f5cf401c4a0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 -- 172.21.15.110:0/1357757100 shutdown_connections 2024-04-21T22:54:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 --2- 172.21.15.110:0/1357757100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d00152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 --2- 172.21.15.110:0/1357757100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00158170 0x7f5d00151f40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 -- 172.21.15.110:0/1357757100 >> 172.21.15.110:0/1357757100 conn(0x7f5d0006fc90 msgr2=0x7f5d00070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 -- 172.21.15.110:0/1357757100 shutdown_connections 2024-04-21T22:54:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 -- 172.21.15.110:0/1357757100 wait complete. 2024-04-21T22:54:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 Processor -- start 2024-04-21T22:54:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.190+0000 7f5d05565640 1 -- start start 2024-04-21T22:54:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5d05565640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00071640 0x7f5d000c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5d05565640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d000c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5d05565640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d00158170 0x7f5d000c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5d05565640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5d00164e90 con 0x7f5d00071640 2024-04-21T22:54:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5d05565640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d00164d10 con 0x7f5d00158170 2024-04-21T22:54:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5d05565640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5d00165010 con 0x7f5d00071a20 2024-04-21T22:54:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5cfeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00071640 0x7f5d000c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5cfeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00071640 0x7f5d000c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43052/0 (socket says 172.21.15.110:43052) 2024-04-21T22:54:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5cfeffd640 1 -- 172.21.15.110:0/3070084367 learned_addr learned my addr 172.21.15.110:0/3070084367 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5cff7fe640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d00158170 0x7f5d000c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.194+0000 7f5cfe7fc640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d000c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.198+0000 7f5cfeffd640 1 -- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 msgr2=0x7f5d000c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.198+0000 7f5cfeffd640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d000c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.198+0000 7f5cfeffd640 1 -- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d00158170 msgr2=0x7f5d000c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.198+0000 7f5cfeffd640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d00158170 0x7f5d000c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.198+0000 7f5cfeffd640 1 -- 172.21.15.110:0/3070084367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000c7d00 con 0x7f5d00071640 2024-04-21T22:54:03.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.202+0000 7f5cfeffd640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00071640 0x7f5d000c6ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c3a0 tx=0x7f5cf000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:03.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.206+0000 7f5ce77fe640 1 -- 172.21.15.110:0/3070084367 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00052d0 con 0x7f5d00071640 2024-04-21T22:54:03.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.206+0000 7f5ce77fe640 1 -- 172.21.15.110:0/3070084367 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0005470 con 0x7f5d00071640 2024-04-21T22:54:03.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.206+0000 7f5ce77fe640 1 -- 172.21.15.110:0/3070084367 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0007260 con 0x7f5d00071640 2024-04-21T22:54:03.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.206+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d001f4930 con 0x7f5d00071640 2024-04-21T22:54:03.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.206+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d001f4ef0 con 0x7f5d00071640 2024-04-21T22:54:03.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.206+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0004f510 con 0x7f5d00071640 2024-04-21T22:54:03.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.478+0000 7f5ce77fe640 1 -- 172.21.15.110:0/3070084367 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5cf0007400 con 0x7f5d00071640 2024-04-21T22:54:03.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.478+0000 7f5ce77fe640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5cec067910 0x7f5cec069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.478+0000 7f5cfe7fc640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5cec067910 0x7f5cec069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.478+0000 7f5cfe7fc640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5cec067910 0x7f5cec069dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40ae000 tx=0x7f5cf40a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:03.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.498+0000 7f5ce77fe640 1 -- 172.21.15.110:0/3070084367 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf0053ac0 con 0x7f5d00071640 2024-04-21T22:54:03.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.498+0000 7f5ce77fe640 1 -- 172.21.15.110:0/3070084367 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f5cf0055a20 con 0x7f5d00071640 2024-04-21T22:54:03.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.670+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d000cb470 con 0x7f5d00071640 2024-04-21T22:54:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.822+0000 7f5ce77fe640 1 -- 172.21.15.110:0/3070084367 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f5cf0059d20 con 0x7f5d00071640 2024-04-21T22:54:03.823 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:54:03.823 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:54:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5cec067910 msgr2=0x7f5cec069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5cec067910 0x7f5cec069dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40ae000 tx=0x7f5cf40a7000 comp rx=0 tx=0).stop 2024-04-21T22:54:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00071640 msgr2=0x7f5d000c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00071640 0x7f5d000c6ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c3a0 tx=0x7f5cf000c860 comp rx=0 tx=0).stop 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 shutdown_connections 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5cec067910 0x7f5cec069dd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d00158170 0x7f5d000c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d00071a20 0x7f5d000c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 --2- 172.21.15.110:0/3070084367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d00071640 0x7f5d000c6ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 >> 172.21.15.110:0/3070084367 conn(0x7f5d0006fc90 msgr2=0x7f5d00159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 shutdown_connections 2024-04-21T22:54:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.826+0000 7f5d05565640 1 -- 172.21.15.110:0/3070084367 wait complete. 2024-04-21T22:54:03.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:52:54.296733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:53:35.338548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:53:36.666246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:54:03.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:54:03.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc312d96640 1 Processor -- start 2024-04-21T22:54:03.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc312d96640 1 -- start start 2024-04-21T22:54:03.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc312d96640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc30c0c9f30 0x7fc30c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc312d96640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30c0ca590 con 0x7fc30c1523e0 2024-04-21T22:54:03.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc312d96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30c0ca830 con 0x7fc30c0c2d50 2024-04-21T22:54:03.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc312d96640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc30c0c9720 con 0x7fc30c0c9f30 2024-04-21T22:54:03.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc311333640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc30c0c9f30 0x7fc30c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc310b32640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc30c1523e0 0x7fc30c070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45426/0 (socket says 172.21.15.110:45426) 2024-04-21T22:54:03.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.970+0000 7fc310b32640 1 -- 172.21.15.110:0/1831783242 learned_addr learned my addr 172.21.15.110:0/1831783242 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:03.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.974+0000 7fc311333640 1 -- 172.21.15.110:0/1831783242 >> v1:172.21.15.154:6789/0 conn(0x7fc30c0c2d50 legacy=0x7fc30c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:03.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.974+0000 7fc311333640 1 -- 172.21.15.110:0/1831783242 >> v1:172.21.15.110:6789/0 conn(0x7fc30c1523e0 legacy=0x7fc30c070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.974+0000 7fc311333640 1 -- 172.21.15.110:0/1831783242 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c0caaf0 con 0x7fc30c0c9f30 2024-04-21T22:54:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.982+0000 7fc311333640 1 --2- 172.21.15.110:0/1831783242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c0c9f30 0x7fc30c158b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc304009d90 tx=0x7fc30401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69505ad60fb77821 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:03.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc30b7fe640 1 -- 172.21.15.110:0/1831783242 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3040b2070 con 0x7fc30c0c9f30 2024-04-21T22:54:03.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc30b7fe640 1 -- 172.21.15.110:0/1831783242 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3040a57f0 con 0x7fc30c0c9f30 2024-04-21T22:54:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc30b7fe640 1 -- 172.21.15.110:0/1831783242 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3040a5bc0 con 0x7fc30c0c9f30 2024-04-21T22:54:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 -- 172.21.15.110:0/1831783242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c0c9f30 msgr2=0x7fc30c158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 --2- 172.21.15.110:0/1831783242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c0c9f30 0x7fc30c158b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc304009d90 tx=0x7fc30401c930 comp rx=0 tx=0).stop 2024-04-21T22:54:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 -- 172.21.15.110:0/1831783242 shutdown_connections 2024-04-21T22:54:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 --2- 172.21.15.110:0/1831783242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c0c9f30 0x7fc30c158b60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 -- 172.21.15.110:0/1831783242 >> 172.21.15.110:0/1831783242 conn(0x7fc30c0714f0 msgr2=0x7fc30c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 -- 172.21.15.110:0/1831783242 shutdown_connections 2024-04-21T22:54:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 -- 172.21.15.110:0/1831783242 wait complete. 2024-04-21T22:54:03.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.986+0000 7fc312d96640 1 Processor -- start 2024-04-21T22:54:03.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc312d96640 1 -- start start 2024-04-21T22:54:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc312d96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc30c0c2d50 0x7fc30c140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc312d96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc30c0c9f30 0x7fc30c1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc312d96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c1523e0 0x7fc30c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc312d96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0c8da0 con 0x7fc30c1523e0 2024-04-21T22:54:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc312d96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c06fe10 con 0x7fc30c0c2d50 2024-04-21T22:54:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc312d96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c0c8f20 con 0x7fc30c0c9f30 2024-04-21T22:54:03.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc311333640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c1523e0 0x7fc30c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:03.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc311333640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c1523e0 0x7fc30c13d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43064/0 (socket says 172.21.15.110:43064) 2024-04-21T22:54:03.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.990+0000 7fc311333640 1 -- 172.21.15.110:0/2977998188 learned_addr learned my addr 172.21.15.110:0/2977998188 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:03.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.994+0000 7fc311333640 1 -- 172.21.15.110:0/2977998188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc30c0c9f30 msgr2=0x7fc30c1406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.994+0000 7fc311333640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc30c0c9f30 0x7fc30c1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.994+0000 7fc311333640 1 -- 172.21.15.110:0/2977998188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc30c0c2d50 msgr2=0x7fc30c140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:03.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.994+0000 7fc311333640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc30c0c2d50 0x7fc30c140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:03.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.994+0000 7fc311333640 1 -- 172.21.15.110:0/2977998188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c14ada0 con 0x7fc30c1523e0 2024-04-21T22:54:03.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:03.998+0000 7fc311333640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c1523e0 0x7fc30c13d2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc30401a560 tx=0x7fc3040196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:04.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.002+0000 7fc3097fa640 1 -- 172.21.15.110:0/2977998188 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3040b2050 con 0x7fc30c1523e0 2024-04-21T22:54:04.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.002+0000 7fc3097fa640 1 -- 172.21.15.110:0/2977998188 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3040be070 con 0x7fc30c1523e0 2024-04-21T22:54:04.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.002+0000 7fc3097fa640 1 -- 172.21.15.110:0/2977998188 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3040ada50 con 0x7fc30c1523e0 2024-04-21T22:54:04.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.002+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c14bd80 con 0x7fc30c1523e0 2024-04-21T22:54:04.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.002+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c13c7d0 con 0x7fc30c1523e0 2024-04-21T22:54:04.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.002+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c04f510 con 0x7fc30c1523e0 2024-04-21T22:54:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.274+0000 7fc3097fa640 1 -- 172.21.15.110:0/2977998188 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3040adbf0 con 0x7fc30c1523e0 2024-04-21T22:54:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.274+0000 7fc3097fa640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc2f0067910 0x7fc2f0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.274+0000 7fc310b32640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc2f0067910 0x7fc2f0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:04.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.274+0000 7fc310b32640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc2f0067910 0x7fc2f0069dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc300005890 tx=0x7fc300007a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:04.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.306+0000 7fc3097fa640 1 -- 172.21.15.110:0/2977998188 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc3040efdb0 con 0x7fc30c1523e0 2024-04-21T22:54:04.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.306+0000 7fc3097fa640 1 -- 172.21.15.110:0/2977998188 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fc304016520 con 0x7fc30c1523e0 2024-04-21T22:54:04.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.482+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc30c0c91d0 con 0x7fc30c1523e0 2024-04-21T22:54:04.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.494+0000 7fc3097fa640 1 -- 172.21.15.110:0/2977998188 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fc3040f2410 con 0x7fc30c1523e0 2024-04-21T22:54:04.495 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-04-21T22:54:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc2f0067910 msgr2=0x7fc2f0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc2f0067910 0x7fc2f0069dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc300005890 tx=0x7fc300007a30 comp rx=0 tx=0).stop 2024-04-21T22:54:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c1523e0 msgr2=0x7fc30c13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c1523e0 0x7fc30c13d2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc30401a560 tx=0x7fc3040196d0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 shutdown_connections 2024-04-21T22:54:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc2f0067910 0x7fc2f0069dd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c1523e0 0x7fc30c13d2b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc30c0c9f30 0x7fc30c1406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 --2- 172.21.15.110:0/2977998188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc30c0c2d50 0x7fc30c140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 >> 172.21.15.110:0/2977998188 conn(0x7fc30c0714f0 msgr2=0x7fc30c155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 shutdown_connections 2024-04-21T22:54:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.498+0000 7fc312d96640 1 -- 172.21.15.110:0/2977998188 wait complete. 2024-04-21T22:54:04.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:54:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.634+0000 7fb72ac11640 1 Processor -- start 2024-04-21T22:54:04.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.634+0000 7fb72ac11640 1 -- start start 2024-04-21T22:54:04.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.638+0000 7fb72ac11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7240c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:04.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.638+0000 7fb72ac11640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7240c6110 con 0x7fb724072460 2024-04-21T22:54:04.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.638+0000 7fb72ac11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7240716c0 con 0x7fb724152180 2024-04-21T22:54:04.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.638+0000 7fb72ac11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7240c63d0 con 0x7fb724152560 2024-04-21T22:54:04.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.638+0000 7fb71bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7240c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:04.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.638+0000 7fb7289ad640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb724152180 0x7fb72406fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:36812/0 (socket says 172.21.15.110:36812) 2024-04-21T22:54:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.638+0000 7fb7289ad640 1 -- 172.21.15.110:0/3093799776 learned_addr learned my addr 172.21.15.110:0/3093799776 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:04.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.646+0000 7fb71b7fe640 1 -- 172.21.15.110:0/3093799776 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657654221 0 0) 0x7fb7240716c0 con 0x7fb724152180 2024-04-21T22:54:04.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.646+0000 7fb71b7fe640 1 -- 172.21.15.110:0/3093799776 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb70c003530 con 0x7fb724152180 2024-04-21T22:54:04.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.646+0000 7fb71b7fe640 1 -- 172.21.15.110:0/3093799776 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246023112 0 0) 0x7fb7240c6110 con 0x7fb724072460 2024-04-21T22:54:04.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.646+0000 7fb71b7fe640 1 -- 172.21.15.110:0/3093799776 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7240716c0 con 0x7fb724072460 2024-04-21T22:54:04.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.646+0000 7fb71bfff640 1 -- 172.21.15.110:0/3093799776 >> v1:172.21.15.154:6789/0 conn(0x7fb724152180 legacy=0x7fb72406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:04.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.646+0000 7fb71bfff640 1 -- 172.21.15.110:0/3093799776 >> v1:172.21.15.110:6789/0 conn(0x7fb724072460 legacy=0x7fb7240c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:04.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.646+0000 7fb71bfff640 1 -- 172.21.15.110:0/3093799776 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7240c66b0 con 0x7fb724152560 2024-04-21T22:54:04.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.654+0000 7fb71bfff640 1 --2- 172.21.15.110:0/3093799776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7240c7490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097f0 tx=0x7fb71401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698f363acc28dae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:04.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb71b7fe640 1 -- 172.21.15.110:0/3093799776 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140b5070 con 0x7fb724152560 2024-04-21T22:54:04.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb71b7fe640 1 -- 172.21.15.110:0/3093799776 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140a89d0 con 0x7fb724152560 2024-04-21T22:54:04.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb71b7fe640 1 -- 172.21.15.110:0/3093799776 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140a8da0 con 0x7fb724152560 2024-04-21T22:54:04.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb72ac11640 1 -- 172.21.15.110:0/3093799776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 msgr2=0x7fb7240c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:04.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb72ac11640 1 --2- 172.21.15.110:0/3093799776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7240c7490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097f0 tx=0x7fb71401ecd0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb72ac11640 1 -- 172.21.15.110:0/3093799776 shutdown_connections 2024-04-21T22:54:04.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb72ac11640 1 --2- 172.21.15.110:0/3093799776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7240c7490 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb72ac11640 1 -- 172.21.15.110:0/3093799776 >> 172.21.15.110:0/3093799776 conn(0x7fb7240cb710 msgr2=0x7fb7240cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:04.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb72ac11640 1 -- 172.21.15.110:0/3093799776 shutdown_connections 2024-04-21T22:54:04.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.682+0000 7fb72ac11640 1 -- 172.21.15.110:0/3093799776 wait complete. 2024-04-21T22:54:04.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 Processor -- start 2024-04-21T22:54:04.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 -- start start 2024-04-21T22:54:04.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb724072460 0x7fb72414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:04.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb724152180 0x7fb724144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:04.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7241ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:04.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb724071f40 con 0x7fb724072460 2024-04-21T22:54:04.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb724071c60 con 0x7fb724152180 2024-04-21T22:54:04.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb72ac11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7240c5530 con 0x7fb724152560 2024-04-21T22:54:04.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb71bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb724152180 0x7fb724144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:04.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb7291ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7241ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:04.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb71bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb724152180 0x7fb724144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:52186/0 (socket says 172.21.15.110:52186) 2024-04-21T22:54:04.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.686+0000 7fb71bfff640 1 -- 172.21.15.110:0/991528586 learned_addr learned my addr 172.21.15.110:0/991528586 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:04.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.690+0000 7fb7289ad640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb724072460 0x7fb72414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:04.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.694+0000 7fb7289ad640 1 -- 172.21.15.110:0/991528586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 msgr2=0x7fb7241ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:04.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.694+0000 7fb7289ad640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7241ee040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.698+0000 7fb7289ad640 1 -- 172.21.15.110:0/991528586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb724152180 msgr2=0x7fb724144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:04.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.698+0000 7fb7289ad640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb724152180 0x7fb724144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:04.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.698+0000 7fb7289ad640 1 -- 172.21.15.110:0/991528586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7241555f0 con 0x7fb724072460 2024-04-21T22:54:04.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.754+0000 7fb7289ad640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb724072460 0x7fb72414b9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c430 tx=0x7fb72000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:04.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.766+0000 7fb7197fa640 1 -- 172.21.15.110:0/991528586 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720017070 con 0x7fb724072460 2024-04-21T22:54:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.766+0000 7fb7197fa640 1 -- 172.21.15.110:0/991528586 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb720005cf0 con 0x7fb724072460 2024-04-21T22:54:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.766+0000 7fb7197fa640 1 -- 172.21.15.110:0/991528586 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200072d0 con 0x7fb724072460 2024-04-21T22:54:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.766+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7241558b0 con 0x7fb724072460 2024-04-21T22:54:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.766+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72414a7c0 con 0x7fb724072460 2024-04-21T22:54:04.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:04.766+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72404f510 con 0x7fb724072460 2024-04-21T22:54:05.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.070+0000 7fb7197fa640 1 -- 172.21.15.110:0/991528586 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb72001a070 con 0x7fb724072460 2024-04-21T22:54:05.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.070+0000 7fb7197fa640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb710067940 0x7fb710069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.070+0000 7fb71bfff640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb710067940 0x7fb710069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.074+0000 7fb71bfff640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb710067940 0x7fb710069e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb71401c900 tx=0x7fb714008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:05.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.110+0000 7fb7197fa640 1 -- 172.21.15.110:0/991528586 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb7200539e0 con 0x7fb724072460 2024-04-21T22:54:05.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.110+0000 7fb7197fa640 1 -- 172.21.15.110:0/991528586 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fb720055940 con 0x7fb724072460 2024-04-21T22:54:05.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.282+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb7240c7440 con 0x7fb724072460 2024-04-21T22:54:05.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.294+0000 7fb7197fa640 1 -- 172.21.15.110:0/991528586 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb720059c40 con 0x7fb724072460 2024-04-21T22:54:05.294 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb710067940 msgr2=0x7fb710069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb710067940 0x7fb710069e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb71401c900 tx=0x7fb714008040 comp rx=0 tx=0).stop 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb724072460 msgr2=0x7fb72414b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb724072460 0x7fb72414b9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c430 tx=0x7fb72000c8f0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 shutdown_connections 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb710067940 0x7fb710069e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb724152560 0x7fb7241ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb724152180 0x7fb724144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 --2- 172.21.15.110:0/991528586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb724072460 0x7fb72414b9d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 >> 172.21.15.110:0/991528586 conn(0x7fb7240cb710 msgr2=0x7fb7240cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 shutdown_connections 2024-04-21T22:54:05.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.298+0000 7fb72ac11640 1 -- 172.21.15.110:0/991528586 wait complete. 2024-04-21T22:54:05.315 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:54:05.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b3a0e640 1 Processor -- start 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b3a0e640 1 -- start start 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b3a0e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac0c9f30 0x7f53ac158b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b3a0e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ac0ca590 con 0x7f53ac0c2d50 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b3a0e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ac0ca830 con 0x7f53ac1523e0 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b3a0e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac0c9720 con 0x7f53ac0c9f30 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b0fa9640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f53ac0c2d50 0x7f53ac0c8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45448/0 (socket says 172.21.15.110:45448) 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b0fa9640 1 -- 172.21.15.110:0/3815410879 learned_addr learned my addr 172.21.15.110:0/3815410879 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:05.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.442+0000 7f53b1fab640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac0c9f30 0x7f53ac158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.446+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779048677 0 0) 0x7f53ac0ca590 con 0x7f53ac0c2d50 2024-04-21T22:54:05.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.446+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5398003530 con 0x7f53ac0c2d50 2024-04-21T22:54:05.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3115204977 0 0) 0x7f5398003530 con 0x7f53ac0c2d50 2024-04-21T22:54:05.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac0c9f30 msgr2=0x7f53ac158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:05.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac0c9f30 0x7f53ac158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 >> v1:172.21.15.154:6789/0 conn(0x7f53ac1523e0 legacy=0x7f53ac070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac0caaf0 con 0x7f53ac0c2d50 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f539c001680 con 0x7f53ac0c2d50 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 >> v1:172.21.15.110:6789/0 conn(0x7f53ac0c2d50 legacy=0x7f53ac0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53980039f0 0x7f5398003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac0c9f30 0x7f5398004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac0c9720 con 0x7f5398004d50 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f539800bab0 con 0x7f53980039f0 2024-04-21T22:54:05.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f539800bcb0 con 0x7f53ac0c9f30 2024-04-21T22:54:05.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.450+0000 7f53b1fab640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.454+0000 7f53b17aa640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53980039f0 0x7f5398003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.454+0000 7f53b1fab640 1 -- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac0c9f30 msgr2=0x7f5398004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:05.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.454+0000 7f53b1fab640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac0c9f30 0x7f5398004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.454+0000 7f53b1fab640 1 -- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53980039f0 msgr2=0x7f5398003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:05.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.454+0000 7f53b1fab640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53980039f0 0x7f5398003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.454+0000 7f53b1fab640 1 -- 172.21.15.110:0/3815410879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5398003530 con 0x7f5398004d50 2024-04-21T22:54:05.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.458+0000 7f53b1fab640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53980051d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009ab0 tx=0x7f53a401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9214740eb189d0f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a40b2070 con 0x7f5398004d50 2024-04-21T22:54:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a40a5680 con 0x7f5398004d50 2024-04-21T22:54:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53a3fff640 1 -- 172.21.15.110:0/3815410879 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a40096b0 con 0x7f5398004d50 2024-04-21T22:54:05.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3815410879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 msgr2=0x7f53980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:05.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53b3a0e640 1 --2- 172.21.15.110:0/3815410879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53980051d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009ab0 tx=0x7f53a401ca90 comp rx=0 tx=0).stop 2024-04-21T22:54:05.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53b1fab640 1 -- 172.21.15.110:0/3815410879 reap_dead start 2024-04-21T22:54:05.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3815410879 shutdown_connections 2024-04-21T22:54:05.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3815410879 >> 172.21.15.110:0/3815410879 conn(0x7f53ac0714f0 msgr2=0x7f53ac071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:05.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3815410879 shutdown_connections 2024-04-21T22:54:05.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.462+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3815410879 wait complete. 2024-04-21T22:54:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 Processor -- start 2024-04-21T22:54:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 -- start start 2024-04-21T22:54:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53ac14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53ac1e29f0 0x7f53ac1e3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac06dfb0 0x7f53ac1e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac06f850 con 0x7f5398004d50 2024-04-21T22:54:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac1527c0 con 0x7f53ac1e29f0 2024-04-21T22:54:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b3a0e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac06fb30 con 0x7f53ac06dfb0 2024-04-21T22:54:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b17aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53ac14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b17aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53ac14d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43104/0 (socket says 172.21.15.110:43104) 2024-04-21T22:54:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b17aa640 1 -- 172.21.15.110:0/3099988822 learned_addr learned my addr 172.21.15.110:0/3099988822 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:05.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b1fab640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac06dfb0 0x7f53ac1e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.466+0000 7f53b0fa9640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53ac1e29f0 0x7f53ac1e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.470+0000 7f53b17aa640 1 -- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac06dfb0 msgr2=0x7f53ac1e3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.470+0000 7f53b17aa640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac06dfb0 0x7f53ac1e3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.470+0000 7f53b17aa640 1 -- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53ac1e29f0 msgr2=0x7f53ac1e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.470+0000 7f53b17aa640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53ac1e29f0 0x7f53ac1e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.470+0000 7f53b17aa640 1 -- 172.21.15.110:0/3099988822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac06dac0 con 0x7f5398004d50 2024-04-21T22:54:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.474+0000 7f53b17aa640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53ac14d3a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f53a800e8d0 tx=0x7f53a800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.474+0000 7f53a1ffb640 1 -- 172.21.15.110:0/3099988822 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8003b90 con 0x7f5398004d50 2024-04-21T22:54:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.474+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac1f3840 con 0x7f5398004d50 2024-04-21T22:54:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.474+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac06d110 con 0x7f5398004d50 2024-04-21T22:54:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.478+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac1f3d20 con 0x7f5398004d50 2024-04-21T22:54:05.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.774+0000 7f53a1ffb640 1 -- 172.21.15.110:0/3099988822 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a8018070 con 0x7f5398004d50 2024-04-21T22:54:05.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.774+0000 7f53a1ffb640 1 -- 172.21.15.110:0/3099988822 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a80050d0 con 0x7f5398004d50 2024-04-21T22:54:05.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.778+0000 7f53a1ffb640 1 -- 172.21.15.110:0/3099988822 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53a80052b0 con 0x7f5398004d50 2024-04-21T22:54:05.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.778+0000 7f53a1ffb640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f53900678f0 0x7f5390069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:05.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.778+0000 7f53b0fa9640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f53900678f0 0x7f5390069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:05.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.778+0000 7f53b0fa9640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f53900678f0 0x7f5390069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f539c001ec0 tx=0x7f539c001990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:05.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.818+0000 7f53a1ffb640 1 -- 172.21.15.110:0/3099988822 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f53a8054c10 con 0x7f5398004d50 2024-04-21T22:54:05.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:05.830+0000 7f53a1ffb640 1 -- 172.21.15.110:0/3099988822 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f53a8056b70 con 0x7f5398004d50 2024-04-21T22:54:06.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.002+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f53ac04f510 con 0x7f5398004d50 2024-04-21T22:54:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53a1ffb640 1 -- 172.21.15.110:0/3099988822 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f53a805ae70 con 0x7f5398004d50 2024-04-21T22:54:06.020 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f53900678f0 msgr2=0x7f5390069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f53900678f0 0x7f5390069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f539c001ec0 tx=0x7f539c001990 comp rx=0 tx=0).stop 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 msgr2=0x7f53ac14d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53ac14d3a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f53a800e8d0 tx=0x7f53a800ed90 comp rx=0 tx=0).stop 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 shutdown_connections 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f53900678f0 0x7f5390069db0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53ac06dfb0 0x7f53ac1e3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53ac1e29f0 0x7f53ac1e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 --2- 172.21.15.110:0/3099988822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5398004d50 0x7f53ac14d3a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 >> 172.21.15.110:0/3099988822 conn(0x7f53ac0714f0 msgr2=0x7f53ac0b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 shutdown_connections 2024-04-21T22:54:06.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.022+0000 7f53b3a0e640 1 -- 172.21.15.110:0/3099988822 wait complete. 2024-04-21T22:54:06.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:54:06.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.158+0000 7f6586f9f640 1 Processor -- start 2024-04-21T22:54:06.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.158+0000 7f6586f9f640 1 -- start start 2024-04-21T22:54:06.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f6586f9f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6580150c20 0x7f65800c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f6586f9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6580156950 0x7f65800c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f6586f9f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65800c7300 con 0x7f658006ee90 2024-04-21T22:54:06.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f6586f9f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f65800c5640 con 0x7f6580150c20 2024-04-21T22:54:06.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f6586f9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65800c4da0 con 0x7f6580156950 2024-04-21T22:54:06.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f6584d3b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6580150c20 0x7f65800c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f658553c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f658006ee90 0x7f65800c6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45460/0 (socket says 172.21.15.110:45460) 2024-04-21T22:54:06.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.162+0000 7f658553c640 1 -- 172.21.15.110:0/1116997931 learned_addr learned my addr 172.21.15.110:0/1116997931 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:06.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.166+0000 7f6584d3b640 1 -- 172.21.15.110:0/1116997931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6580156950 msgr2=0x7f65800c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:06.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.166+0000 7f6584d3b640 1 --2- 172.21.15.110:0/1116997931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6580156950 0x7f65800c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.166+0000 7f6584d3b640 1 -- 172.21.15.110:0/1116997931 >> v1:172.21.15.110:6789/0 conn(0x7f658006ee90 legacy=0x7f65800c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.166+0000 7f6584d3b640 1 -- 172.21.15.110:0/1116997931 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65800c5080 con 0x7f6580150c20 2024-04-21T22:54:06.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.170+0000 7f6584d3b640 1 --2- 172.21.15.110:0/1116997931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65800c7ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65740097c0 tx=0x7f657401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4acd5a9cb4ed9b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:06.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f657f7fe640 1 -- 172.21.15.110:0/1116997931 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740b5070 con 0x7f6580150c20 2024-04-21T22:54:06.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f657f7fe640 1 -- 172.21.15.110:0/1116997931 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65740a8990 con 0x7f6580150c20 2024-04-21T22:54:06.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f657f7fe640 1 -- 172.21.15.110:0/1116997931 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740a8d60 con 0x7f6580150c20 2024-04-21T22:54:06.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- 172.21.15.110:0/1116997931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 msgr2=0x7f65800c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 --2- 172.21.15.110:0/1116997931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65800c7ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65740097c0 tx=0x7f657401ec90 comp rx=0 tx=0).stop 2024-04-21T22:54:06.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- 172.21.15.110:0/1116997931 shutdown_connections 2024-04-21T22:54:06.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 --2- 172.21.15.110:0/1116997931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6580156950 0x7f65800c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 --2- 172.21.15.110:0/1116997931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65800c7ac0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- 172.21.15.110:0/1116997931 >> 172.21.15.110:0/1116997931 conn(0x7f65800cb710 msgr2=0x7f65800cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:06.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- 172.21.15.110:0/1116997931 shutdown_connections 2024-04-21T22:54:06.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- 172.21.15.110:0/1116997931 wait complete. 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 Processor -- start 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- start start 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658006ee90 0x7f65800ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65801558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6580156950 0x7f6580155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6580151000 con 0x7f6580150c20 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65800c75a0 con 0x7f6580156950 2024-04-21T22:54:06.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.174+0000 7f6586f9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65800c24a0 con 0x7f658006ee90 2024-04-21T22:54:06.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.178+0000 7f657ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65801558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.178+0000 7f657ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65801558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43108/0 (socket says 172.21.15.110:43108) 2024-04-21T22:54:06.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.178+0000 7f657ffff640 1 -- 172.21.15.110:0/23211220 learned_addr learned my addr 172.21.15.110:0/23211220 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:06.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.182+0000 7f657ffff640 1 -- 172.21.15.110:0/23211220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658006ee90 msgr2=0x7f65800ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.182+0000 7f657ffff640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658006ee90 0x7f65800ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.182+0000 7f657ffff640 1 -- 172.21.15.110:0/23211220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6580156950 msgr2=0x7f6580155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.182+0000 7f657ffff640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6580156950 0x7f6580155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.182+0000 7f657ffff640 1 -- 172.21.15.110:0/23211220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65800729a0 con 0x7f6580150c20 2024-04-21T22:54:06.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.182+0000 7f657ffff640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65801558c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f656c00b440 tx=0x7f656c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:06.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.186+0000 7f657d7fa640 1 -- 172.21.15.110:0/23211220 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c015020 con 0x7f6580150c20 2024-04-21T22:54:06.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.186+0000 7f657d7fa640 1 -- 172.21.15.110:0/23211220 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656c0118b0 con 0x7f6580150c20 2024-04-21T22:54:06.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.186+0000 7f657d7fa640 1 -- 172.21.15.110:0/23211220 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c011ca0 con 0x7f6580150c20 2024-04-21T22:54:06.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.186+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65801f3a30 con 0x7f6580150c20 2024-04-21T22:54:06.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.186+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65801f3ff0 con 0x7f6580150c20 2024-04-21T22:54:06.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.186+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658004f510 con 0x7f6580150c20 2024-04-21T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.206+0000 7f657d7fa640 1 -- 172.21.15.110:0/23211220 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f656c018020 con 0x7f6580150c20 2024-04-21T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.210+0000 7f657d7fa640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6564067940 0x7f6564069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.210+0000 7f6584d3b640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6564067940 0x7f6564069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.210+0000 7f6584d3b640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6564067940 0x7f6564069e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f65740b2000 tx=0x7f6574004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.210+0000 7f657d7fa640 1 -- 172.21.15.110:0/23211220 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f656c054820 con 0x7f6580150c20 2024-04-21T22:54:06.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.470+0000 7f657d7fa640 1 -- 172.21.15.110:0/23211220 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f656c01f020 con 0x7f6580150c20 2024-04-21T22:54:06.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.650+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6580155620 con 0x7f6580150c20 2024-04-21T22:54:06.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.682+0000 7f657d7fa640 1 -- 172.21.15.110:0/23211220 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6842 (secure 0 0 0) 0x7f65800729a0 con 0x7f6580150c20 2024-04-21T22:54:06.681 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:54:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3272126146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3272126146},{"type":"v1","addr":"172.21.15.154:6835","nonce":3272126146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1335792720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1335792720},{"type":"v1","addr":"172.21.15.110:6839","nonce":1335792720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1521497243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1521497243},{"type":"v1","addr":"172.21.15.154:6833","nonce":1521497243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1669982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1669982495},{"type":"v1","addr":"172.21.15.154:6837","nonce":1669982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T22:53:38.095934+0000","modified":"2024-04-21T22:53:44.722732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/1034856927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1034856927},{"type":"v1","addr":"172.21.15.110:6837","nonce":1034856927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-21T22:54:06.681 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2024-04-21T22:54:06.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6564067940 msgr2=0x7f6564069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6564067940 0x7f6564069e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f65740b2000 tx=0x7f6574004740 comp rx=0 tx=0).stop 2024-04-21T22:54:06.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 msgr2=0x7f65801558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65801558c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f656c00b440 tx=0x7f656c00b900 comp rx=0 tx=0).stop 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 shutdown_connections 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6564067940 0x7f6564069e00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6580156950 0x7f6580155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6580150c20 0x7f65801558c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 --2- 172.21.15.110:0/23211220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658006ee90 0x7f65800ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 >> 172.21.15.110:0/23211220 conn(0x7f65800cb710 msgr2=0x7f65800cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 shutdown_connections 2024-04-21T22:54:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.686+0000 7f6586f9f640 1 -- 172.21.15.110:0/23211220 wait complete. 2024-04-21T22:54:06.700 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:54:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc32965e640 1 Processor -- start 2024-04-21T22:54:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc32965e640 1 -- start start 2024-04-21T22:54:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc32965e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc324154500 0x7fc3240c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc32965e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3240caa20 0x7fc3240c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc32965e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32406c9a0 con 0x7fc3240c9930 2024-04-21T22:54:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc32965e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc3241548e0 con 0x7fc3240caa20 2024-04-21T22:54:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc32965e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc32415a370 con 0x7fc324154500 2024-04-21T22:54:06.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc322ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc324154500 0x7fc3240c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.822+0000 7fc3237fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3240caa20 0x7fc3240c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.826+0000 7fc322ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc324154500 0x7fc3240c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:49810/0 (socket says 172.21.15.110:49810) 2024-04-21T22:54:06.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.826+0000 7fc322ffd640 1 -- 172.21.15.110:0/2104896011 learned_addr learned my addr 172.21.15.110:0/2104896011 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:06.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.830+0000 7fc322ffd640 1 -- 172.21.15.110:0/2104896011 >> v2:172.21.15.154:3300/0 conn(0x7fc3240caa20 msgr2=0x7fc3240c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:06.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.830+0000 7fc322ffd640 1 --2- 172.21.15.110:0/2104896011 >> v2:172.21.15.154:3300/0 conn(0x7fc3240caa20 0x7fc3240c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.830+0000 7fc322ffd640 1 -- 172.21.15.110:0/2104896011 >> v1:172.21.15.154:6789/0 conn(0x7fc3240c9930 legacy=0x7fc3240ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:06.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.830+0000 7fc322ffd640 1 -- 172.21.15.110:0/2104896011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32415a650 con 0x7fc324154500 2024-04-21T22:54:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.838+0000 7fc322ffd640 1 --2- 172.21.15.110:0/2104896011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc324154500 0x7fc3240c93f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b89a62c0dd2c1956 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:06.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc321ffb640 1 -- 172.21.15.110:0/2104896011 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0b5070 con 0x7fc324154500 2024-04-21T22:54:06.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc321ffb640 1 -- 172.21.15.110:0/2104896011 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c0a89d0 con 0x7fc324154500 2024-04-21T22:54:06.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc321ffb640 1 -- 172.21.15.110:0/2104896011 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0a8da0 con 0x7fc324154500 2024-04-21T22:54:06.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc32965e640 1 -- 172.21.15.110:0/2104896011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc324154500 msgr2=0x7fc3240c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc32965e640 1 --2- 172.21.15.110:0/2104896011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc324154500 0x7fc3240c93f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c01ed10 comp rx=0 tx=0).stop 2024-04-21T22:54:06.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc32965e640 1 -- 172.21.15.110:0/2104896011 shutdown_connections 2024-04-21T22:54:06.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc32965e640 1 --2- 172.21.15.110:0/2104896011 >> v2:172.21.15.154:3300/0 conn(0x7fc3240caa20 0x7fc3240c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc32965e640 1 --2- 172.21.15.110:0/2104896011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc324154500 0x7fc3240c93f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.846+0000 7fc32965e640 1 -- 172.21.15.110:0/2104896011 >> 172.21.15.110:0/2104896011 conn(0x7fc3240714f0 msgr2=0x7fc324071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:06.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 -- 172.21.15.110:0/2104896011 shutdown_connections 2024-04-21T22:54:06.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 -- 172.21.15.110:0/2104896011 wait complete. 2024-04-21T22:54:06.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 Processor -- start 2024-04-21T22:54:06.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 -- start start 2024-04-21T22:54:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3240c9930 0x7fc3241575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240caa20 0x7fc3241f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc324154500 0x7fc3240c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.850+0000 7fc32965e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc32415aef0 con 0x7fc3240caa20 2024-04-21T22:54:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.854+0000 7fc32965e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc32415ac10 con 0x7fc324154500 2024-04-21T22:54:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.854+0000 7fc32965e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3240c3fa0 con 0x7fc3240c9930 2024-04-21T22:54:06.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.854+0000 7fc3227fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240caa20 0x7fc3241f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.854+0000 7fc3227fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240caa20 0x7fc3241f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43120/0 (socket says 172.21.15.110:43120) 2024-04-21T22:54:06.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.854+0000 7fc3227fc640 1 -- 172.21.15.110:0/1838984000 learned_addr learned my addr 172.21.15.110:0/1838984000 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:06.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.854+0000 7fc3237fe640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc324154500 0x7fc3240c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.854+0000 7fc322ffd640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3240c9930 0x7fc3241575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:06.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.858+0000 7fc3227fc640 1 -- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3240c9930 msgr2=0x7fc3241575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.858+0000 7fc3227fc640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3240c9930 0x7fc3241575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.858+0000 7fc3227fc640 1 -- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc324154500 msgr2=0x7fc3240c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:06.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.858+0000 7fc3227fc640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc324154500 0x7fc3240c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:06.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.858+0000 7fc3227fc640 1 -- 172.21.15.110:0/1838984000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3240caf40 con 0x7fc3240caa20 2024-04-21T22:54:06.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.858+0000 7fc3227fc640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240caa20 0x7fc3241f1ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c800 tx=0x7fc31c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:06.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.862+0000 7fc31b7fe640 1 -- 172.21.15.110:0/1838984000 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c017070 con 0x7fc3240caa20 2024-04-21T22:54:06.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.862+0000 7fc31b7fe640 1 -- 172.21.15.110:0/1838984000 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c003db0 con 0x7fc3240caa20 2024-04-21T22:54:06.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.862+0000 7fc31b7fe640 1 -- 172.21.15.110:0/1838984000 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0052b0 con 0x7fc3240caa20 2024-04-21T22:54:06.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.862+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3240685b0 con 0x7fc3240caa20 2024-04-21T22:54:06.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.862+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3240c93f0 con 0x7fc3240caa20 2024-04-21T22:54:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:06.866+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32404f510 con 0x7fc3240caa20 2024-04-21T22:54:07.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.134+0000 7fc31b7fe640 1 -- 172.21.15.110:0/1838984000 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc31c01a070 con 0x7fc3240caa20 2024-04-21T22:54:07.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.134+0000 7fc31b7fe640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc304067940 0x7fc304069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:07.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.138+0000 7fc322ffd640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc304067940 0x7fc304069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:07.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.138+0000 7fc322ffd640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc304067940 0x7fc304069e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0b2000 tx=0x7fc30c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:07.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.162+0000 7fc31b7fe640 1 -- 172.21.15.110:0/1838984000 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc31c053ff0 con 0x7fc3240caa20 2024-04-21T22:54:07.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.162+0000 7fc31b7fe640 1 -- 172.21.15.110:0/1838984000 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fc31c021070 con 0x7fc3240caa20 2024-04-21T22:54:07.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.334+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3240c9670 con 0x7fc3240caa20 2024-04-21T22:54:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.382+0000 7fc31b7fe640 1 -- 172.21.15.110:0/1838984000 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7fc31c055f50 con 0x7fc3240caa20 2024-04-21T22:54:07.381 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:54:07.382 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:53:39.272660+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:54:07.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc304067940 msgr2=0x7fc304069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:07.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc304067940 0x7fc304069e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0b2000 tx=0x7fc30c0aa070 comp rx=0 tx=0).stop 2024-04-21T22:54:07.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240caa20 msgr2=0x7fc3241f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:07.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240caa20 0x7fc3241f1ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c800 tx=0x7fc31c00ccc0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 shutdown_connections 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc304067940 0x7fc304069e00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc324154500 0x7fc3240c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240caa20 0x7fc3241f1ac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 --2- 172.21.15.110:0/1838984000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3240c9930 0x7fc3241575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 >> 172.21.15.110:0/1838984000 conn(0x7fc3240714f0 msgr2=0x7fc32414a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 shutdown_connections 2024-04-21T22:54:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.386+0000 7fc32965e640 1 -- 172.21.15.110:0/1838984000 wait complete. 2024-04-21T22:54:07.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:54:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb720ff2640 1 Processor -- start 2024-04-21T22:54:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb720ff2640 1 -- start start 2024-04-21T22:54:07.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb720ff2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb71c154550 0x7fb71c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:07.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb720ff2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb71c061ff0 0x7fb71c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:07.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb720ff2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb71c154930 con 0x7fb71c06f390 2024-04-21T22:54:07.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb720ff2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb71c0c8020 con 0x7fb71c061ff0 2024-04-21T22:54:07.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb720ff2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb71c0c89f0 con 0x7fb71c154550 2024-04-21T22:54:07.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.526+0000 7fb71a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb71c154550 0x7fb71c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:07.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.530+0000 7fb71a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb71c154550 0x7fb71c06b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:52244/0 (socket says 172.21.15.110:52244) 2024-04-21T22:54:07.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.530+0000 7fb71a59c640 1 -- 172.21.15.110:0/1766839413 learned_addr learned my addr 172.21.15.110:0/1766839413 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:07.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.538+0000 7fb71a59c640 1 -- 172.21.15.110:0/1766839413 >> v2:172.21.15.110:3300/0 conn(0x7fb71c061ff0 msgr2=0x7fb71c0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:07.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.538+0000 7fb71a59c640 1 --2- 172.21.15.110:0/1766839413 >> v2:172.21.15.110:3300/0 conn(0x7fb71c061ff0 0x7fb71c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.538+0000 7fb71a59c640 1 -- 172.21.15.110:0/1766839413 >> v1:172.21.15.110:6789/0 conn(0x7fb71c06f390 legacy=0x7fb71c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:07.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.538+0000 7fb71a59c640 1 -- 172.21.15.110:0/1766839413 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c15ae30 con 0x7fb71c154550 2024-04-21T22:54:07.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.546+0000 7fb71a59c640 1 --2- 172.21.15.110:0/1766839413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c154550 0x7fb71c06b1e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0628d0 tx=0x7fb70c01ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5750be2e8eaa251a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:07.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb719d9b640 1 -- 172.21.15.110:0/1766839413 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0b5070 con 0x7fb71c154550 2024-04-21T22:54:07.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb719d9b640 1 -- 172.21.15.110:0/1766839413 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c0a89d0 con 0x7fb71c154550 2024-04-21T22:54:07.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb719d9b640 1 -- 172.21.15.110:0/1766839413 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0a8da0 con 0x7fb71c154550 2024-04-21T22:54:07.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 -- 172.21.15.110:0/1766839413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c154550 msgr2=0x7fb71c06b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:07.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 --2- 172.21.15.110:0/1766839413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c154550 0x7fb71c06b1e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0628d0 tx=0x7fb70c01ecd0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 -- 172.21.15.110:0/1766839413 shutdown_connections 2024-04-21T22:54:07.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 --2- 172.21.15.110:0/1766839413 >> v2:172.21.15.110:3300/0 conn(0x7fb71c061ff0 0x7fb71c0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 --2- 172.21.15.110:0/1766839413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c154550 0x7fb71c06b1e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 -- 172.21.15.110:0/1766839413 >> 172.21.15.110:0/1766839413 conn(0x7fb71c0cc250 msgr2=0x7fb71c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:07.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 -- 172.21.15.110:0/1766839413 shutdown_connections 2024-04-21T22:54:07.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 -- 172.21.15.110:0/1766839413 wait complete. 2024-04-21T22:54:07.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.566+0000 7fb720ff2640 1 Processor -- start 2024-04-21T22:54:07.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb720ff2640 1 -- start start 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb720ff2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71c061ff0 0x7fb71c158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb720ff2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c06f390 0x7fb71c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb720ff2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb71c154550 0x7fb71c150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb720ff2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c0c79d0 con 0x7fb71c154550 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb720ff2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c0c76f0 con 0x7fb71c06f390 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb720ff2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb71c0c7cb0 con 0x7fb71c061ff0 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb71ad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb71c154550 0x7fb71c150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb71ad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb71c154550 0x7fb71c150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43136/0 (socket says 172.21.15.110:43136) 2024-04-21T22:54:07.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.570+0000 7fb71ad9d640 1 -- 172.21.15.110:0/2895396099 learned_addr learned my addr 172.21.15.110:0/2895396099 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:07.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.574+0000 7fb713fff640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c06f390 0x7fb71c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:07.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.574+0000 7fb71ad9d640 1 -- 172.21.15.110:0/2895396099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71c061ff0 msgr2=0x7fb71c158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:07.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.574+0000 7fb71ad9d640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71c061ff0 0x7fb71c158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.574+0000 7fb71ad9d640 1 -- 172.21.15.110:0/2895396099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c06f390 msgr2=0x7fb71c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:07.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.574+0000 7fb71ad9d640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c06f390 0x7fb71c14ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:07.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.574+0000 7fb71ad9d640 1 -- 172.21.15.110:0/2895396099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c0cbc80 con 0x7fb71c154550 2024-04-21T22:54:07.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.574+0000 7fb71ad9d640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb71c154550 0x7fb71c150520 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c7b0 tx=0x7fb71400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:07.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.578+0000 7fb712ffd640 1 -- 172.21.15.110:0/2895396099 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714017070 con 0x7fb71c154550 2024-04-21T22:54:07.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.578+0000 7fb712ffd640 1 -- 172.21.15.110:0/2895396099 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714003db0 con 0x7fb71c154550 2024-04-21T22:54:07.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.578+0000 7fb712ffd640 1 -- 172.21.15.110:0/2895396099 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140052b0 con 0x7fb71c154550 2024-04-21T22:54:07.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.578+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71c1f0360 con 0x7fb71c154550 2024-04-21T22:54:07.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.578+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb71c1f0900 con 0x7fb71c154550 2024-04-21T22:54:07.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.582+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb71c04f510 con 0x7fb71c154550 2024-04-21T22:54:07.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.866+0000 7fb712ffd640 1 -- 172.21.15.110:0/2895396099 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb71401a070 con 0x7fb71c154550 2024-04-21T22:54:07.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.866+0000 7fb712ffd640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb6fc067910 0x7fb6fc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:07.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.866+0000 7fb71a59c640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb6fc067910 0x7fb6fc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:07.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.870+0000 7fb71a59c640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb6fc067910 0x7fb6fc069dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0b2000 tx=0x7fb70c004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:07.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.906+0000 7fb712ffd640 1 -- 172.21.15.110:0/2895396099 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb714053c70 con 0x7fb71c154550 2024-04-21T22:54:07.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:07.906+0000 7fb712ffd640 1 -- 172.21.15.110:0/2895396099 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fb714021020 con 0x7fb71c154550 2024-04-21T22:54:08.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.110+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb71c157c50 con 0x7fb71c154550 2024-04-21T22:54:08.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.134+0000 7fb712ffd640 1 -- 172.21.15.110:0/2895396099 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6842 (secure 0 0 0) 0x7fb7140562d0 con 0x7fb71c154550 2024-04-21T22:54:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-21T22:54:08.133 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3272126146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3272126146},{"type":"v1","addr":"172.21.15.154:6835","nonce":3272126146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1335792720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1335792720},{"type":"v1","addr":"172.21.15.110:6839","nonce":1335792720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1521497243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1521497243},{"type":"v1","addr":"172.21.15.154:6833","nonce":1521497243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1669982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1669982495},{"type":"v1","addr":"172.21.15.154:6837","nonce":1669982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T22:53:38.095934+0000","modified":"2024-04-21T22:53:44.722732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/1034856927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1034856927},{"type":"v1","addr":"172.21.15.110:6837","nonce":1034856927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-21T22:54:08.134 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb6fc067910 msgr2=0x7fb6fc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb6fc067910 0x7fb6fc069dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0b2000 tx=0x7fb70c004740 comp rx=0 tx=0).stop 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb71c154550 msgr2=0x7fb71c150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb71c154550 0x7fb71c150520 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c7b0 tx=0x7fb71400cc70 comp rx=0 tx=0).stop 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 shutdown_connections 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb6fc067910 0x7fb6fc069dd0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0b2000 tx=0x7fb70c004740 comp rx=0 tx=0).stop 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb71c154550 0x7fb71c150520 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71c06f390 0x7fb71c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 --2- 172.21.15.110:0/2895396099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71c061ff0 0x7fb71c158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 >> 172.21.15.110:0/2895396099 conn(0x7fb71c0cc250 msgr2=0x7fb71c06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 shutdown_connections 2024-04-21T22:54:08.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.138+0000 7fb720ff2640 1 -- 172.21.15.110:0/2895396099 wait complete. 2024-04-21T22:54:08.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-21T22:53:38.095934+0000', 'modified': '2024-04-21T22:53:44.722732+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4261}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4261': {'gid': 4261, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.110:6837/1034856927', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6836', 'nonce': 1034856927}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 1034856927}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4261, 'qdb_cluster': [4261]} 2024-04-21T22:54:08.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-21T22:54:08.757 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-21T22:54:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f6700f6d640 1 Processor -- start 2024-04-21T22:54:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f6700f6d640 1 -- start start 2024-04-21T22:54:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f6700f6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66fc152180 0x7f66fc0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f6700f6d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66fc072460 0x7f66fc158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f6700f6d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66fc0c6110 con 0x7f66fc152560 2024-04-21T22:54:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f6700f6d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f66fc1592e0 con 0x7f66fc072460 2024-04-21T22:54:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f6700f6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f66fc0716c0 con 0x7f66fc152180 2024-04-21T22:54:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f66fad9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66fc072460 0x7f66fc158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f66f9d9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f66fc152560 0x7f66fc06fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45486/0 (socket says 172.21.15.110:45486) 2024-04-21T22:54:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.890+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1523982580 learned_addr learned my addr 172.21.15.110:0/1523982580 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-21T22:54:08.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.894+0000 7f66fa59c640 1 --2- 172.21.15.110:0/1523982580 >> v2:172.21.15.154:3300/0 conn(0x7f66fc152180 0x7f66fc0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.898+0000 7f66fad9d640 1 -- 172.21.15.110:0/1523982580 >> v2:172.21.15.154:3300/0 conn(0x7f66fc152180 msgr2=0x7f66fc0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:08.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.898+0000 7f66fad9d640 1 --2- 172.21.15.110:0/1523982580 >> v2:172.21.15.154:3300/0 conn(0x7f66fc152180 0x7f66fc0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.898+0000 7f66fad9d640 1 -- 172.21.15.110:0/1523982580 >> v1:172.21.15.110:6789/0 conn(0x7f66fc152560 legacy=0x7f66fc06fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:08.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.898+0000 7f66fad9d640 1 -- 172.21.15.110:0/1523982580 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc0c63d0 con 0x7f66fc072460 2024-04-21T22:54:08.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.902+0000 7f66fad9d640 1 --2- 172.21.15.110:0/1523982580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc072460 0x7f66fc158da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66fc070270 tx=0x7f66f401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a996b709254f323 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:08.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f66f959a640 1 -- 172.21.15.110:0/1523982580 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f40b4070 con 0x7f66fc072460 2024-04-21T22:54:08.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f66f959a640 1 -- 172.21.15.110:0/1523982580 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f40af600 con 0x7f66fc072460 2024-04-21T22:54:08.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f66f959a640 1 -- 172.21.15.110:0/1523982580 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f40af9d0 con 0x7f66fc072460 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 -- 172.21.15.110:0/1523982580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc072460 msgr2=0x7f66fc158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1523982580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc072460 0x7f66fc158da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66fc070270 tx=0x7f66f401f110 comp rx=0 tx=0).stop 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 -- 172.21.15.110:0/1523982580 shutdown_connections 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1523982580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc072460 0x7f66fc158da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1523982580 >> v2:172.21.15.154:3300/0 conn(0x7f66fc152180 0x7f66fc0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 -- 172.21.15.110:0/1523982580 >> 172.21.15.110:0/1523982580 conn(0x7f66fc0cb710 msgr2=0x7f66fc0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 -- 172.21.15.110:0/1523982580 shutdown_connections 2024-04-21T22:54:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 -- 172.21.15.110:0/1523982580 wait complete. 2024-04-21T22:54:08.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 Processor -- start 2024-04-21T22:54:08.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.910+0000 7f6700f6d640 1 -- start start 2024-04-21T22:54:08.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f6700f6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc072460 0x7f66fc156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f6700f6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc152180 0x7f66fc0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f6700f6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc152560 0x7f66fc1f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f6700f6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc071c60 con 0x7f66fc152180 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f6700f6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc071980 con 0x7f66fc152560 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f6700f6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f66fc071f40 con 0x7f66fc072460 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc152180 0x7f66fc0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc152180 0x7f66fc0c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43160/0 (socket says 172.21.15.110:43160) 2024-04-21T22:54:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1770524632 learned_addr learned my addr 172.21.15.110:0/1770524632 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:08.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f66fad9d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc152560 0x7f66fc1f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.914+0000 7f66fa59c640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc072460 0x7f66fc156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.918+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc072460 msgr2=0x7f66fc156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:08.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.918+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc072460 0x7f66fc156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.918+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc152560 msgr2=0x7f66fc1f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:08.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.918+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc152560 0x7f66fc1f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.918+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1770524632 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc157430 con 0x7f66fc152180 2024-04-21T22:54:08.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.918+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc152180 0x7f66fc0c8880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c400 tx=0x7f66f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:08.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.922+0000 7f66eaffd640 1 -- 172.21.15.110:0/1770524632 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0017070 con 0x7f66fc152180 2024-04-21T22:54:08.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.922+0000 7f66eaffd640 1 -- 172.21.15.110:0/1770524632 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f0005cf0 con 0x7f66fc152180 2024-04-21T22:54:08.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.922+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc157b80 con 0x7f66fc152180 2024-04-21T22:54:08.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.922+0000 7f66eaffd640 1 -- 172.21.15.110:0/1770524632 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0007310 con 0x7f66fc152180 2024-04-21T22:54:08.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.922+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc14c670 con 0x7f66fc152180 2024-04-21T22:54:08.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 Processor -- start 2024-04-21T22:54:08.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 -- start start 2024-04-21T22:54:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc73180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc7e0d0 0x55f02fc804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc80a00 0x55f02fc82df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f02fa855e0 con 0x55f02fc72da0 2024-04-21T22:54:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f02fa0cc50 con 0x55f02fc80a00 2024-04-21T22:54:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.926+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x55f02fa815a0 con 0x55f02fc7e0d0 2024-04-21T22:54:08.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.930+0000 7f66fa59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc7e0d0 0x55f02fc804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.930+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc80a00 0x55f02fc82df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.930+0000 7f66fa59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc7e0d0 0x55f02fc804c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:49854/0 (socket says 172.21.15.110:49854) 2024-04-21T22:54:08.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.930+0000 7f66fa59c640 1 -- 172.21.15.110:0/3222671058 learned_addr learned my addr 172.21.15.110:0/3222671058 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:08.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.938+0000 7f66fa59c640 1 -- 172.21.15.110:0/3222671058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc80a00 msgr2=0x55f02fc82df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:08.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.938+0000 7f66fa59c640 1 --2- 172.21.15.110:0/3222671058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc80a00 0x55f02fc82df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.938+0000 7f66fa59c640 1 -- 172.21.15.110:0/3222671058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 msgr2=0x55f02fc73180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:08.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.938+0000 7f66fa59c640 1 --2- 172.21.15.110:0/3222671058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.938+0000 7f66fa59c640 1 -- 172.21.15.110:0/3222671058 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f02fa0ad10 con 0x55f02fc7e0d0 2024-04-21T22:54:08.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.942+0000 7f66fa59c640 1 --2- 172.21.15.110:0/3222671058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc7e0d0 0x55f02fc804c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009c70 tx=0x7f66ec011690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0ddc8d7dde5fd2c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:08.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.946+0000 7f66eaffd640 1 -- 172.21.15.110:0/1770524632 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66f001a070 con 0x7f66fc152180 2024-04-21T22:54:08.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.946+0000 7f66eaffd640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f66dc067940 0x7f66dc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.946+0000 7f66fad9d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f66dc067940 0x7f66dc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.950+0000 7f66fad9d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f66dc067940 0x7f66dc069e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f66f40b1000 tx=0x7f66f4004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:08.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.950+0000 7f66eaffd640 1 -- 172.21.15.110:0/1770524632 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f66f00539a0 con 0x7f66fc152180 2024-04-21T22:54:08.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f66dbfff640 1 -- 172.21.15.110:0/3222671058 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec014440 con 0x55f02fc7e0d0 2024-04-21T22:54:08.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f66dbfff640 1 -- 172.21.15.110:0/3222671058 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ec0145e0 con 0x55f02fc7e0d0 2024-04-21T22:54:08.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f66dbfff640 1 -- 172.21.15.110:0/3222671058 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0149d0 con 0x55f02fc7e0d0 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- 172.21.15.110:0/3222671058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc7e0d0 msgr2=0x55f02fc804c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 --2- 172.21.15.110:0/3222671058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc7e0d0 0x55f02fc804c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009c70 tx=0x7f66ec011690 comp rx=0 tx=0).stop 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- 172.21.15.110:0/3222671058 shutdown_connections 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 --2- 172.21.15.110:0/3222671058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc80a00 0x55f02fc82df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 --2- 172.21.15.110:0/3222671058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc7e0d0 0x55f02fc804c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 --2- 172.21.15.110:0/3222671058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc73180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- 172.21.15.110:0/3222671058 >> 172.21.15.110:0/3222671058 conn(0x55f02fc73c10 msgr2=0x55f02fc76000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- 172.21.15.110:0/3222671058 shutdown_connections 2024-04-21T22:54:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- 172.21.15.110:0/3222671058 wait complete. 2024-04-21T22:54:08.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- start start 2024-04-21T22:54:08.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 Processor -- start 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc7ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc7b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f02fa3f520 con 0x55f02fc72da0 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f02fa848f0 con 0x55f02fc7e0d0 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x55f02fa52340 con 0x55f02fc80a00 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.954+0000 7f67040e6000 10 client.0 _ll_register_callbacks cb 0x55f02fc225c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:54:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc7ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc7ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43172/0 (socket says 172.21.15.110:43172) 2024-04-21T22:54:08.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 -- 172.21.15.110:0/88980441 learned_addr learned my addr 172.21.15.110:0/88980441 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:08.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc7b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fad9d640 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:08.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 -- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 msgr2=0x55f02fc7b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:08.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 -- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 msgr2=0x55f02fc7b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:08.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc7b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:08.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.958+0000 7f66fa59c640 1 -- 172.21.15.110:0/88980441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f02fa1d7b0 con 0x55f02fc72da0 2024-04-21T22:54:08.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.962+0000 7f66fa59c640 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc7ad50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55f02fb54910 tx=0x7f66ec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8198d04ea8c6b2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:08.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.962+0000 7f66d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-21T22:54:08.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.966+0000 7f66d97fa640 1 -- 172.21.15.110:0/88980441 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec02c060 con 0x55f02fc72da0 2024-04-21T22:54:08.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.966+0000 7f66d97fa640 1 -- 172.21.15.110:0/88980441 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f66ec004230 con 0x55f02fc72da0 2024-04-21T22:54:08.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.966+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66ec0145e0 con 0x55f02fc72da0 2024-04-21T22:54:08.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.970+0000 7f66d97fa640 1 -- 172.21.15.110:0/88980441 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f66ec014440 con 0x55f02fc72da0 2024-04-21T22:54:08.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.970+0000 7f67040e6000 10 client.4539 fetch_fsmap learned FSMap version 9 2024-04-21T22:54:08.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.970+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f02fa0cea0 con 0x55f02fc72da0 2024-04-21T22:54:08.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f66d97fa640 1 -- 172.21.15.110:0/88980441 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ec0145e0 con 0x55f02fc72da0 2024-04-21T22:54:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f66d97fa640 1 -- 172.21.15.110:0/88980441 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 9) ==== 4704+0+0 (secure 0 0 0) 0x7f66ec003620 con 0x55f02fc72da0 2024-04-21T22:54:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f67040e6000 10 client.4539 fetch_fsmap finished waiting for FSMap version 9 2024-04-21T22:54:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f67040e6000 10 client.4539 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-21T22:54:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f67040e6000 20 client.4539 populate_metadata read hostname 'smithi110' 2024-04-21T22:54:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f67040e6000 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fc7c1e0 0x55f02fc8e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f67040e6000 4 client.4539 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:54:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.974+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 --> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f02fa20ab0 con 0x55f02fc7c1e0 2024-04-21T22:54:08.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:08.982+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fc7c1e0 0x55f02fc8e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.082+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fc7c1e0 0x55f02fc8e150 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7571828b08d122b server_cookie=29ecd8f0517a33ad in_seq=0 out_seq=0 2024-04-21T22:54:09.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.082+0000 7f66d97fa640 10 client.4539 ms_handle_connect on v2:172.21.15.110:6836/1034856927 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f66d97fa640 1 -- 172.21.15.110:0/88980441 <== mds.0 v2:172.21.15.110:6836/1034856927 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f02fa20ab0 con 0x55f02fc7c1e0 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f66d97fa640 10 client.4539 handle_command_reply: tid=0 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 client.4539 shutdown 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 msgr2=0x55f02fc7ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc7ad50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55f02fb54910 tx=0x7f66ec004740 comp rx=0 tx=0).stop 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 shutdown_connections 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fc7c1e0 0x55f02fc8e150 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc7b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f66d97fa640 0 client.4539 ms_handle_reset on v2:172.21.15.110:6836/1034856927 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 --2- 172.21.15.110:0/88980441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc7ad50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 >> 172.21.15.110:0/88980441 conn(0x55f02fc73c10 msgr2=0x55f02fc76000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 shutdown_connections 2024-04-21T22:54:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 1 -- 172.21.15.110:0/88980441 wait complete. 2024-04-21T22:54:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.302+0000 7f67040e6000 20 client.4539 trim_cache size 0 max 16384 2024-04-21T22:54:09.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 Processor -- start 2024-04-21T22:54:09.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 -- start start 2024-04-21T22:54:09.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc72da0 0x55f02fc91180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc7e0d0 0x55f02fc916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc1e59c0 con 0x55f02fc7e0d0 2024-04-21T22:54:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc1fbe10 con 0x55f02fc72da0 2024-04-21T22:54:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.350+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f66fc1e6010 con 0x55f02fc80a00 2024-04-21T22:54:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc7e0d0 0x55f02fc916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc7e0d0 0x55f02fc916c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48826/0 (socket says 172.21.15.110:48826) 2024-04-21T22:54:09.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66fad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 -- 172.21.15.110:0/75711308 learned_addr learned my addr 172.21.15.110:0/75711308 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:09.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66fa59c640 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc72da0 0x55f02fc91180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 -- 172.21.15.110:0/75711308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 msgr2=0x55f02fc7e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:09.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 -- 172.21.15.110:0/75711308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc72da0 msgr2=0x55f02fc91180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:09.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc72da0 0x55f02fc91180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.354+0000 7f66f9d9b640 1 -- 172.21.15.110:0/75711308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f02fa0de80 con 0x55f02fc7e0d0 2024-04-21T22:54:09.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.358+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc7e0d0 0x55f02fc916c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66f0055600 tx=0x7f66f005c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d585c9e32f24e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:09.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f66db7fe640 1 -- 172.21.15.110:0/75711308 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0051f70 con 0x55f02fc7e0d0 2024-04-21T22:54:09.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f66db7fe640 1 -- 172.21.15.110:0/75711308 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00074b0 con 0x55f02fc7e0d0 2024-04-21T22:54:09.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f66db7fe640 1 -- 172.21.15.110:0/75711308 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0052110 con 0x55f02fc7e0d0 2024-04-21T22:54:09.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 -- 172.21.15.110:0/75711308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc7e0d0 msgr2=0x55f02fc916c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc7e0d0 0x55f02fc916c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66f0055600 tx=0x7f66f005c040 comp rx=0 tx=0).stop 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 -- 172.21.15.110:0/75711308 shutdown_connections 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc7e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc7e0d0 0x55f02fc916c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 --2- 172.21.15.110:0/75711308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc72da0 0x55f02fc91180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 -- 172.21.15.110:0/75711308 >> 172.21.15.110:0/75711308 conn(0x55f02fc73c10 msgr2=0x55f02fc7ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 -- 172.21.15.110:0/75711308 shutdown_connections 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 -- 172.21.15.110:0/75711308 wait complete. 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 -- start start 2024-04-21T22:54:09.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.366+0000 7f67040e6000 1 Processor -- start 2024-04-21T22:54:09.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f67040e6000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc90860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc91110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f67040e6000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc91650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f67040e6000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f02fa2b810 con 0x55f02fc72da0 2024-04-21T22:54:09.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc1e6660 con 0x55f02fc7e0d0 2024-04-21T22:54:09.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f67040e6000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x55f02fa8c1f0 con 0x55f02fc80a00 2024-04-21T22:54:09.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f67040e6000 10 client.0 _ll_register_callbacks cb 0x7f66f0015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:54:09.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f66fad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc91650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc91110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc91110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:46506/0 (socket says 172.21.15.110:46506) 2024-04-21T22:54:09.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.370+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1592392342 learned_addr learned my addr 172.21.15.110:0/1592392342 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:09.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.378+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1592392342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 msgr2=0x55f02fc91650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:09.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.378+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc91650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.378+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1592392342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 msgr2=0x55f02fc90860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:09.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.378+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc90860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.378+0000 7f66f9d9b640 1 -- 172.21.15.110:0/1592392342 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f02fa52760 con 0x55f02fc7e0d0 2024-04-21T22:54:09.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.386+0000 7f66f9d9b640 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc91110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66f0051d60 tx=0x7f66f0083810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22a13e10859ac93 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:09.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.386+0000 7f66d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-21T22:54:09.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.394+0000 7f66d97fa640 1 -- 172.21.15.110:0/1592392342 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0051f70 con 0x55f02fc7e0d0 2024-04-21T22:54:09.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.394+0000 7f66d97fa640 1 -- 172.21.15.110:0/1592392342 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f66f0056b80 con 0x55f02fc7e0d0 2024-04-21T22:54:09.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.394+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66f00074b0 con 0x55f02fc7e0d0 2024-04-21T22:54:09.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.402+0000 7f66d97fa640 1 -- 172.21.15.110:0/1592392342 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f66f0052110 con 0x55f02fc7e0d0 2024-04-21T22:54:09.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.402+0000 7f67040e6000 10 client.4522 fetch_fsmap learned FSMap version 9 2024-04-21T22:54:09.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.402+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f02fade9e0 con 0x55f02fc7e0d0 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f66d97fa640 1 -- 172.21.15.110:0/1592392342 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00074b0 con 0x55f02fc7e0d0 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f66d97fa640 1 -- 172.21.15.110:0/1592392342 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 9) ==== 4704+0+0 (secure 0 0 0) 0x7f66f0069ce0 con 0x55f02fc7e0d0 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f67040e6000 10 client.4522 fetch_fsmap finished waiting for FSMap version 9 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f67040e6000 10 client.4522 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f67040e6000 20 client.4522 populate_metadata read hostname 'smithi110' 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f67040e6000 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fcae160 0x55f02fcae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f67040e6000 4 client.4522 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:54:09.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 --> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] -- command(tid 0: {"prefix": "status"}) -- 0x55f02fa92b20 con 0x55f02fcae160 2024-04-21T22:54:09.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.438+0000 7f66fa59c640 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fcae160 0x55f02fcae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.446+0000 7f66fa59c640 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fcae160 0x55f02fcae540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b24624d0ed205b78 server_cookie=7f7a9c359762949e in_seq=0 out_seq=0 2024-04-21T22:54:09.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.446+0000 7f66d97fa640 10 client.4522 ms_handle_connect on v2:172.21.15.110:6836/1034856927 2024-04-21T22:54:09.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f66d97fa640 1 -- 172.21.15.110:0/1592392342 <== mds.0 v2:172.21.15.110:6836/1034856927 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55f02fa92b20 con 0x55f02fcae160 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f66d97fa640 10 client.4522 handle_command_reply: tid=0 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 client.4522 shutdown 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 msgr2=0x55f02fc91110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc91110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66f0051d60 tx=0x7f66f0083810 comp rx=0 tx=0).stop 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 shutdown_connections 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.110:6836/1034856927,v1:172.21.15.110:6837/1034856927] conn(0x55f02fcae160 0x55f02fcae540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f02fc80a00 0x55f02fc91650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f02fc7e0d0 0x55f02fc91110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f66d97fa640 0 client.4522 ms_handle_reset on v2:172.21.15.110:6836/1034856927 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 --2- 172.21.15.110:0/1592392342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f02fc72da0 0x55f02fc90860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 >> 172.21.15.110:0/1592392342 conn(0x55f02fc73c10 msgr2=0x55f02fc3bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 shutdown_connections 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 1 -- 172.21.15.110:0/1592392342 wait complete. 2024-04-21T22:54:09.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.474+0000 7f67040e6000 20 client.4522 trim_cache size 0 max 16384 2024-04-21T22:54:09.476 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-21T22:54:09.476 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "937714ee-3114-4e7a-bad0-9e54f3261824", 2024-04-21T22:54:09.476 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-04-21T22:54:09.476 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 4261, 2024-04-21T22:54:09.476 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-21T22:54:09.476 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-21T22:54:09.476 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-21T22:54:09.477 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 30.494288057999999, 2024-04-21T22:54:09.477 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 9, 2024-04-21T22:54:09.477 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 23, 2024-04-21T22:54:09.477 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 23, 2024-04-21T22:54:09.477 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 45.537951386000003 2024-04-21T22:54:09.477 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-21T22:54:09.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f66dc067940 msgr2=0x7f66dc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f66dc067940 0x7f66dc069e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f66f40b1000 tx=0x7f66f4004ac0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc152180 msgr2=0x7f66fc0c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc152180 0x7f66fc0c8880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c400 tx=0x7f66f000c8c0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 shutdown_connections 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f66dc067940 0x7f66dc069e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc152560 0x7f66fc1f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66fc152180 0x7f66fc0c8880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 --2- 172.21.15.110:0/1770524632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc072460 0x7f66fc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 >> 172.21.15.110:0/1770524632 conn(0x7f66fc0cb710 msgr2=0x7f66fc150220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 shutdown_connections 2024-04-21T22:54:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.478+0000 7f6700f6d640 1 -- 172.21.15.110:0/1770524632 wait complete. 2024-04-21T22:54:09.501 INFO:teuthology.run_tasks:Running task sequential... 2024-04-21T22:54:09.510 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-21T22:54:09.510 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-21T22:54:09.511 INFO:teuthology.task.print:Enabling mgr modules 2024-04-21T22:54:09.511 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-21T22:54:09.561 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-21T22:54:09.562 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-21T22:54:09.562 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-21T22:54:09.562 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-21T22:54:09.562 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:09.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:09.562 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-04-21T22:54:09.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:09.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-04-21T22:54:09.632 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-04-21T22:54:09.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:54:09.633 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-21T22:54:09.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-21T22:54:09.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.802+0000 7f8be64aa640 1 Processor -- start 2024-04-21T22:54:09.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.802+0000 7f8be64aa640 1 -- start start 2024-04-21T22:54:09.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8be64aa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8be0152180 0x7f8be00c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8be64aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be0158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8be64aa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be00c6110 con 0x7f8be0152560 2024-04-21T22:54:09.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8be64aa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8be01592e0 con 0x7f8be0152180 2024-04-21T22:54:09.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8be64aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8be00716c0 con 0x7f8be0072460 2024-04-21T22:54:09.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8bdffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8be0152180 0x7f8be00c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8be4a47640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be0158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8bdffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8be0152180 0x7f8be00c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48838/0 (socket says 172.21.15.110:48838) 2024-04-21T22:54:09.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.806+0000 7f8bdffff640 1 -- 172.21.15.110:0/2804886682 learned_addr learned my addr 172.21.15.110:0/2804886682 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:09.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.810+0000 7f8bdffff640 1 -- 172.21.15.110:0/2804886682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 msgr2=0x7f8be0158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:09.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.810+0000 7f8bdffff640 1 --2- 172.21.15.110:0/2804886682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be0158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.810+0000 7f8bdffff640 1 -- 172.21.15.110:0/2804886682 >> v1:172.21.15.110:6789/0 conn(0x7f8be0152560 legacy=0x7f8be006fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:54:09.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.810+0000 7f8bdffff640 1 -- 172.21.15.110:0/2804886682 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be00c63d0 con 0x7f8be0152180 2024-04-21T22:54:09.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.814+0000 7f8bdffff640 1 --2- 172.21.15.110:0/2804886682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be00c7490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8be0070270 tx=0x7f8bd401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4089286cd78ea6b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8bdeffd640 1 -- 172.21.15.110:0/2804886682 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40b5070 con 0x7f8be0152180 2024-04-21T22:54:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8bdeffd640 1 -- 172.21.15.110:0/2804886682 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd40a89b0 con 0x7f8be0152180 2024-04-21T22:54:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8bdeffd640 1 -- 172.21.15.110:0/2804886682 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40a8d80 con 0x7f8be0152180 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 -- 172.21.15.110:0/2804886682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 msgr2=0x7f8be00c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 --2- 172.21.15.110:0/2804886682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be00c7490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8be0070270 tx=0x7f8bd401ecf0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 -- 172.21.15.110:0/2804886682 shutdown_connections 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 --2- 172.21.15.110:0/2804886682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be0158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 --2- 172.21.15.110:0/2804886682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be00c7490 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 -- 172.21.15.110:0/2804886682 >> 172.21.15.110:0/2804886682 conn(0x7f8be00cb710 msgr2=0x7f8be00cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 -- 172.21.15.110:0/2804886682 shutdown_connections 2024-04-21T22:54:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 -- 172.21.15.110:0/2804886682 wait complete. 2024-04-21T22:54:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 Processor -- start 2024-04-21T22:54:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.822+0000 7f8be64aa640 1 -- start start 2024-04-21T22:54:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8be64aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be014b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8be64aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be0148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8be64aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8be0152560 0x7f8be01485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8be64aa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0071c60 con 0x7f8be0152180 2024-04-21T22:54:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8be64aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0071980 con 0x7f8be0152560 2024-04-21T22:54:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8be64aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8be0071f40 con 0x7f8be0072460 2024-04-21T22:54:09.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8bdf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be0148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8bdf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be0148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48848/0 (socket says 172.21.15.110:48848) 2024-04-21T22:54:09.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8bdf7fe640 1 -- 172.21.15.110:0/3830961477 learned_addr learned my addr 172.21.15.110:0/3830961477 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-21T22:54:09.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8bdffff640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be014b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.826+0000 7f8be4a47640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8be0152560 0x7f8be01485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:09.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.830+0000 7f8bdf7fe640 1 -- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 msgr2=0x7f8be014b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.830+0000 7f8bdf7fe640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be014b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.830+0000 7f8bdf7fe640 1 -- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8be0152560 msgr2=0x7f8be01485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:09.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.830+0000 7f8bdf7fe640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8be0152560 0x7f8be01485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:09.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.830+0000 7f8bdf7fe640 1 -- 172.21.15.110:0/3830961477 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be01579a0 con 0x7f8be0152180 2024-04-21T22:54:09.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.830+0000 7f8bdf7fe640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be0148060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b3f0 tx=0x7f8bd000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:09.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.834+0000 7f8bdcff9640 1 -- 172.21.15.110:0/3830961477 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0015020 con 0x7f8be0152180 2024-04-21T22:54:09.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.834+0000 7f8bdcff9640 1 -- 172.21.15.110:0/3830961477 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd0011830 con 0x7f8be0152180 2024-04-21T22:54:09.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.834+0000 7f8bdcff9640 1 -- 172.21.15.110:0/3830961477 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0011c00 con 0x7f8be0152180 2024-04-21T22:54:09.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.834+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be0153a20 con 0x7f8be0152180 2024-04-21T22:54:09.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.834+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be01ef1c0 con 0x7f8be0152180 2024-04-21T22:54:09.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:09.838+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be004f510 con 0x7f8be0152180 2024-04-21T22:54:10.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.122+0000 7f8bdcff9640 1 -- 172.21.15.110:0/3830961477 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8bd0018020 con 0x7f8be0152180 2024-04-21T22:54:10.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.122+0000 7f8bdcff9640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8bcc067940 0x7f8bcc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:54:10.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.122+0000 7f8bdffff640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8bcc067940 0x7f8bcc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:54:10.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.122+0000 7f8bdffff640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8bcc067940 0x7f8bcc069e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40b2000 tx=0x7f8bd40aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:54:10.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.158+0000 7f8bdcff9640 1 -- 172.21.15.110:0/3830961477 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8bd0054120 con 0x7f8be0152180 2024-04-21T22:54:10.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.158+0000 7f8bdcff9640 1 -- 172.21.15.110:0/3830961477 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f8bd001f030 con 0x7f8be0152180 2024-04-21T22:54:10.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.358+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8be01506a0 con 0x7f8be0152180 2024-04-21T22:54:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.366+0000 7f8bdcff9640 1 -- 172.21.15.110:0/3830961477 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+73 (secure 0 0 0) 0x7f8be01579a0 con 0x7f8be0152180 2024-04-21T22:54:10.366 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-21T22:54:10.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8bcc067940 msgr2=0x7f8bcc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:10.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8bcc067940 0x7f8bcc069e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40b2000 tx=0x7f8bd40aa070 comp rx=0 tx=0).stop 2024-04-21T22:54:10.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 msgr2=0x7f8be0148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:54:10.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be0148060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b3f0 tx=0x7f8bd000b8b0 comp rx=0 tx=0).stop 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 shutdown_connections 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8bcc067940 0x7f8bcc069e00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8be0152560 0x7f8be01485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be0152180 0x7f8be0148060 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b3f0 tx=0x7f8bd000b8b0 comp rx=0 tx=0).stop 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 --2- 172.21.15.110:0/3830961477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8be0072460 0x7f8be014b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 >> 172.21.15.110:0/3830961477 conn(0x7f8be00cb710 msgr2=0x7f8be00ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 shutdown_connections 2024-04-21T22:54:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10.370+0000 7f8be64aa640 1 -- 172.21.15.110:0/3830961477 wait complete. 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-21T22:54:10.384 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-21T22:54:10.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:10.385 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-04-21T22:54:10.390 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-21T22:54:10.390 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-21T22:54:10.390 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-21T22:54:10.391 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42121sec preferred_lft 42121sec 2024-04-21T22:54:10.392 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-04-21T22:54:10.392 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-21T22:54:10.392 INFO:teuthology.orchestra.run.smithi110.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-21T22:54:10.392 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 02:42:a3:26:71:ef brd ff:ff:ff:ff:ff:ff 2024-04-21T22:54:10.392 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-21T22:54:10.392 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-21T22:54:10.392 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-21T22:54:10.392 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:54:10.393 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-21T22:54:10.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-04-21T22:54:10.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-04-21T22:54:10.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-04-21T22:54:10.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-21T22:54:10.393 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-21T22:54:10.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:54:10.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:54:10.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:10.513 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-21T22:54:10.569 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-04-21T22:54:10.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:10.571 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-04-21T22:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-21T22:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-21T22:54:10.638 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:54:10.638 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-21T22:54:10.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-21T22:54:10.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-21T22:54:10.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-21T22:54:10.638 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-21T22:54:10.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:54:10.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:54:10.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:10.756 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-04-21T22:54:10.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:10.804 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-04-21T22:54:10.852 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:54:10.852 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-21T22:54:10.852 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:10.852 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-21T22:54:10.852 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-21T22:54:10.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:54:10.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:54:10.969 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-21T22:54:10.970 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-21T22:54:11.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:54:11.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:54:11.077 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:54:11.077 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-21T22:54:11.077 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-04-21T22:54:11.077 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-04-21T22:54:11.077 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-21T22:54:11.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:54:11.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:54:11.179 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-21T22:54:11.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T22:54:11.180 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:11.227 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-21T22:54:11.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T22:54:11.228 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:11.275 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-21T22:54:11.275 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:11.329 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:11.375 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:11.375 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:11.375 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:11.375 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:11.375 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:11.375 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:11.375 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:11.376 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:11.377 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:11.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:11.378 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:11.423 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-21T22:54:11.423 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-21T22:54:11.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:11.487 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:11.537 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:11.538 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:11.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:11.539 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:12.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:12.701 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:12.748 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:12.748 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:12.748 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:12.748 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:12.748 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:12.749 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:12.750 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:12.751 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:12.751 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:12.751 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:12.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:12.752 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:13.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:13.916 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:13.965 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:13.966 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:13.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:13.967 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:15.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:15.128 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:15.176 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:15.176 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:15.176 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:15.176 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:15.176 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:15.177 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:15.178 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:15.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:15.179 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:15.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:54:15.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:54:16.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:16.344 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:16.393 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:16.393 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:16.393 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:16.393 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:16.393 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:16.394 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:16.396 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:16.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:16.397 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:17.545 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:17.560 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:17.608 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:17.608 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:17.608 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:17.608 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:17.608 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:17.608 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:17.609 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:17.610 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:17.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:17.611 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:18.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:ceph-fuse[33652]: starting ceph client 2024-04-21T22:54:18.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:2024-04-21T22:54:17.930+0000 690c100 -1 init, newargv = 0x7e70230 newargc=15 2024-04-21T22:54:18.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:18.778 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:18.828 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:18.828 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:18.828 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:18.828 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:18.828 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:18.829 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:18.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:18.831 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:19.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:ceph-fuse[33652]: starting fuse 2024-04-21T22:54:19.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-21T22:54:19.997 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T22:54:20.045 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/run/lock 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-21T22:54:20.046 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/fs/nfsd 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T22:54:20.047 INFO:teuthology.orchestra.run.smithi110.stdout:/run/rpc_pipefs 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:54:20.048 INFO:teuthology.orchestra.run.smithi110.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:20.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:20.049 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-21T22:54:20.096 INFO:teuthology.orchestra.run.smithi110.stdout:44 2024-04-21T22:54:20.097 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-21T22:54:20.097 DEBUG:teuthology.orchestra.run.smithi110:> sudo stdin-killer -- python3 -c ' 2024-04-21T22:54:20.097 DEBUG:teuthology.orchestra.run.smithi110:> import glob 2024-04-21T22:54:20.097 DEBUG:teuthology.orchestra.run.smithi110:> import re 2024-04-21T22:54:20.097 DEBUG:teuthology.orchestra.run.smithi110:> import os 2024-04-21T22:54:20.097 DEBUG:teuthology.orchestra.run.smithi110:> import subprocess 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> def _find_admin_socket(client_name): 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> files = glob.glob(asok_path) 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> # Given a non-glob path, it better be there 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> if "*" not in asok_path: 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> assert(len(files) == 1) 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> return files[0] 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> for f in files: 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-21T22:54:20.098 DEBUG:teuthology.orchestra.run.smithi110:> contents = proc_f.read() 2024-04-21T22:54:20.099 DEBUG:teuthology.orchestra.run.smithi110:> if mountpoint in contents: 2024-04-21T22:54:20.099 DEBUG:teuthology.orchestra.run.smithi110:> return f 2024-04-21T22:54:20.099 DEBUG:teuthology.orchestra.run.smithi110:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-21T22:54:20.099 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-21T22:54:20.099 DEBUG:teuthology.orchestra.run.smithi110:> print(_find_admin_socket("client.0")) 2024-04-21T22:54:20.099 DEBUG:teuthology.orchestra.run.smithi110:> ' 2024-04-21T22:54:20.227 INFO:teuthology.orchestra.run.smithi110.stdout:/var/run/ceph/ceph-client.0.33652.asok 2024-04-21T22:54:20.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-21T22:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:54:20.239 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33652.asok 2024-04-21T22:54:20.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:20.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33652.asok status 2024-04-21T22:54:20.507 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-21T22:54:20.507 INFO:teuthology.orchestra.run.smithi110.stdout: "metadata": { 2024-04-21T22:54:20.507 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_sha1": "820a2f8ced66152ed3d765c31444b8076ea28c6b", 2024-04-21T22:54:20.508 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev)", 2024-04-21T22:54:20.508 INFO:teuthology.orchestra.run.smithi110.stdout: "entity_id": "0", 2024-04-21T22:54:20.508 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": "smithi110", 2024-04-21T22:54:20.508 INFO:teuthology.orchestra.run.smithi110.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-21T22:54:20.508 INFO:teuthology.orchestra.run.smithi110.stdout: "pid": "33652", 2024-04-21T22:54:20.508 INFO:teuthology.orchestra.run.smithi110.stdout: "root": "/" 2024-04-21T22:54:20.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_count": 0, 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_pinned_count": 0, 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 4551, 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "inst": { 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "name": { 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "client", 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "num": 4551 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-21T22:54:20.509 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-04-21T22:54:20.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-04-21T22:54:20.510 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-04-21T22:54:20.510 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 4161902929 2024-04-21T22:54:20.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-21T22:54:20.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-21T22:54:20.511 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-04-21T22:54:20.511 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-04-21T22:54:20.512 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-04-21T22:54:20.512 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 4161902929 2024-04-21T22:54:20.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-21T22:54:20.512 INFO:teuthology.orchestra.run.smithi110.stdout: "inst_str": "client.4551 172.21.15.110:0/4161902929", 2024-04-21T22:54:20.512 INFO:teuthology.orchestra.run.smithi110.stdout: "addr_str": "172.21.15.110:0/4161902929", 2024-04-21T22:54:20.513 INFO:teuthology.orchestra.run.smithi110.stdout: "inode_count": 1, 2024-04-21T22:54:20.513 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_epoch": 9, 2024-04-21T22:54:20.513 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch": 23, 2024-04-21T22:54:20.513 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch_barrier": 0, 2024-04-21T22:54:20.514 INFO:teuthology.orchestra.run.smithi110.stdout: "blocklisted": false, 2024-04-21T22:54:20.514 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs" 2024-04-21T22:54:20.514 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-21T22:54:20.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:20.521 DEBUG:teuthology.orchestra.run.smithi110:> stat --file-system '--printf=%T 2024-04-21T22:54:20.521 DEBUG:teuthology.orchestra.run.smithi110:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:20.692 INFO:teuthology.orchestra.run.smithi110.stdout:fuseblk 2024-04-21T22:54:20.692 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:20.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:54:20.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:20.874 INFO:teuthology.run_tasks:Running task workunit... 2024-04-21T22:54:20.888 INFO:tasks.workunit:Pulling workunits from ref 430e09df97c8fc7dc2b2ae424f68ed11366c540f 2024-04-21T22:54:20.889 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-21T22:54:20.889 INFO:tasks.workunit:timeout=6h 2024-04-21T22:54:20.889 INFO:tasks.workunit:cleanup=True 2024-04-21T22:54:20.889 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-21T22:54:20.932 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-21T22:54:20.932 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:54:20.932 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-21T22:54:20.932 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-21 22:53:39.289757427 +0000 2024-04-21T22:54:20.933 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-21 22:54:20.736102383 +0000 2024-04-21T22:54:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-04-21T22:54:20.933 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-21T22:54:20.933 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-21T22:54:21.827 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 430e09df97c8fc7dc2b2ae424f68ed11366c540f 2024-04-21T22:54:21.835 INFO:tasks.workunit.client.0.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-21T22:54:45.493 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:54:45.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:55:15.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:55:15.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr:Note: switching to '430e09df97c8fc7dc2b2ae424f68ed11366c540f'. 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-21T22:55:29.230 INFO:tasks.workunit.client.0.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr: git switch -c 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr:Or undo this operation with: 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr: git switch - 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-04-21T22:55:29.231 INFO:tasks.workunit.client.0.smithi110.stderr:HEAD is now at 430e09df97c Merge pull request #57017 from zdover23/wip-doc-2024-04-21-backport-56904-to-squid 2024-04-21T22:55:29.234 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-21T22:55:29.240 INFO:tasks.workunit.client.0.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-21T22:55:29.244 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-21T22:55:29.244 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-21T22:55:30.172 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-21T22:55:30.248 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-21T22:55:30.305 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-21T22:55:30.306 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-21T22:55:30.306 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-21T22:55:30.352 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-21T22:55:30.355 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-21T22:55:30.355 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-21T22:55:30.402 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-21T22:55:30.404 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-21T22:55:30.404 DEBUG:teuthology.orchestra.run.smithi110:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=430e09df97c8fc7dc2b2ae424f68ed11366c540f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-21T22:55:30.826 INFO:tasks.workunit.client.0.smithi110.stderr:+ mkdir -p fsstress 2024-04-21T22:55:31.029 INFO:tasks.workunit.client.0.smithi110.stderr:+ pushd fsstress 2024-04-21T22:55:31.075 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-21T22:55:31.075 INFO:tasks.workunit.client.0.smithi110.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-21T22:55:44.001 INFO:tasks.workunit.client.0.smithi110.stderr:+ tar xzf ltp-full.tgz 2024-04-21T22:55:45.829 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:55:45.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:56:16.077 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:56:16.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:56:46.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:56:46.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:57:16.262 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:57:16.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:57:46.368 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:57:46.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:58:16.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:58:16.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:58:46.689 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:58:46.692 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:59:16.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:59:16.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:59:46.836 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T22:59:46.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:00:16.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:00:16.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:00:46.978 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:00:46.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:01:17.197 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:01:17.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:01:44.842 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:09:25.099 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:44.938 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:09:25.195 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:45.123 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:09:25.320 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:45.221 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:09:25.418 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:45.247 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:09:25.445 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:45.340 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:09:25.537 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:45.402 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:09:25.659 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:45.808 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:09:26.005 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:45.822 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:09:26.019 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:01:47.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:01:47.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:02:17.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:02:17.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:02:47.666 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:02:47.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:03:17.878 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:03:17.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:03:47.933 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:03:47.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:04:18.061 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:04:18.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:04:30.343 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:12:10.600 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.396 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:12:10.594 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.401 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:12:10.597 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.405 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:12:10.604 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.408 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:12:10.606 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.413 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:12:10.671 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.572 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:12:10.769 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.610 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:12:10.867 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:30.663 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:12:10.861 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:04:48.195 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:04:48.198 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:05:18.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:05:18.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:05:48.578 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:05:48.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:06:18.708 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:06:18.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:06:48.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:06:48.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:07:18.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:07:18.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:07:48.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:07:48.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:08:19.061 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:08:19.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:08:38.868 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:16:19.126 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:38.875 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:16:19.133 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:38.987 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:16:19.185 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:38.989 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:16:19.187 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:38.990 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:16:19.189 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:38.995 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:16:19.193 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:39.027 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:16:19.285 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:39.102 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:16:19.300 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:39.143 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:16:19.342 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:08:49.159 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:08:49.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:09:19.311 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:09:19.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:09:49.561 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:09:49.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:10:08.004 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:17:48.262 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.007 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:17:48.265 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.066 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:17:48.324 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.104 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:17:48.301 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.117 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:17:48.314 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.123 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:17:48.319 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.141 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:17:48.337 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.206 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:17:48.402 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:08.228 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:17:48.424 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:10:19.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:10:19.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:10:49.679 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:10:49.682 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:11:19.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:11:19.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:11:50.066 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:11:50.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:12:20.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:12:20.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:12:47.185 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:20:27.442 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.191 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:20:27.448 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.277 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:20:27.535 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.299 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:20:27.494 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.302 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:20:27.498 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.303 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:20:27.499 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.308 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:20:27.504 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.432 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:20:27.627 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:47.432 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:20:27.628 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:12:50.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:12:50.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:13:20.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:13:20.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:13:50.442 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:13:50.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:14:20.555 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:14:20.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:14:50.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:14:50.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:15:20.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:15:20.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:15:50.839 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:15:50.843 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:16:21.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:16:21.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:16:51.207 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:16:51.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:17:20.652 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:25:00.908 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.655 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:25:00.912 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.768 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:25:00.963 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.782 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:25:00.977 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.791 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:25:00.986 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.797 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:25:00.993 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.802 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:25:01.059 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.963 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:25:01.158 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:20.990 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:25:01.185 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:17:21.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:17:21.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:17:51.376 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:17:51.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:18:21.522 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:18:21.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:18:31.080 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:26:11.336 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.094 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:26:11.351 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.138 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:26:11.394 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.210 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:26:11.403 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.210 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:26:11.403 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.215 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:26:11.409 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.216 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:26:11.410 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.269 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:26:11.463 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:31.284 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:26:11.478 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:18:51.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:18:51.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:19:21.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:19:21.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:19:51.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:19:51.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:20:22.102 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:20:22.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:20:52.246 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:20:52.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:21:02.387 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:28:42.643 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.418 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:28:42.675 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.426 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:28:42.617 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.433 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:28:42.624 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.433 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:28:42.625 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.447 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:28:42.639 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.559 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:28:42.816 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.583 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:28:42.775 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:02.588 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:28:42.780 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:21:22.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:21:22.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:21:52.414 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:21:52.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:22:22.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:22:22.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:22:52.566 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:22:52.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:23:22.700 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:23:22.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:23:52.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:23:52.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:24:22.939 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:24:22.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:24:53.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:24:53.072 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:25:10.665 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:32:50.921 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.679 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:32:50.935 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.725 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:32:50.914 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.726 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:32:50.915 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.740 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:32:50.929 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.746 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:32:50.935 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.916 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:32:51.105 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.949 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:32:51.206 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:10.950 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:32:51.140 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:23.157 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:25:23.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:25:43.654 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:33:23.910 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.668 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:33:23.925 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.749 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:33:24.005 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.766 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:33:23.954 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.781 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:33:23.969 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.785 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:33:23.974 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.786 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:33:23.975 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.835 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:33:24.023 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:43.850 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:33:24.036 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:25:53.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:25:53.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:26:23.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:26:23.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:26:53.501 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:26:53.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:27:23.578 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:27:23.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:27:53.734 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:27:53.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:28:23.854 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:28:23.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:28:53.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:28:53.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:29:18.399 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:36:58.655 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.415 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:36:58.671 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.445 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:36:58.634 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.451 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:36:58.640 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.461 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:36:58.650 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.462 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:36:58.651 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.571 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:36:58.827 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.619 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:36:58.808 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:18.740 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:36:58.929 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:29:24.013 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:29:24.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:29:54.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:29:54.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:30:24.256 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:30:24.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:30:54.327 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:30:54.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:31:24.382 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:31:24.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:31:54.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:31:54.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:32:24.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:32:24.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:32:54.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:32:54.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:33:24.945 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:33:24.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:33:26.083 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:41:06.340 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.101 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:41:06.359 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.148 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:41:06.339 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.165 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:41:06.356 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.170 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:41:06.362 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.182 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:41:06.373 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.287 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:41:06.544 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.355 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:41:06.546 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:26.406 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:41:06.598 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:33:55.075 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:33:55.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:34:02.284 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:41:42.541 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.342 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:41:42.599 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.386 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:41:42.644 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.405 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:41:42.597 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.407 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:41:42.598 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.408 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:41:42.599 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.410 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:41:42.601 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.453 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:41:42.644 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:02.460 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:41:42.651 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:34:25.210 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:34:25.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:34:55.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:34:55.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:35:17.841 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:42:58.098 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:17.848 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:42:58.106 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:17.908 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:42:58.165 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:17.963 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:42:58.156 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:17.970 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:42:58.162 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:17.971 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:42:58.163 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:17.973 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:42:58.166 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:18.034 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:42:58.227 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:18.049 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:42:58.241 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:35:25.419 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:35:25.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:35:55.490 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:35:55.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:36:25.599 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:36:25.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:36:55.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:36:55.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:37:25.769 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:37:25.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:37:32.297 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:45:12.555 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.309 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:45:12.567 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.329 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:45:12.522 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.335 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:45:12.529 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.340 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:45:12.533 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.345 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:45:12.539 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.430 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:45:12.689 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.459 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:45:12.653 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:32.464 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:45:12.658 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:37:55.902 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:37:55.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:38:25.974 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:38:25.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:38:56.072 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:38:56.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:39:26.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:39:26.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:39:56.285 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:39:56.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:40:26.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:40:26.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:40:56.406 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:40:56.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:41:26.544 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:41:26.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:41:41.557 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:49:21.816 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.568 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:49:21.827 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.596 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:49:21.791 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.598 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:49:21.793 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.604 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:49:21.799 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.617 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:49:21.812 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.756 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:49:22.016 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.784 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:49:21.979 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:41.803 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:49:21.998 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:41:56.598 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:41:56.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:42:08.593 INFO:tasks.workunit.client.0.smithi110.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-21T23:42:08.992 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-21T23:42:08.993 INFO:tasks.workunit.client.0.smithi110.stderr:+ make 2024-04-21T23:42:11.860 INFO:tasks.workunit.client.0.smithi110.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-21T23:42:20.046 INFO:tasks.workunit.client.0.smithi110.stderr:++ readlink -f fsstress 2024-04-21T23:42:20.084 INFO:tasks.workunit.client.0.smithi110.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-21T23:42:20.084 INFO:tasks.workunit.client.0.smithi110.stderr:+ popd 2024-04-21T23:42:20.134 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-21T23:42:20.134 INFO:tasks.workunit.client.0.smithi110.stderr:+ popd 2024-04-21T23:42:20.164 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-21T23:42:20.165 INFO:tasks.workunit.client.0.smithi110.stderr:++ mktemp -d -p . 2024-04-21T23:42:20.261 INFO:tasks.workunit.client.0.smithi110.stderr:+ T=./tmp.LWrKj73LHG 2024-04-21T23:42:20.261 INFO:tasks.workunit.client.0.smithi110.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.LWrKj73LHG -l 1 -n 1000 -p 10 -v 2024-04-21T23:42:20.524 INFO:tasks.workunit.client.0.smithi110.stdout:seed = 1714272758 2024-04-21T23:42:20.827 INFO:tasks.workunit.client.0.smithi110.stdout:0/0: write - no filename 2024-04-21T23:42:20.827 INFO:tasks.workunit.client.0.smithi110.stdout:0/1: dwrite - no filename 2024-04-21T23:42:20.827 INFO:tasks.workunit.client.0.smithi110.stdout:0/2: dwrite - no filename 2024-04-21T23:42:20.976 INFO:tasks.workunit.client.0.smithi110.stdout:1/0: link - no file 2024-04-21T23:42:20.976 INFO:tasks.workunit.client.0.smithi110.stdout:1/1: fsync - no filename 2024-04-21T23:42:21.023 INFO:tasks.workunit.client.0.smithi110.stdout:0/3: mkdir d0 0 2024-04-21T23:42:21.023 INFO:tasks.workunit.client.0.smithi110.stdout:0/4: dread - no filename 2024-04-21T23:42:21.206 INFO:tasks.workunit.client.0.smithi110.stdout:1/2: creat f0 x:0 0 0 2024-04-21T23:42:21.240 INFO:tasks.workunit.client.0.smithi110.stdout:3/0: dread - no filename 2024-04-21T23:42:21.240 INFO:tasks.workunit.client.0.smithi110.stdout:3/1: dwrite - no filename 2024-04-21T23:42:21.240 INFO:tasks.workunit.client.0.smithi110.stdout:3/2: stat - no entries 2024-04-21T23:42:21.244 INFO:tasks.workunit.client.0.smithi110.stdout:3/3: chown . 240328035 1 2024-04-21T23:42:21.272 INFO:tasks.workunit.client.0.smithi110.stdout:0/5: symlink d0/l1 0 2024-04-21T23:42:21.272 INFO:tasks.workunit.client.0.smithi110.stdout:0/6: write - no filename 2024-04-21T23:42:21.272 INFO:tasks.workunit.client.0.smithi110.stdout:0/7: dread - no filename 2024-04-21T23:42:21.287 INFO:tasks.workunit.client.0.smithi110.stdout:0/8: chown d0/l1 6634 1 2024-04-21T23:42:21.288 INFO:tasks.workunit.client.0.smithi110.stdout:0/9: write - no filename 2024-04-21T23:42:21.288 INFO:tasks.workunit.client.0.smithi110.stdout:0/10: dread - no filename 2024-04-21T23:42:21.297 INFO:tasks.workunit.client.0.smithi110.stdout:0/11: chown d0/l1 58300 1 2024-04-21T23:42:21.304 INFO:tasks.workunit.client.0.smithi110.stdout:0/12: stat d0/l1 0 2024-04-21T23:42:21.304 INFO:tasks.workunit.client.0.smithi110.stdout:0/13: dread - no filename 2024-04-21T23:42:21.403 INFO:tasks.workunit.client.0.smithi110.stdout:2/0: creat f0 x:0 0 0 2024-04-21T23:42:21.406 INFO:tasks.workunit.client.0.smithi110.stdout:4/0: write - no filename 2024-04-21T23:42:21.406 INFO:tasks.workunit.client.0.smithi110.stdout:4/1: link - no file 2024-04-21T23:42:21.425 INFO:tasks.workunit.client.0.smithi110.stdout:2/1: write f0 [794751,2250] 0 2024-04-21T23:42:21.428 INFO:tasks.workunit.client.0.smithi110.stdout:2/2: readlink - no filename 2024-04-21T23:42:21.453 INFO:tasks.workunit.client.0.smithi110.stdout:0/14: rmdir d0 39 2024-04-21T23:42:21.531 INFO:tasks.workunit.client.0.smithi110.stdout:5/0: link - no file 2024-04-21T23:42:21.531 INFO:tasks.workunit.client.0.smithi110.stdout:5/1: truncate - no filename 2024-04-21T23:42:21.531 INFO:tasks.workunit.client.0.smithi110.stdout:5/2: dwrite - no filename 2024-04-21T23:42:21.552 INFO:tasks.workunit.client.0.smithi110.stdout:4/2: creat f0 x:0 0 0 2024-04-21T23:42:21.600 INFO:tasks.workunit.client.0.smithi110.stdout:3/4: sync 2024-04-21T23:42:21.602 INFO:tasks.workunit.client.0.smithi110.stdout:3/5: chown . 103163 1 2024-04-21T23:42:21.602 INFO:tasks.workunit.client.0.smithi110.stdout:3/6: truncate - no filename 2024-04-21T23:42:21.602 INFO:tasks.workunit.client.0.smithi110.stdout:3/7: read - no filename 2024-04-21T23:42:22.161 INFO:tasks.workunit.client.0.smithi110.stdout:6/0: dwrite - no filename 2024-04-21T23:42:22.164 INFO:tasks.workunit.client.0.smithi110.stdout:6/1: chown . 8 1 2024-04-21T23:42:22.325 INFO:tasks.workunit.client.0.smithi110.stdout:4/3: mkdir d1 0 2024-04-21T23:42:22.327 INFO:tasks.workunit.client.0.smithi110.stdout:1/3: getdents . 0 2024-04-21T23:42:22.346 INFO:tasks.workunit.client.0.smithi110.stdout:0/15: symlink d0/l2 0 2024-04-21T23:42:22.473 INFO:tasks.workunit.client.0.smithi110.stdout:4/4: write f0 [968330,93261] 0 2024-04-21T23:42:22.508 INFO:tasks.workunit.client.0.smithi110.stdout:2/3: link f0 f1 0 2024-04-21T23:42:22.523 INFO:tasks.workunit.client.0.smithi110.stdout:5/3: getdents . 0 2024-04-21T23:42:22.523 INFO:tasks.workunit.client.0.smithi110.stdout:5/4: fsync - no filename 2024-04-21T23:42:22.523 INFO:tasks.workunit.client.0.smithi110.stdout:5/5: write - no filename 2024-04-21T23:42:22.523 INFO:tasks.workunit.client.0.smithi110.stdout:3/8: creat f0 x:0 0 0 2024-04-21T23:42:22.579 INFO:tasks.workunit.client.0.smithi110.stdout:3/9: write f0 [846330,125653] 0 2024-04-21T23:42:22.601 INFO:tasks.workunit.client.0.smithi110.stdout:1/4: mkdir d1 0 2024-04-21T23:42:22.607 INFO:tasks.workunit.client.0.smithi110.stdout:0/16: symlink d0/l3 0 2024-04-21T23:42:22.607 INFO:tasks.workunit.client.0.smithi110.stdout:0/17: dread - no filename 2024-04-21T23:42:22.668 INFO:tasks.workunit.client.0.smithi110.stdout:1/5: chown d1 31 1 2024-04-21T23:42:22.809 INFO:tasks.workunit.client.0.smithi110.stdout:2/4: symlink l2 0 2024-04-21T23:42:22.809 INFO:tasks.workunit.client.0.smithi110.stdout:6/2: creat f0 x:0 0 0 2024-04-21T23:42:22.813 INFO:tasks.workunit.client.0.smithi110.stdout:8/0: truncate - no filename 2024-04-21T23:42:22.813 INFO:tasks.workunit.client.0.smithi110.stdout:8/1: dwrite - no filename 2024-04-21T23:42:22.813 INFO:tasks.workunit.client.0.smithi110.stdout:8/2: rmdir - no directory 2024-04-21T23:42:22.875 INFO:tasks.workunit.client.0.smithi110.stdout:7/0: creat f0 x:0 0 0 2024-04-21T23:42:22.909 INFO:tasks.workunit.client.0.smithi110.stdout:3/10: creat f1 x:0 0 0 2024-04-21T23:42:23.119 INFO:tasks.workunit.client.0.smithi110.stdout:4/5: link f0 d1/f2 0 2024-04-21T23:42:23.155 INFO:tasks.workunit.client.0.smithi110.stdout:5/6: creat f0 x:0 0 0 2024-04-21T23:42:23.218 INFO:tasks.workunit.client.0.smithi110.stdout:6/3: creat f1 x:0 0 0 2024-04-21T23:42:23.274 INFO:tasks.workunit.client.0.smithi110.stdout:3/11: truncate f1 61299 0 2024-04-21T23:42:23.336 INFO:tasks.workunit.client.0.smithi110.stdout:6/4: stat f0 0 2024-04-21T23:42:23.381 INFO:tasks.workunit.client.0.smithi110.stdout:2/5: write f0 [823003,95971] 0 2024-04-21T23:42:23.491 INFO:tasks.workunit.client.0.smithi110.stdout:5/7: chown f0 6214 1 2024-04-21T23:42:23.736 INFO:tasks.workunit.client.0.smithi110.stdout:1/6: dwrite f0 [0,4194304] 0 2024-04-21T23:42:23.769 INFO:tasks.workunit.client.0.smithi110.stdout:8/3: creat f0 x:0 0 0 2024-04-21T23:42:24.023 INFO:tasks.workunit.client.0.smithi110.stdout:6/5: symlink l2 0 2024-04-21T23:42:24.027 INFO:tasks.workunit.client.0.smithi110.stdout:1/7: stat d1 0 2024-04-21T23:42:24.053 INFO:tasks.workunit.client.0.smithi110.stdout:2/6: symlink l3 0 2024-04-21T23:42:24.095 INFO:tasks.workunit.client.0.smithi110.stdout:9/0: symlink l0 0 2024-04-21T23:42:24.095 INFO:tasks.workunit.client.0.smithi110.stdout:9/1: dread - no filename 2024-04-21T23:42:24.196 INFO:tasks.workunit.client.0.smithi110.stdout:7/1: dwrite f0 [0,4194304] 0 2024-04-21T23:42:24.387 INFO:tasks.workunit.client.0.smithi110.stdout:1/8: read f0 [4093540,79715] 0 2024-04-21T23:42:24.391 INFO:tasks.workunit.client.0.smithi110.stdout:8/4: unlink f0 0 2024-04-21T23:42:24.391 INFO:tasks.workunit.client.0.smithi110.stdout:8/5: read - no filename 2024-04-21T23:42:24.523 INFO:tasks.workunit.client.0.smithi110.stdout:0/18: getdents d0 0 2024-04-21T23:42:24.526 INFO:tasks.workunit.client.0.smithi110.stdout:9/2: chown l0 116395989 1 2024-04-21T23:42:24.554 INFO:tasks.workunit.client.0.smithi110.stdout:4/6: truncate d1/f2 853455 0 2024-04-21T23:42:24.606 INFO:tasks.workunit.client.0.smithi110.stdout:6/6: creat f3 x:0 0 0 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/6: sync 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/7: dwrite - no filename 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/8: rename - no filename 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/9: rename - no filename 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/10: dwrite - no filename 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/11: dwrite - no filename 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/12: dread - no filename 2024-04-21T23:42:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/13: rename - no filename 2024-04-21T23:42:24.636 INFO:tasks.workunit.client.0.smithi110.stdout:2/7: mknod c4 0 2024-04-21T23:42:24.646 INFO:tasks.workunit.client.0.smithi110.stdout:0/19: sync 2024-04-21T23:42:24.648 INFO:tasks.workunit.client.0.smithi110.stdout:7/2: creat f1 x:0 0 0 2024-04-21T23:42:24.686 INFO:tasks.workunit.client.0.smithi110.stdout:1/9: write f0 [2343067,24606] 0 2024-04-21T23:42:24.847 INFO:tasks.workunit.client.0.smithi110.stdout:6/7: write f0 [669546,49168] 0 2024-04-21T23:42:24.886 INFO:tasks.workunit.client.0.smithi110.stdout:3/12: dwrite f0 [0,4194304] 0 2024-04-21T23:42:24.998 INFO:tasks.workunit.client.0.smithi110.stdout:7/3: write f1 [290540,104029] 0 2024-04-21T23:42:25.019 INFO:tasks.workunit.client.0.smithi110.stdout:2/8: chown f1 1555 1 2024-04-21T23:42:25.076 INFO:tasks.workunit.client.0.smithi110.stdout:9/3: mkdir d1 0 2024-04-21T23:42:25.076 INFO:tasks.workunit.client.0.smithi110.stdout:9/4: truncate - no filename 2024-04-21T23:42:25.142 INFO:tasks.workunit.client.0.smithi110.stdout:7/4: read f0 [1386555,40150] 0 2024-04-21T23:42:25.208 INFO:tasks.workunit.client.0.smithi110.stdout:1/10: write f0 [349584,3034] 0 2024-04-21T23:42:25.239 INFO:tasks.workunit.client.0.smithi110.stdout:2/9: chown f0 7 1 2024-04-21T23:42:25.320 INFO:tasks.workunit.client.0.smithi110.stdout:5/8: getdents . 0 2024-04-21T23:42:25.410 INFO:tasks.workunit.client.0.smithi110.stdout:1/11: chown d1 312755400 1 2024-04-21T23:42:25.430 INFO:tasks.workunit.client.0.smithi110.stdout:6/8: creat f4 x:0 0 0 2024-04-21T23:42:25.454 INFO:tasks.workunit.client.0.smithi110.stdout:0/20: rename d0/l2 to d0/l4 0 2024-04-21T23:42:25.599 INFO:tasks.workunit.client.0.smithi110.stdout:2/10: write f0 [1642873,55846] 0 2024-04-21T23:42:25.614 INFO:tasks.workunit.client.0.smithi110.stdout:0/21: stat d0 0 2024-04-21T23:42:25.783 INFO:tasks.workunit.client.0.smithi110.stdout:6/9: truncate f4 178449 0 2024-04-21T23:42:25.871 INFO:tasks.workunit.client.0.smithi110.stdout:3/13: dwrite f1 [0,4194304] 0 2024-04-21T23:42:26.056 INFO:tasks.workunit.client.0.smithi110.stdout:9/5: symlink d1/l2 0 2024-04-21T23:42:26.089 INFO:tasks.workunit.client.0.smithi110.stdout:5/9: symlink l1 0 2024-04-21T23:42:26.089 INFO:tasks.workunit.client.0.smithi110.stdout:6/10: chown f4 1954 1 2024-04-21T23:42:26.168 INFO:tasks.workunit.client.0.smithi110.stdout:8/14: getdents . 0 2024-04-21T23:42:26.228 INFO:tasks.workunit.client.0.smithi110.stdout:7/5: dwrite f1 [0,4194304] 0 2024-04-21T23:42:26.372 INFO:tasks.workunit.client.0.smithi110.stdout:3/14: mknod c2 0 2024-04-21T23:42:26.430 INFO:tasks.workunit.client.0.smithi110.stdout:1/12: mkdir d1/d2 0 2024-04-21T23:42:26.548 INFO:tasks.workunit.client.0.smithi110.stdout:8/15: mknod c1 0 2024-04-21T23:42:26.560 INFO:tasks.workunit.client.0.smithi110.stdout:9/6: symlink d1/l3 0 2024-04-21T23:42:26.561 INFO:tasks.workunit.client.0.smithi110.stdout:9/7: dread - no filename 2024-04-21T23:42:26.690 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:42:26.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:42:26.757 INFO:tasks.workunit.client.0.smithi110.stdout:3/15: unlink c2 0 2024-04-21T23:42:26.782 INFO:tasks.workunit.client.0.smithi110.stdout:1/13: unlink f0 0 2024-04-21T23:42:26.828 INFO:tasks.workunit.client.0.smithi110.stdout:2/11: truncate f1 411975 0 2024-04-21T23:42:26.901 INFO:tasks.workunit.client.0.smithi110.stdout:5/10: dwrite f0 [0,4194304] 0 2024-04-21T23:42:27.038 INFO:tasks.workunit.client.0.smithi110.stdout:8/16: unlink c1 0 2024-04-21T23:42:27.038 INFO:tasks.workunit.client.0.smithi110.stdout:8/17: truncate - no filename 2024-04-21T23:42:27.039 INFO:tasks.workunit.client.0.smithi110.stdout:8/18: dwrite - no filename 2024-04-21T23:42:27.045 INFO:tasks.workunit.client.0.smithi110.stdout:4/7: dread d1/f2 [0,4194304] 0 2024-04-21T23:42:27.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/8: mkdir d1/d4 0 2024-04-21T23:42:27.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/9: truncate - no filename 2024-04-21T23:42:27.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/10: write - no filename 2024-04-21T23:42:27.087 INFO:tasks.workunit.client.0.smithi110.stdout:0/22: getdents d0 0 2024-04-21T23:42:27.087 INFO:tasks.workunit.client.0.smithi110.stdout:0/23: dwrite - no filename 2024-04-21T23:42:27.204 INFO:tasks.workunit.client.0.smithi110.stdout:0/24: readlink d0/l1 0 2024-04-21T23:42:27.204 INFO:tasks.workunit.client.0.smithi110.stdout:0/25: fsync - no filename 2024-04-21T23:42:27.273 INFO:tasks.workunit.client.0.smithi110.stdout:9/11: chown d1/l3 108742 1 2024-04-21T23:42:27.273 INFO:tasks.workunit.client.0.smithi110.stdout:9/12: write - no filename 2024-04-21T23:42:27.380 INFO:tasks.workunit.client.0.smithi110.stdout:3/16: dread f0 [0,4194304] 0 2024-04-21T23:42:27.441 INFO:tasks.workunit.client.0.smithi110.stdout:2/12: creat f5 x:0 0 0 2024-04-21T23:42:27.455 INFO:tasks.workunit.client.0.smithi110.stdout:1/14: creat d1/f3 x:0 0 0 2024-04-21T23:42:27.483 INFO:tasks.workunit.client.0.smithi110.stdout:7/6: dwrite f0 [0,4194304] 0 2024-04-21T23:42:27.724 INFO:tasks.workunit.client.0.smithi110.stdout:8/19: symlink l2 0 2024-04-21T23:42:27.775 INFO:tasks.workunit.client.0.smithi110.stdout:6/11: getdents . 0 2024-04-21T23:42:27.811 INFO:tasks.workunit.client.0.smithi110.stdout:0/26: creat d0/f5 x:0 0 0 2024-04-21T23:42:27.931 INFO:tasks.workunit.client.0.smithi110.stdout:7/7: creat f2 x:0 0 0 2024-04-21T23:42:27.936 INFO:tasks.workunit.client.0.smithi110.stdout:5/11: dwrite f0 [0,4194304] 0 2024-04-21T23:42:28.144 INFO:tasks.workunit.client.0.smithi110.stdout:1/15: mkdir d1/d4 0 2024-04-21T23:42:28.154 INFO:tasks.workunit.client.0.smithi110.stdout:8/20: chown l2 31968504 1 2024-04-21T23:42:28.280 INFO:tasks.workunit.client.0.smithi110.stdout:6/12: write f4 [607115,43533] 0 2024-04-21T23:42:28.369 INFO:tasks.workunit.client.0.smithi110.stdout:3/17: dread f0 [0,4194304] 0 2024-04-21T23:42:28.549 INFO:tasks.workunit.client.0.smithi110.stdout:9/13: getdents d1 0 2024-04-21T23:42:28.627 INFO:tasks.workunit.client.0.smithi110.stdout:0/27: truncate d0/f5 90073 0 2024-04-21T23:42:28.634 INFO:tasks.workunit.client.0.smithi110.stdout:8/21: creat f3 x:0 0 0 2024-04-21T23:42:28.719 INFO:tasks.workunit.client.0.smithi110.stdout:6/13: symlink l5 0 2024-04-21T23:42:28.719 INFO:tasks.workunit.client.0.smithi110.stdout:1/16: read - d1/f3 zero size 2024-04-21T23:42:28.791 INFO:tasks.workunit.client.0.smithi110.stdout:7/8: link f1 f3 0 2024-04-21T23:42:28.883 INFO:tasks.workunit.client.0.smithi110.stdout:8/22: dread - f3 zero size 2024-04-21T23:42:29.055 INFO:tasks.workunit.client.0.smithi110.stdout:6/14: dread - f1 zero size 2024-04-21T23:42:29.075 INFO:tasks.workunit.client.0.smithi110.stdout:4/8: dwrite f0 [0,4194304] 0 2024-04-21T23:42:29.111 INFO:tasks.workunit.client.0.smithi110.stdout:9/14: chown d1/l2 707720053 1 2024-04-21T23:42:29.228 INFO:tasks.workunit.client.0.smithi110.stdout:2/13: dread f0 [0,4194304] 0 2024-04-21T23:42:29.246 INFO:tasks.workunit.client.0.smithi110.stdout:7/9: symlink l4 0 2024-04-21T23:42:29.353 INFO:tasks.workunit.client.0.smithi110.stdout:5/12: dwrite f0 [0,4194304] 0 2024-04-21T23:42:29.526 INFO:tasks.workunit.client.0.smithi110.stdout:8/23: mknod c4 0 2024-04-21T23:42:29.568 INFO:tasks.workunit.client.0.smithi110.stdout:3/18: getdents . 0 2024-04-21T23:42:29.630 INFO:tasks.workunit.client.0.smithi110.stdout:6/15: creat f6 x:0 0 0 2024-04-21T23:42:29.661 INFO:tasks.workunit.client.0.smithi110.stdout:2/14: symlink l6 0 2024-04-21T23:42:29.728 INFO:tasks.workunit.client.0.smithi110.stdout:9/15: chown d1/l2 17 1 2024-04-21T23:42:29.729 INFO:tasks.workunit.client.0.smithi110.stdout:9/16: dread - no filename 2024-04-21T23:42:29.793 INFO:tasks.workunit.client.0.smithi110.stdout:8/24: dread - f3 zero size 2024-04-21T23:42:29.794 INFO:tasks.workunit.client.0.smithi110.stdout:3/19: stat f1 0 2024-04-21T23:42:29.837 INFO:tasks.workunit.client.0.smithi110.stdout:6/16: read - f6 zero size 2024-04-21T23:42:29.906 INFO:tasks.workunit.client.0.smithi110.stdout:1/17: symlink d1/d2/l5 0 2024-04-21T23:42:30.063 INFO:tasks.workunit.client.0.smithi110.stdout:2/15: symlink l7 0 2024-04-21T23:42:30.070 INFO:tasks.workunit.client.0.smithi110.stdout:0/28: dwrite d0/f5 [0,4194304] 0 2024-04-21T23:42:30.144 INFO:tasks.workunit.client.0.smithi110.stdout:9/17: stat d1/l2 0 2024-04-21T23:42:30.150 INFO:tasks.workunit.client.0.smithi110.stdout:4/9: creat d1/f3 x:0 0 0 2024-04-21T23:42:30.356 INFO:tasks.workunit.client.0.smithi110.stdout:8/25: dread - f3 zero size 2024-04-21T23:42:30.373 INFO:tasks.workunit.client.0.smithi110.stdout:2/16: sync 2024-04-21T23:42:30.578 INFO:tasks.workunit.client.0.smithi110.stdout:8/26: stat c4 0 2024-04-21T23:42:30.602 INFO:tasks.workunit.client.0.smithi110.stdout:2/17: dread - f5 zero size 2024-04-21T23:42:30.808 INFO:tasks.workunit.client.0.smithi110.stdout:6/17: truncate f3 942467 0 2024-04-21T23:42:30.857 INFO:tasks.workunit.client.0.smithi110.stdout:4/10: write d1/f3 [914014,104479] 0 2024-04-21T23:42:30.886 INFO:tasks.workunit.client.0.smithi110.stdout:3/20: dread f0 [0,4194304] 0 2024-04-21T23:42:30.941 INFO:tasks.workunit.client.0.smithi110.stdout:1/18: symlink d1/d2/l6 0 2024-04-21T23:42:30.986 INFO:tasks.workunit.client.0.smithi110.stdout:7/10: dwrite f0 [0,4194304] 0 2024-04-21T23:42:31.001 INFO:tasks.workunit.client.0.smithi110.stdout:8/27: write f3 [860172,123948] 0 2024-04-21T23:42:31.121 INFO:tasks.workunit.client.0.smithi110.stdout:8/28: sync 2024-04-21T23:42:31.172 INFO:tasks.workunit.client.0.smithi110.stdout:7/11: sync 2024-04-21T23:42:31.206 INFO:tasks.workunit.client.0.smithi110.stdout:2/18: unlink c4 0 2024-04-21T23:42:31.260 INFO:tasks.workunit.client.0.smithi110.stdout:9/18: getdents d1/d4 0 2024-04-21T23:42:31.260 INFO:tasks.workunit.client.0.smithi110.stdout:9/19: fsync - no filename 2024-04-21T23:42:31.260 INFO:tasks.workunit.client.0.smithi110.stdout:9/20: dread - no filename 2024-04-21T23:42:31.260 INFO:tasks.workunit.client.0.smithi110.stdout:9/21: dwrite - no filename 2024-04-21T23:42:31.286 INFO:tasks.workunit.client.0.smithi110.stdout:6/18: write f4 [973255,130000] 0 2024-04-21T23:42:31.293 INFO:tasks.workunit.client.0.smithi110.stdout:0/29: dread d0/f5 [0,4194304] 0 2024-04-21T23:42:31.345 INFO:tasks.workunit.client.0.smithi110.stdout:5/13: dwrite f0 [4194304,4194304] 0 2024-04-21T23:42:31.378 INFO:tasks.workunit.client.0.smithi110.stdout:1/19: dread - d1/f3 zero size 2024-04-21T23:42:31.380 INFO:tasks.workunit.client.0.smithi110.stdout:3/21: creat f3 x:0 0 0 2024-04-21T23:42:31.433 INFO:tasks.workunit.client.0.smithi110.stdout:6/19: stat f1 0 2024-04-21T23:42:31.434 INFO:tasks.workunit.client.0.smithi110.stdout:4/11: mkdir d1/d4 0 2024-04-21T23:42:31.448 INFO:tasks.workunit.client.0.smithi110.stdout:7/12: chown f0 23853410 1 2024-04-21T23:42:31.607 INFO:tasks.workunit.client.0.smithi110.stdout:5/14: fdatasync f0 0 2024-04-21T23:42:31.645 INFO:tasks.workunit.client.0.smithi110.stdout:8/29: mkdir d5 0 2024-04-21T23:42:31.715 INFO:tasks.workunit.client.0.smithi110.stdout:5/15: stat f0 0 2024-04-21T23:42:31.760 INFO:tasks.workunit.client.0.smithi110.stdout:5/16: chown l1 1968435 1 2024-04-21T23:42:31.783 INFO:tasks.workunit.client.0.smithi110.stdout:5/17: write f0 [4692634,16879] 0 2024-04-21T23:42:31.837 INFO:tasks.workunit.client.0.smithi110.stdout:3/22: mknod c4 0 2024-04-21T23:42:31.837 INFO:tasks.workunit.client.0.smithi110.stdout:3/23: readlink - no filename 2024-04-21T23:42:31.851 INFO:tasks.workunit.client.0.smithi110.stdout:6/20: mknod c7 0 2024-04-21T23:42:32.126 INFO:tasks.workunit.client.0.smithi110.stdout:0/30: rename d0/l1 to d0/l6 0 2024-04-21T23:42:32.132 INFO:tasks.workunit.client.0.smithi110.stdout:7/13: rename f0 to f5 0 2024-04-21T23:42:32.153 INFO:tasks.workunit.client.0.smithi110.stdout:8/30: unlink f3 0 2024-04-21T23:42:32.153 INFO:tasks.workunit.client.0.smithi110.stdout:8/31: dwrite - no filename 2024-04-21T23:42:32.211 INFO:tasks.workunit.client.0.smithi110.stdout:9/22: mknod d1/d4/c5 0 2024-04-21T23:42:32.270 INFO:tasks.workunit.client.0.smithi110.stdout:1/20: symlink d1/d4/l7 0 2024-04-21T23:42:32.286 INFO:tasks.workunit.client.0.smithi110.stdout:6/21: creat f8 x:0 0 0 2024-04-21T23:42:32.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/24: dread f0 [0,4194304] 0 2024-04-21T23:42:32.604 INFO:tasks.workunit.client.0.smithi110.stdout:1/21: dread - d1/f3 zero size 2024-04-21T23:42:32.622 INFO:tasks.workunit.client.0.smithi110.stdout:5/18: dwrite f0 [0,4194304] 0 2024-04-21T23:42:32.634 INFO:tasks.workunit.client.0.smithi110.stdout:7/14: creat f6 x:0 0 0 2024-04-21T23:42:32.642 INFO:tasks.workunit.client.0.smithi110.stdout:2/19: dwrite f1 [0,4194304] 0 2024-04-21T23:42:32.775 INFO:tasks.workunit.client.0.smithi110.stdout:6/22: write f1 [163392,109758] 0 2024-04-21T23:42:32.886 INFO:tasks.workunit.client.0.smithi110.stdout:4/12: truncate d1/f2 3425676 0 2024-04-21T23:42:32.911 INFO:tasks.workunit.client.0.smithi110.stdout:0/31: write d0/f5 [23841,54621] 0 2024-04-21T23:42:33.019 INFO:tasks.workunit.client.0.smithi110.stdout:8/32: creat d5/f6 x:0 0 0 2024-04-21T23:42:33.048 INFO:tasks.workunit.client.0.smithi110.stdout:6/23: chown l5 15019702 1 2024-04-21T23:42:33.134 INFO:tasks.workunit.client.0.smithi110.stdout:2/20: rename l6 to l8 0 2024-04-21T23:42:33.275 INFO:tasks.workunit.client.0.smithi110.stdout:1/22: mknod d1/d4/c8 0 2024-04-21T23:42:33.326 INFO:tasks.workunit.client.0.smithi110.stdout:4/13: creat d1/f5 x:0 0 0 2024-04-21T23:42:33.397 INFO:tasks.workunit.client.0.smithi110.stdout:6/24: chown f4 56 1 2024-04-21T23:42:33.402 INFO:tasks.workunit.client.0.smithi110.stdout:9/23: getdents d1 0 2024-04-21T23:42:33.402 INFO:tasks.workunit.client.0.smithi110.stdout:9/24: fdatasync - no filename 2024-04-21T23:42:33.402 INFO:tasks.workunit.client.0.smithi110.stdout:9/25: truncate - no filename 2024-04-21T23:42:33.404 INFO:tasks.workunit.client.0.smithi110.stdout:8/33: fdatasync d5/f6 0 2024-04-21T23:42:33.456 INFO:tasks.workunit.client.0.smithi110.stdout:2/21: mkdir d9 0 2024-04-21T23:42:33.643 INFO:tasks.workunit.client.0.smithi110.stdout:1/23: chown d1/f3 7226 1 2024-04-21T23:42:33.700 INFO:tasks.workunit.client.0.smithi110.stdout:2/22: fsync f0 0 2024-04-21T23:42:33.736 INFO:tasks.workunit.client.0.smithi110.stdout:8/34: fdatasync d5/f6 0 2024-04-21T23:42:33.798 INFO:tasks.workunit.client.0.smithi110.stdout:7/15: dwrite f6 [0,4194304] 0 2024-04-21T23:42:33.812 INFO:tasks.workunit.client.0.smithi110.stdout:5/19: dwrite f0 [0,4194304] 0 2024-04-21T23:42:33.943 INFO:tasks.workunit.client.0.smithi110.stdout:3/25: getdents . 0 2024-04-21T23:42:34.098 INFO:tasks.workunit.client.0.smithi110.stdout:9/26: mkdir d1/d4/d6 0 2024-04-21T23:42:34.146 INFO:tasks.workunit.client.0.smithi110.stdout:4/14: rename d1/d4 to d1/d6 0 2024-04-21T23:42:34.187 INFO:tasks.workunit.client.0.smithi110.stdout:0/32: getdents d0 0 2024-04-21T23:42:34.230 INFO:tasks.workunit.client.0.smithi110.stdout:6/25: write f0 [1560924,104998] 0 2024-04-21T23:42:34.238 INFO:tasks.workunit.client.0.smithi110.stdout:8/35: write d5/f6 [298502,78220] 0 2024-04-21T23:42:34.279 INFO:tasks.workunit.client.0.smithi110.stdout:5/20: chown l1 10077 1 2024-04-21T23:42:34.446 INFO:tasks.workunit.client.0.smithi110.stdout:5/21: chown f0 0 1 2024-04-21T23:42:34.447 INFO:tasks.workunit.client.0.smithi110.stdout:6/26: chown f4 23 1 2024-04-21T23:42:34.554 INFO:tasks.workunit.client.0.smithi110.stdout:1/24: creat d1/d4/f9 x:0 0 0 2024-04-21T23:42:34.655 INFO:tasks.workunit.client.0.smithi110.stdout:8/36: dread d5/f6 [0,4194304] 0 2024-04-21T23:42:34.722 INFO:tasks.workunit.client.0.smithi110.stdout:3/26: dwrite f3 [0,4194304] 0 2024-04-21T23:42:34.857 INFO:tasks.workunit.client.0.smithi110.stdout:8/37: sync 2024-04-21T23:42:34.871 INFO:tasks.workunit.client.0.smithi110.stdout:7/16: creat f7 x:0 0 0 2024-04-21T23:42:34.871 INFO:tasks.workunit.client.0.smithi110.stdout:9/27: creat d1/f7 x:0 0 0 2024-04-21T23:42:34.903 INFO:tasks.workunit.client.0.smithi110.stdout:2/23: creat d9/fa x:0 0 0 2024-04-21T23:42:34.938 INFO:tasks.workunit.client.0.smithi110.stdout:4/15: symlink d1/d6/l7 0 2024-04-21T23:42:34.942 INFO:tasks.workunit.client.0.smithi110.stdout:0/33: creat d0/f7 x:0 0 0 2024-04-21T23:42:35.003 INFO:tasks.workunit.client.0.smithi110.stdout:5/22: creat f2 x:0 0 0 2024-04-21T23:42:35.314 INFO:tasks.workunit.client.0.smithi110.stdout:2/24: chown l3 370352 1 2024-04-21T23:42:35.400 INFO:tasks.workunit.client.0.smithi110.stdout:0/34: dread - d0/f7 zero size 2024-04-21T23:42:35.489 INFO:tasks.workunit.client.0.smithi110.stdout:4/16: stat d1/f2 0 2024-04-21T23:42:35.644 INFO:tasks.workunit.client.0.smithi110.stdout:1/25: dwrite d1/d4/f9 [0,4194304] 0 2024-04-21T23:42:35.646 INFO:tasks.workunit.client.0.smithi110.stdout:8/38: symlink d5/l7 0 2024-04-21T23:42:35.745 INFO:tasks.workunit.client.0.smithi110.stdout:0/35: fdatasync d0/f7 0 2024-04-21T23:42:35.817 INFO:tasks.workunit.client.0.smithi110.stdout:5/23: unlink f0 0 2024-04-21T23:42:35.854 INFO:tasks.workunit.client.0.smithi110.stdout:7/17: rename f7 to f8 0 2024-04-21T23:42:36.100 INFO:tasks.workunit.client.0.smithi110.stdout:5/24: dread - f2 zero size 2024-04-21T23:42:36.254 INFO:tasks.workunit.client.0.smithi110.stdout:7/18: creat f9 x:0 0 0 2024-04-21T23:42:36.268 INFO:tasks.workunit.client.0.smithi110.stdout:3/27: dwrite f3 [4194304,4194304] 0 2024-04-21T23:42:36.272 INFO:tasks.workunit.client.0.smithi110.stdout:4/17: write d1/f2 [3306456,78796] 0 2024-04-21T23:42:36.281 INFO:tasks.workunit.client.0.smithi110.stdout:3/28: rmdir - no directory 2024-04-21T23:42:36.510 INFO:tasks.workunit.client.0.smithi110.stdout:5/25: read - f2 zero size 2024-04-21T23:42:36.590 INFO:tasks.workunit.client.0.smithi110.stdout:9/28: getdents d1 0 2024-04-21T23:42:36.697 INFO:tasks.workunit.client.0.smithi110.stdout:4/18: fdatasync f0 0 2024-04-21T23:42:36.765 INFO:tasks.workunit.client.0.smithi110.stdout:8/39: dread d5/f6 [0,4194304] 0 2024-04-21T23:42:36.767 INFO:tasks.workunit.client.0.smithi110.stdout:3/29: symlink l5 0 2024-04-21T23:42:36.887 INFO:tasks.workunit.client.0.smithi110.stdout:2/25: dwrite f1 [4194304,4194304] 0 2024-04-21T23:42:37.164 INFO:tasks.workunit.client.0.smithi110.stdout:5/26: symlink l3 0 2024-04-21T23:42:37.239 INFO:tasks.workunit.client.0.smithi110.stdout:3/30: mkdir d6 0 2024-04-21T23:42:37.348 INFO:tasks.workunit.client.0.smithi110.stdout:5/27: sync 2024-04-21T23:42:37.484 INFO:tasks.workunit.client.0.smithi110.stdout:8/40: chown c4 17 1 2024-04-21T23:42:37.740 INFO:tasks.workunit.client.0.smithi110.stdout:5/28: stat l1 0 2024-04-21T23:42:37.763 INFO:tasks.workunit.client.0.smithi110.stdout:8/41: stat c4 0 2024-04-21T23:42:37.916 INFO:tasks.workunit.client.0.smithi110.stdout:6/27: dwrite f3 [0,4194304] 0 2024-04-21T23:42:38.202 INFO:tasks.workunit.client.0.smithi110.stdout:2/26: link l7 d9/lb 0 2024-04-21T23:42:38.258 INFO:tasks.workunit.client.0.smithi110.stdout:1/26: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:42:38.332 INFO:tasks.workunit.client.0.smithi110.stdout:4/19: getdents d1 0 2024-04-21T23:42:38.336 INFO:tasks.workunit.client.0.smithi110.stdout:0/36: dwrite d0/f5 [0,4194304] 0 2024-04-21T23:42:38.425 INFO:tasks.workunit.client.0.smithi110.stdout:3/31: creat d6/f7 x:0 0 0 2024-04-21T23:42:38.462 INFO:tasks.workunit.client.0.smithi110.stdout:6/28: fdatasync f0 0 2024-04-21T23:42:38.558 INFO:tasks.workunit.client.0.smithi110.stdout:2/27: chown d9 8 1 2024-04-21T23:42:38.606 INFO:tasks.workunit.client.0.smithi110.stdout:7/19: dwrite f9 [0,4194304] 0 2024-04-21T23:42:38.614 INFO:tasks.workunit.client.0.smithi110.stdout:5/29: write f2 [741041,67908] 0 2024-04-21T23:42:38.808 INFO:tasks.workunit.client.0.smithi110.stdout:0/37: rmdir d0 39 2024-04-21T23:42:38.812 INFO:tasks.workunit.client.0.smithi110.stdout:1/27: readlink d1/d4/l7 0 2024-04-21T23:42:38.951 INFO:tasks.workunit.client.0.smithi110.stdout:7/20: symlink la 0 2024-04-21T23:42:39.092 INFO:tasks.workunit.client.0.smithi110.stdout:9/29: dwrite d1/f7 [0,4194304] 0 2024-04-21T23:42:39.436 INFO:tasks.workunit.client.0.smithi110.stdout:3/32: rename d6/f7 to d6/f8 0 2024-04-21T23:42:39.600 INFO:tasks.workunit.client.0.smithi110.stdout:1/28: unlink d1/d2/l6 0 2024-04-21T23:42:39.658 INFO:tasks.workunit.client.0.smithi110.stdout:8/42: dwrite d5/f6 [0,4194304] 0 2024-04-21T23:42:39.806 INFO:tasks.workunit.client.0.smithi110.stdout:1/29: chown d1 19266 1 2024-04-21T23:42:39.836 INFO:tasks.workunit.client.0.smithi110.stdout:3/33: chown d6/f8 8068 1 2024-04-21T23:42:39.868 INFO:tasks.workunit.client.0.smithi110.stdout:7/21: mknod cb 0 2024-04-21T23:42:39.883 INFO:tasks.workunit.client.0.smithi110.stdout:8/43: rename d5 to d5/d8 22 2024-04-21T23:42:39.978 INFO:tasks.workunit.client.0.smithi110.stdout:2/28: link d9/fa d9/fc 0 2024-04-21T23:42:39.985 INFO:tasks.workunit.client.0.smithi110.stdout:6/29: link f8 f9 0 2024-04-21T23:42:39.994 INFO:tasks.workunit.client.0.smithi110.stdout:5/30: link l1 l4 0 2024-04-21T23:42:40.021 INFO:tasks.workunit.client.0.smithi110.stdout:0/38: dwrite d0/f7 [0,4194304] 0 2024-04-21T23:42:40.034 INFO:tasks.workunit.client.0.smithi110.stdout:1/30: readlink d1/d2/l5 0 2024-04-21T23:42:40.149 INFO:tasks.workunit.client.0.smithi110.stdout:7/22: chown l4 569 1 2024-04-21T23:42:40.228 INFO:tasks.workunit.client.0.smithi110.stdout:4/20: link d1/f5 d1/f8 0 2024-04-21T23:42:40.288 INFO:tasks.workunit.client.0.smithi110.stdout:2/29: write f1 [5245025,94095] 0 2024-04-21T23:42:40.300 INFO:tasks.workunit.client.0.smithi110.stdout:3/34: mknod d6/c9 0 2024-04-21T23:42:40.345 INFO:tasks.workunit.client.0.smithi110.stdout:1/31: fdatasync d1/d4/f9 0 2024-04-21T23:42:40.468 INFO:tasks.workunit.client.0.smithi110.stdout:3/35: write f3 [7081554,110951] 0 2024-04-21T23:42:40.514 INFO:tasks.workunit.client.0.smithi110.stdout:5/31: dread f2 [0,4194304] 0 2024-04-21T23:42:40.588 INFO:tasks.workunit.client.0.smithi110.stdout:1/32: chown d1/d4/c8 0 1 2024-04-21T23:42:40.631 INFO:tasks.workunit.client.0.smithi110.stdout:8/44: mkdir d5/d9 0 2024-04-21T23:42:40.715 INFO:tasks.workunit.client.0.smithi110.stdout:2/30: dread f1 [0,4194304] 0 2024-04-21T23:42:40.811 INFO:tasks.workunit.client.0.smithi110.stdout:2/31: read f1 [4653207,21569] 0 2024-04-21T23:42:40.816 INFO:tasks.workunit.client.0.smithi110.stdout:6/30: creat fa x:0 0 0 2024-04-21T23:42:40.890 INFO:tasks.workunit.client.0.smithi110.stdout:7/23: creat fc x:0 0 0 2024-04-21T23:42:40.890 INFO:tasks.workunit.client.0.smithi110.stdout:7/24: rmdir - no directory 2024-04-21T23:42:40.929 INFO:tasks.workunit.client.0.smithi110.stdout:0/39: symlink d0/l8 0 2024-04-21T23:42:40.984 INFO:tasks.workunit.client.0.smithi110.stdout:1/33: dread d1/f3 [0,4194304] 0 2024-04-21T23:42:41.013 INFO:tasks.workunit.client.0.smithi110.stdout:6/31: chown f6 0 1 2024-04-21T23:42:41.038 INFO:tasks.workunit.client.0.smithi110.stdout:8/45: dread d5/f6 [0,4194304] 0 2024-04-21T23:42:41.099 INFO:tasks.workunit.client.0.smithi110.stdout:1/34: write d1/f3 [1345238,40933] 0 2024-04-21T23:42:41.139 INFO:tasks.workunit.client.0.smithi110.stdout:1/35: write d1/f3 [209413,118338] 0 2024-04-21T23:42:41.498 INFO:tasks.workunit.client.0.smithi110.stdout:3/36: creat d6/fa x:0 0 0 2024-04-21T23:42:41.715 INFO:tasks.workunit.client.0.smithi110.stdout:5/32: creat f5 x:0 0 0 2024-04-21T23:42:41.760 INFO:tasks.workunit.client.0.smithi110.stdout:9/30: getdents d1/d4 0 2024-04-21T23:42:41.850 INFO:tasks.workunit.client.0.smithi110.stdout:3/37: dwrite f3 [8388608,4194304] 0 2024-04-21T23:42:41.957 INFO:tasks.workunit.client.0.smithi110.stdout:9/31: chown d1/f7 1780751 1 2024-04-21T23:42:42.040 INFO:tasks.workunit.client.0.smithi110.stdout:0/40: creat d0/f9 x:0 0 0 2024-04-21T23:42:42.044 INFO:tasks.workunit.client.0.smithi110.stdout:6/32: mknod cb 0 2024-04-21T23:42:42.147 INFO:tasks.workunit.client.0.smithi110.stdout:8/46: mkdir d5/da 0 2024-04-21T23:42:42.318 INFO:tasks.workunit.client.0.smithi110.stdout:5/33: mknod c6 0 2024-04-21T23:42:42.336 INFO:tasks.workunit.client.0.smithi110.stdout:7/25: link fc fd 0 2024-04-21T23:42:42.347 INFO:tasks.workunit.client.0.smithi110.stdout:0/41: dread d0/f5 [0,4194304] 0 2024-04-21T23:42:42.366 INFO:tasks.workunit.client.0.smithi110.stdout:5/34: fsync f5 0 2024-04-21T23:42:42.403 INFO:tasks.workunit.client.0.smithi110.stdout:1/36: link d1/f3 d1/d2/fa 0 2024-04-21T23:42:42.436 INFO:tasks.workunit.client.0.smithi110.stdout:5/35: stat f5 0 2024-04-21T23:42:42.457 INFO:tasks.workunit.client.0.smithi110.stdout:0/42: dread - d0/f9 zero size 2024-04-21T23:42:42.813 INFO:tasks.workunit.client.0.smithi110.stdout:4/21: link d1/f3 d1/d6/f9 0 2024-04-21T23:42:42.839 INFO:tasks.workunit.client.0.smithi110.stdout:9/32: rename d1/l3 to d1/d4/d6/l8 0 2024-04-21T23:42:42.844 INFO:tasks.workunit.client.0.smithi110.stdout:2/32: write f5 [5011,57148] 0 2024-04-21T23:42:42.888 INFO:tasks.workunit.client.0.smithi110.stdout:9/33: chown d1/d4/c5 6371047 1 2024-04-21T23:42:42.984 INFO:tasks.workunit.client.0.smithi110.stdout:9/34: dread d1/f7 [0,4194304] 0 2024-04-21T23:42:43.026 INFO:tasks.workunit.client.0.smithi110.stdout:7/26: creat fe x:0 0 0 2024-04-21T23:42:43.053 INFO:tasks.workunit.client.0.smithi110.stdout:1/37: mknod d1/d2/cb 0 2024-04-21T23:42:43.063 INFO:tasks.workunit.client.0.smithi110.stdout:5/36: mkdir d7 0 2024-04-21T23:42:43.066 INFO:tasks.workunit.client.0.smithi110.stdout:6/33: fdatasync f8 0 2024-04-21T23:42:43.148 INFO:tasks.workunit.client.0.smithi110.stdout:6/34: write f0 [2388951,124328] 0 2024-04-21T23:42:43.153 INFO:tasks.workunit.client.0.smithi110.stdout:7/27: truncate f8 532185 0 2024-04-21T23:42:43.250 INFO:tasks.workunit.client.0.smithi110.stdout:8/47: truncate d5/f6 1701760 0 2024-04-21T23:42:43.313 INFO:tasks.workunit.client.0.smithi110.stdout:6/35: write f3 [3039803,94818] 0 2024-04-21T23:42:43.399 INFO:tasks.workunit.client.0.smithi110.stdout:7/28: sync 2024-04-21T23:42:43.423 INFO:tasks.workunit.client.0.smithi110.stdout:3/38: link d6/fa d6/fb 0 2024-04-21T23:42:43.427 INFO:tasks.workunit.client.0.smithi110.stdout:4/22: rmdir d1 39 2024-04-21T23:42:43.439 INFO:tasks.workunit.client.0.smithi110.stdout:2/33: mknod d9/cd 0 2024-04-21T23:42:43.475 INFO:tasks.workunit.client.0.smithi110.stdout:3/39: dread - d6/fa zero size 2024-04-21T23:42:43.552 INFO:tasks.workunit.client.0.smithi110.stdout:9/35: creat d1/f9 x:0 0 0 2024-04-21T23:42:43.622 INFO:tasks.workunit.client.0.smithi110.stdout:5/37: unlink c6 0 2024-04-21T23:42:43.635 INFO:tasks.workunit.client.0.smithi110.stdout:0/43: link d0/f5 d0/fa 0 2024-04-21T23:42:43.891 INFO:tasks.workunit.client.0.smithi110.stdout:6/36: mknod cc 0 2024-04-21T23:42:43.941 INFO:tasks.workunit.client.0.smithi110.stdout:3/40: rmdir d6 39 2024-04-21T23:42:43.965 INFO:tasks.workunit.client.0.smithi110.stdout:6/37: chown f1 54 1 2024-04-21T23:42:44.319 INFO:tasks.workunit.client.0.smithi110.stdout:9/36: dwrite d1/f7 [0,4194304] 0 2024-04-21T23:42:45.172 INFO:tasks.workunit.client.0.smithi110.stdout:6/38: truncate f6 611862 0 2024-04-21T23:42:45.197 INFO:tasks.workunit.client.0.smithi110.stdout:5/38: getdents d7 0 2024-04-21T23:42:45.391 INFO:tasks.workunit.client.0.smithi110.stdout:5/39: sync 2024-04-21T23:42:45.631 INFO:tasks.workunit.client.0.smithi110.stdout:2/34: link d9/fc d9/fe 0 2024-04-21T23:42:45.979 INFO:tasks.workunit.client.0.smithi110.stdout:7/29: dwrite fd [0,4194304] 0 2024-04-21T23:42:46.568 INFO:tasks.workunit.client.0.smithi110.stdout:1/38: truncate d1/f3 877374 0 2024-04-21T23:42:46.874 INFO:tasks.workunit.client.0.smithi110.stdout:8/48: dwrite d5/f6 [0,4194304] 0 2024-04-21T23:42:46.972 INFO:tasks.workunit.client.0.smithi110.stdout:7/30: unlink f1 0 2024-04-21T23:42:47.167 INFO:tasks.workunit.client.0.smithi110.stdout:0/44: getdents d0 0 2024-04-21T23:42:47.181 INFO:tasks.workunit.client.0.smithi110.stdout:8/49: write d5/f6 [3596583,119282] 0 2024-04-21T23:42:47.330 INFO:tasks.workunit.client.0.smithi110.stdout:0/45: readlink d0/l6 0 2024-04-21T23:42:47.381 INFO:tasks.workunit.client.0.smithi110.stdout:8/50: readlink d5/l7 0 2024-04-21T23:42:47.566 INFO:tasks.workunit.client.0.smithi110.stdout:9/37: truncate d1/f7 810798 0 2024-04-21T23:42:47.625 INFO:tasks.workunit.client.0.smithi110.stdout:4/23: dwrite d1/f2 [0,4194304] 0 2024-04-21T23:42:47.906 INFO:tasks.workunit.client.0.smithi110.stdout:6/39: truncate f3 3691730 0 2024-04-21T23:42:47.914 INFO:tasks.workunit.client.0.smithi110.stdout:5/40: write f2 [1375165,122866] 0 2024-04-21T23:42:47.994 INFO:tasks.workunit.client.0.smithi110.stdout:2/35: rename f0 to d9/ff 0 2024-04-21T23:42:48.025 INFO:tasks.workunit.client.0.smithi110.stdout:3/41: dwrite f1 [4194304,4194304] 0 2024-04-21T23:42:48.396 INFO:tasks.workunit.client.0.smithi110.stdout:5/41: write f2 [797934,75309] 0 2024-04-21T23:42:48.517 INFO:tasks.workunit.client.0.smithi110.stdout:0/46: write d0/fa [2854611,118912] 0 2024-04-21T23:42:48.568 INFO:tasks.workunit.client.0.smithi110.stdout:7/31: dwrite f5 [4194304,4194304] 0 2024-04-21T23:42:48.743 INFO:tasks.workunit.client.0.smithi110.stdout:8/51: dread d5/f6 [0,4194304] 0 2024-04-21T23:42:48.770 INFO:tasks.workunit.client.0.smithi110.stdout:0/47: readlink d0/l6 0 2024-04-21T23:42:48.791 INFO:tasks.workunit.client.0.smithi110.stdout:4/24: dread d1/f2 [0,4194304] 0 2024-04-21T23:42:48.960 INFO:tasks.workunit.client.0.smithi110.stdout:2/36: creat d9/f10 x:0 0 0 2024-04-21T23:42:49.282 INFO:tasks.workunit.client.0.smithi110.stdout:9/38: chown d1/f7 770442457 1 2024-04-21T23:42:49.478 INFO:tasks.workunit.client.0.smithi110.stdout:5/42: read - f5 zero size 2024-04-21T23:42:49.500 INFO:tasks.workunit.client.0.smithi110.stdout:5/43: dread - f5 zero size 2024-04-21T23:42:49.508 INFO:tasks.workunit.client.0.smithi110.stdout:9/39: sync 2024-04-21T23:42:50.241 INFO:tasks.workunit.client.0.smithi110.stdout:0/48: creat d0/fb x:0 0 0 2024-04-21T23:42:50.466 INFO:tasks.workunit.client.0.smithi110.stdout:4/25: mknod d1/ca 0 2024-04-21T23:42:50.517 INFO:tasks.workunit.client.0.smithi110.stdout:2/37: chown f1 3 1 2024-04-21T23:42:50.678 INFO:tasks.workunit.client.0.smithi110.stdout:1/39: rename d1/d2/fa to d1/d4/fc 0 2024-04-21T23:42:50.738 INFO:tasks.workunit.client.0.smithi110.stdout:7/32: symlink lf 0 2024-04-21T23:42:51.102 INFO:tasks.workunit.client.0.smithi110.stdout:4/26: mknod d1/cb 0 2024-04-21T23:42:51.188 INFO:tasks.workunit.client.0.smithi110.stdout:2/38: creat d9/f11 x:0 0 0 2024-04-21T23:42:51.403 INFO:tasks.workunit.client.0.smithi110.stdout:8/52: rename c4 to d5/da/cb 0 2024-04-21T23:42:51.521 INFO:tasks.workunit.client.0.smithi110.stdout:7/33: readlink l4 0 2024-04-21T23:42:51.556 INFO:tasks.workunit.client.0.smithi110.stdout:3/42: write d6/fb [23752,17886] 0 2024-04-21T23:42:51.614 INFO:tasks.workunit.client.0.smithi110.stdout:3/43: write d6/fa [792158,13201] 0 2024-04-21T23:42:51.661 INFO:tasks.workunit.client.0.smithi110.stdout:9/40: symlink d1/la 0 2024-04-21T23:42:51.820 INFO:tasks.workunit.client.0.smithi110.stdout:4/27: rename d1/f2 to d1/fc 0 2024-04-21T23:42:51.866 INFO:tasks.workunit.client.0.smithi110.stdout:6/40: write f3 [4145708,76726] 0 2024-04-21T23:42:51.910 INFO:tasks.workunit.client.0.smithi110.stdout:2/39: symlink d9/l12 0 2024-04-21T23:42:52.079 INFO:tasks.workunit.client.0.smithi110.stdout:1/40: fsync d1/f3 0 2024-04-21T23:42:52.207 INFO:tasks.workunit.client.0.smithi110.stdout:0/49: write d0/f7 [1376824,36545] 0 2024-04-21T23:42:52.239 INFO:tasks.workunit.client.0.smithi110.stdout:8/53: write d5/f6 [60114,89410] 0 2024-04-21T23:42:52.327 INFO:tasks.workunit.client.0.smithi110.stdout:0/50: chown d0/f7 9130358 1 2024-04-21T23:42:52.468 INFO:tasks.workunit.client.0.smithi110.stdout:3/44: symlink d6/lc 0 2024-04-21T23:42:52.519 INFO:tasks.workunit.client.0.smithi110.stdout:9/41: stat d1/d4/d6/l8 0 2024-04-21T23:42:52.532 INFO:tasks.workunit.client.0.smithi110.stdout:3/45: truncate d6/fb 1354074 0 2024-04-21T23:42:52.722 INFO:tasks.workunit.client.0.smithi110.stdout:6/41: dread - f8 zero size 2024-04-21T23:42:53.246 INFO:tasks.workunit.client.0.smithi110.stdout:5/44: rename l1 to d7/l8 0 2024-04-21T23:42:53.286 INFO:tasks.workunit.client.0.smithi110.stdout:0/51: rmdir d0 39 2024-04-21T23:42:53.288 INFO:tasks.workunit.client.0.smithi110.stdout:8/54: creat d5/da/fc x:0 0 0 2024-04-21T23:42:53.389 INFO:tasks.workunit.client.0.smithi110.stdout:9/42: unlink d1/la 0 2024-04-21T23:42:53.524 INFO:tasks.workunit.client.0.smithi110.stdout:6/42: fdatasync f0 0 2024-04-21T23:42:53.527 INFO:tasks.workunit.client.0.smithi110.stdout:5/45: dread f2 [0,4194304] 0 2024-04-21T23:42:53.676 INFO:tasks.workunit.client.0.smithi110.stdout:6/43: dread - f9 zero size 2024-04-21T23:42:54.030 INFO:tasks.workunit.client.0.smithi110.stdout:1/41: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:42:54.226 INFO:tasks.workunit.client.0.smithi110.stdout:8/55: creat d5/da/fd x:0 0 0 2024-04-21T23:42:54.263 INFO:tasks.workunit.client.0.smithi110.stdout:6/44: dread f3 [0,4194304] 0 2024-04-21T23:42:54.280 INFO:tasks.workunit.client.0.smithi110.stdout:0/52: write d0/f7 [3152571,103895] 0 2024-04-21T23:42:54.324 INFO:tasks.workunit.client.0.smithi110.stdout:3/46: link d6/fa d6/fd 0 2024-04-21T23:42:54.436 INFO:tasks.workunit.client.0.smithi110.stdout:8/56: write d5/da/fd [148172,29295] 0 2024-04-21T23:42:54.545 INFO:tasks.workunit.client.0.smithi110.stdout:9/43: creat d1/d4/fb x:0 0 0 2024-04-21T23:42:54.767 INFO:tasks.workunit.client.0.smithi110.stdout:5/46: rmdir d7 39 2024-04-21T23:42:55.321 INFO:tasks.workunit.client.0.smithi110.stdout:1/42: dwrite d1/d4/fc [0,4194304] 0 2024-04-21T23:42:55.528 INFO:tasks.workunit.client.0.smithi110.stdout:8/57: dread d5/f6 [0,4194304] 0 2024-04-21T23:42:55.610 INFO:tasks.workunit.client.0.smithi110.stdout:2/40: dwrite d9/fc [0,4194304] 0 2024-04-21T23:42:55.728 INFO:tasks.workunit.client.0.smithi110.stdout:4/28: dwrite d1/f5 [0,4194304] 0 2024-04-21T23:42:55.849 INFO:tasks.workunit.client.0.smithi110.stdout:8/58: stat l2 0 2024-04-21T23:42:55.917 INFO:tasks.workunit.client.0.smithi110.stdout:0/53: dread - d0/f9 zero size 2024-04-21T23:42:56.074 INFO:tasks.workunit.client.0.smithi110.stdout:9/44: unlink l0 0 2024-04-21T23:42:56.369 INFO:tasks.workunit.client.0.smithi110.stdout:1/43: dwrite d1/d4/fc [0,4194304] 0 2024-04-21T23:42:56.571 INFO:tasks.workunit.client.0.smithi110.stdout:2/41: creat d9/f13 x:0 0 0 2024-04-21T23:42:56.580 INFO:tasks.workunit.client.0.smithi110.stdout:7/34: getdents . 0 2024-04-21T23:42:56.623 INFO:tasks.workunit.client.0.smithi110.stdout:3/47: rename d6/fb to d6/fe 0 2024-04-21T23:42:56.721 INFO:tasks.workunit.client.0.smithi110.stdout:8/59: dwrite d5/da/fc [0,4194304] 0 2024-04-21T23:42:56.823 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:42:56.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:42:56.885 INFO:tasks.workunit.client.0.smithi110.stdout:0/54: rename d0/f5 to d0/fc 0 2024-04-21T23:42:56.943 INFO:tasks.workunit.client.0.smithi110.stdout:4/29: dread d1/fc [0,4194304] 0 2024-04-21T23:42:57.010 INFO:tasks.workunit.client.0.smithi110.stdout:4/30: write d1/f8 [990338,21850] 0 2024-04-21T23:42:57.024 INFO:tasks.workunit.client.0.smithi110.stdout:4/31: chown d1 16256 1 2024-04-21T23:42:57.232 INFO:tasks.workunit.client.0.smithi110.stdout:5/47: mkdir d7/d9 0 2024-04-21T23:42:57.270 INFO:tasks.workunit.client.0.smithi110.stdout:9/45: mkdir d1/d4/dc 0 2024-04-21T23:42:57.272 INFO:tasks.workunit.client.0.smithi110.stdout:1/44: mkdir d1/dd 0 2024-04-21T23:42:57.288 INFO:tasks.workunit.client.0.smithi110.stdout:7/35: mkdir d10 0 2024-04-21T23:42:57.309 INFO:tasks.workunit.client.0.smithi110.stdout:3/48: symlink d6/lf 0 2024-04-21T23:42:57.325 INFO:tasks.workunit.client.0.smithi110.stdout:2/42: mknod d9/c14 0 2024-04-21T23:42:57.378 INFO:tasks.workunit.client.0.smithi110.stdout:8/60: unlink l2 0 2024-04-21T23:42:57.395 INFO:tasks.workunit.client.0.smithi110.stdout:1/45: chown d1/d2/l5 342207 1 2024-04-21T23:42:57.550 INFO:tasks.workunit.client.0.smithi110.stdout:3/49: sync 2024-04-21T23:42:57.560 INFO:tasks.workunit.client.0.smithi110.stdout:3/50: readlink d6/lc 0 2024-04-21T23:42:57.793 INFO:tasks.workunit.client.0.smithi110.stdout:6/45: getdents . 0 2024-04-21T23:42:57.820 INFO:tasks.workunit.client.0.smithi110.stdout:7/36: chown fe 2729 1 2024-04-21T23:42:57.946 INFO:tasks.workunit.client.0.smithi110.stdout:5/48: creat d7/fa x:0 0 0 2024-04-21T23:42:58.442 INFO:tasks.workunit.client.0.smithi110.stdout:1/46: creat d1/fe x:0 0 0 2024-04-21T23:42:58.508 INFO:tasks.workunit.client.0.smithi110.stdout:1/47: dread - d1/fe zero size 2024-04-21T23:42:58.602 INFO:tasks.workunit.client.0.smithi110.stdout:3/51: dread f0 [0,4194304] 0 2024-04-21T23:42:58.651 INFO:tasks.workunit.client.0.smithi110.stdout:4/32: rename d1/d6/f9 to d1/fd 0 2024-04-21T23:42:58.750 INFO:tasks.workunit.client.0.smithi110.stdout:6/46: truncate f1 220378 0 2024-04-21T23:42:58.772 INFO:tasks.workunit.client.0.smithi110.stdout:6/47: read - fa zero size 2024-04-21T23:42:59.138 INFO:tasks.workunit.client.0.smithi110.stdout:9/46: write d1/f7 [444196,101543] 0 2024-04-21T23:42:59.298 INFO:tasks.workunit.client.0.smithi110.stdout:1/48: unlink d1/fe 0 2024-04-21T23:42:59.317 INFO:tasks.workunit.client.0.smithi110.stdout:2/43: write f1 [3431260,102820] 0 2024-04-21T23:42:59.333 INFO:tasks.workunit.client.0.smithi110.stdout:8/61: write d5/f6 [3289804,78470] 0 2024-04-21T23:42:59.445 INFO:tasks.workunit.client.0.smithi110.stdout:7/37: mknod d10/c11 0 2024-04-21T23:42:59.478 INFO:tasks.workunit.client.0.smithi110.stdout:2/44: write d9/ff [1778836,41234] 0 2024-04-21T23:42:59.542 INFO:tasks.workunit.client.0.smithi110.stdout:8/62: dread d5/da/fd [0,4194304] 0 2024-04-21T23:42:59.603 INFO:tasks.workunit.client.0.smithi110.stdout:6/48: unlink l5 0 2024-04-21T23:42:59.616 INFO:tasks.workunit.client.0.smithi110.stdout:6/49: dread - f9 zero size 2024-04-21T23:42:59.630 INFO:tasks.workunit.client.0.smithi110.stdout:6/50: chown f4 120701104 1 2024-04-21T23:42:59.920 INFO:tasks.workunit.client.0.smithi110.stdout:0/55: write d0/fc [4236020,47774] 0 2024-04-21T23:42:59.991 INFO:tasks.workunit.client.0.smithi110.stdout:5/49: mknod d7/d9/cb 0 2024-04-21T23:43:00.025 INFO:tasks.workunit.client.0.smithi110.stdout:5/50: write d7/fa [560381,25828] 0 2024-04-21T23:43:00.665 INFO:tasks.workunit.client.0.smithi110.stdout:7/38: rmdir d10 39 2024-04-21T23:43:00.793 INFO:tasks.workunit.client.0.smithi110.stdout:2/45: creat d9/f15 x:0 0 0 2024-04-21T23:43:01.183 INFO:tasks.workunit.client.0.smithi110.stdout:6/51: fsync f9 0 2024-04-21T23:43:01.531 INFO:tasks.workunit.client.0.smithi110.stdout:1/49: creat d1/ff x:0 0 0 2024-04-21T23:43:01.602 INFO:tasks.workunit.client.0.smithi110.stdout:9/47: creat d1/d4/dc/fd x:0 0 0 2024-04-21T23:43:01.719 INFO:tasks.workunit.client.0.smithi110.stdout:9/48: chown d1/l2 12436 1 2024-04-21T23:43:01.749 INFO:tasks.workunit.client.0.smithi110.stdout:5/51: symlink d7/lc 0 2024-04-21T23:43:01.883 INFO:tasks.workunit.client.0.smithi110.stdout:9/49: write d1/d4/dc/fd [413457,107655] 0 2024-04-21T23:43:01.913 INFO:tasks.workunit.client.0.smithi110.stdout:1/50: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:43:02.168 INFO:tasks.workunit.client.0.smithi110.stdout:4/33: link d1/fd d1/fe 0 2024-04-21T23:43:02.305 INFO:tasks.workunit.client.0.smithi110.stdout:4/34: dread f0 [0,4194304] 0 2024-04-21T23:43:02.577 INFO:tasks.workunit.client.0.smithi110.stdout:8/63: creat d5/fe x:0 0 0 2024-04-21T23:43:02.600 INFO:tasks.workunit.client.0.smithi110.stdout:8/64: dread - d5/fe zero size 2024-04-21T23:43:02.728 INFO:tasks.workunit.client.0.smithi110.stdout:6/52: creat fd x:0 0 0 2024-04-21T23:43:02.868 INFO:tasks.workunit.client.0.smithi110.stdout:5/52: fsync f2 0 2024-04-21T23:43:02.962 INFO:tasks.workunit.client.0.smithi110.stdout:3/52: getdents d6 0 2024-04-21T23:43:03.327 INFO:tasks.workunit.client.0.smithi110.stdout:9/50: creat d1/d4/d6/fe x:0 0 0 2024-04-21T23:43:03.769 INFO:tasks.workunit.client.0.smithi110.stdout:1/51: fdatasync d1/d4/f9 0 2024-04-21T23:43:03.916 INFO:tasks.workunit.client.0.smithi110.stdout:0/56: link d0/l4 d0/ld 0 2024-04-21T23:43:04.077 INFO:tasks.workunit.client.0.smithi110.stdout:4/35: dread d1/f5 [0,4194304] 0 2024-04-21T23:43:04.203 INFO:tasks.workunit.client.0.smithi110.stdout:6/53: truncate f6 605763 0 2024-04-21T23:43:04.344 INFO:tasks.workunit.client.0.smithi110.stdout:0/57: dwrite d0/fa [0,4194304] 0 2024-04-21T23:43:04.483 INFO:tasks.workunit.client.0.smithi110.stdout:3/53: symlink d6/l10 0 2024-04-21T23:43:04.527 INFO:tasks.workunit.client.0.smithi110.stdout:9/51: fsync d1/f9 0 2024-04-21T23:43:04.587 INFO:tasks.workunit.client.0.smithi110.stdout:3/54: stat d6/f8 0 2024-04-21T23:43:04.709 INFO:tasks.workunit.client.0.smithi110.stdout:9/52: rename d1 to d1/d4/d6/df 22 2024-04-21T23:43:04.838 INFO:tasks.workunit.client.0.smithi110.stdout:5/53: dwrite f2 [0,4194304] 0 2024-04-21T23:43:04.953 INFO:tasks.workunit.client.0.smithi110.stdout:2/46: truncate f1 8017501 0 2024-04-21T23:43:04.964 INFO:tasks.workunit.client.0.smithi110.stdout:1/52: rmdir d1 39 2024-04-21T23:43:05.235 INFO:tasks.workunit.client.0.smithi110.stdout:6/54: creat fe x:0 0 0 2024-04-21T23:43:05.381 INFO:tasks.workunit.client.0.smithi110.stdout:6/55: dread f3 [0,4194304] 0 2024-04-21T23:43:05.666 INFO:tasks.workunit.client.0.smithi110.stdout:0/58: creat d0/fe x:0 0 0 2024-04-21T23:43:05.795 INFO:tasks.workunit.client.0.smithi110.stdout:3/55: dread f3 [4194304,4194304] 0 2024-04-21T23:43:05.915 INFO:tasks.workunit.client.0.smithi110.stdout:9/53: mknod d1/d4/dc/c10 0 2024-04-21T23:43:06.478 INFO:tasks.workunit.client.0.smithi110.stdout:4/36: truncate d1/f8 223559 0 2024-04-21T23:43:06.495 INFO:tasks.workunit.client.0.smithi110.stdout:7/39: link f9 d10/f12 0 2024-04-21T23:43:06.628 INFO:tasks.workunit.client.0.smithi110.stdout:3/56: mknod d6/c11 0 2024-04-21T23:43:06.641 INFO:tasks.workunit.client.0.smithi110.stdout:9/54: unlink d1/d4/dc/c10 0 2024-04-21T23:43:06.662 INFO:tasks.workunit.client.0.smithi110.stdout:1/53: mkdir d1/d4/d10 0 2024-04-21T23:43:06.705 INFO:tasks.workunit.client.0.smithi110.stdout:8/65: getdents d5 0 2024-04-21T23:43:06.941 INFO:tasks.workunit.client.0.smithi110.stdout:4/37: rmdir d1/d6 39 2024-04-21T23:43:07.014 INFO:tasks.workunit.client.0.smithi110.stdout:3/57: dread f3 [0,4194304] 0 2024-04-21T23:43:07.065 INFO:tasks.workunit.client.0.smithi110.stdout:7/40: creat d10/f13 x:0 0 0 2024-04-21T23:43:07.299 INFO:tasks.workunit.client.0.smithi110.stdout:8/66: dwrite d5/fe [0,4194304] 0 2024-04-21T23:43:07.576 INFO:tasks.workunit.client.0.smithi110.stdout:9/55: fsync d1/f9 0 2024-04-21T23:43:07.869 INFO:tasks.workunit.client.0.smithi110.stdout:3/58: mkdir d6/d12 0 2024-04-21T23:43:07.977 INFO:tasks.workunit.client.0.smithi110.stdout:5/54: dwrite f5 [0,4194304] 0 2024-04-21T23:43:08.115 INFO:tasks.workunit.client.0.smithi110.stdout:3/59: sync 2024-04-21T23:43:08.319 INFO:tasks.workunit.client.0.smithi110.stdout:6/56: getdents . 0 2024-04-21T23:43:08.430 INFO:tasks.workunit.client.0.smithi110.stdout:0/59: write d0/fb [18877,35811] 0 2024-04-21T23:43:08.490 INFO:tasks.workunit.client.0.smithi110.stdout:8/67: creat d5/ff x:0 0 0 2024-04-21T23:43:08.515 INFO:tasks.workunit.client.0.smithi110.stdout:0/60: sync 2024-04-21T23:43:08.856 INFO:tasks.workunit.client.0.smithi110.stdout:9/56: rename d1/d4/d6/l8 to d1/d4/l11 0 2024-04-21T23:43:08.900 INFO:tasks.workunit.client.0.smithi110.stdout:7/41: unlink f3 0 2024-04-21T23:43:09.150 INFO:tasks.workunit.client.0.smithi110.stdout:5/55: rmdir d7 39 2024-04-21T23:43:09.313 INFO:tasks.workunit.client.0.smithi110.stdout:1/54: link d1/d4/f9 d1/d4/f11 0 2024-04-21T23:43:09.552 INFO:tasks.workunit.client.0.smithi110.stdout:8/68: stat d5/da/cb 0 2024-04-21T23:43:09.621 INFO:tasks.workunit.client.0.smithi110.stdout:0/61: creat d0/ff x:0 0 0 2024-04-21T23:43:09.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/69: sync 2024-04-21T23:43:09.765 INFO:tasks.workunit.client.0.smithi110.stdout:2/47: rmdir d9 39 2024-04-21T23:43:09.909 INFO:tasks.workunit.client.0.smithi110.stdout:9/57: write d1/f9 [465126,19991] 0 2024-04-21T23:43:09.950 INFO:tasks.workunit.client.0.smithi110.stdout:0/62: dwrite d0/ff [0,4194304] 0 2024-04-21T23:43:09.985 INFO:tasks.workunit.client.0.smithi110.stdout:7/42: creat d10/f14 x:0 0 0 2024-04-21T23:43:10.121 INFO:tasks.workunit.client.0.smithi110.stdout:7/43: stat l4 0 2024-04-21T23:43:10.123 INFO:tasks.workunit.client.0.smithi110.stdout:0/63: dread - d0/f9 zero size 2024-04-21T23:43:10.166 INFO:tasks.workunit.client.0.smithi110.stdout:3/60: creat d6/d12/f13 x:0 0 0 2024-04-21T23:43:10.187 INFO:tasks.workunit.client.0.smithi110.stdout:0/64: write d0/fc [1301074,18180] 0 2024-04-21T23:43:10.985 INFO:tasks.workunit.client.0.smithi110.stdout:9/58: mkdir d1/d4/d6/d12 0 2024-04-21T23:43:10.999 INFO:tasks.workunit.client.0.smithi110.stdout:3/61: mkdir d6/d12/d14 0 2024-04-21T23:43:11.029 INFO:tasks.workunit.client.0.smithi110.stdout:0/65: mknod d0/c10 0 2024-04-21T23:43:11.053 INFO:tasks.workunit.client.0.smithi110.stdout:6/57: link fa ff 0 2024-04-21T23:43:11.062 INFO:tasks.workunit.client.0.smithi110.stdout:0/66: chown d0 0 1 2024-04-21T23:43:11.248 INFO:tasks.workunit.client.0.smithi110.stdout:0/67: dread d0/fc [0,4194304] 0 2024-04-21T23:43:11.318 INFO:tasks.workunit.client.0.smithi110.stdout:0/68: write d0/fc [475231,34804] 0 2024-04-21T23:43:11.476 INFO:tasks.workunit.client.0.smithi110.stdout:1/55: rmdir d1/d4 39 2024-04-21T23:43:11.551 INFO:tasks.workunit.client.0.smithi110.stdout:2/48: rmdir d9 39 2024-04-21T23:43:11.693 INFO:tasks.workunit.client.0.smithi110.stdout:3/62: fsync d6/f8 0 2024-04-21T23:43:11.771 INFO:tasks.workunit.client.0.smithi110.stdout:6/58: creat f10 x:0 0 0 2024-04-21T23:43:11.787 INFO:tasks.workunit.client.0.smithi110.stdout:6/59: readlink l2 0 2024-04-21T23:43:11.853 INFO:tasks.workunit.client.0.smithi110.stdout:8/70: mkdir d5/d10 0 2024-04-21T23:43:12.150 INFO:tasks.workunit.client.0.smithi110.stdout:8/71: dwrite d5/ff [0,4194304] 0 2024-04-21T23:43:12.277 INFO:tasks.workunit.client.0.smithi110.stdout:0/69: rename d0/f7 to d0/f11 0 2024-04-21T23:43:12.336 INFO:tasks.workunit.client.0.smithi110.stdout:8/72: chown d5/da/fc 282246 1 2024-04-21T23:43:12.345 INFO:tasks.workunit.client.0.smithi110.stdout:8/73: readlink d5/l7 0 2024-04-21T23:43:12.469 INFO:tasks.workunit.client.0.smithi110.stdout:5/56: truncate f5 2716943 0 2024-04-21T23:43:12.504 INFO:tasks.workunit.client.0.smithi110.stdout:2/49: stat d9/cd 0 2024-04-21T23:43:12.651 INFO:tasks.workunit.client.0.smithi110.stdout:3/63: unlink d6/d12/f13 0 2024-04-21T23:43:12.749 INFO:tasks.workunit.client.0.smithi110.stdout:6/60: unlink f0 0 2024-04-21T23:43:13.051 INFO:tasks.workunit.client.0.smithi110.stdout:4/38: dread d1/f8 [0,4194304] 0 2024-04-21T23:43:13.210 INFO:tasks.workunit.client.0.smithi110.stdout:0/70: chown d0/l4 16088166 1 2024-04-21T23:43:13.633 INFO:tasks.workunit.client.0.smithi110.stdout:2/50: mkdir d9/d16 0 2024-04-21T23:43:13.948 INFO:tasks.workunit.client.0.smithi110.stdout:6/61: creat f11 x:0 0 0 2024-04-21T23:43:14.367 INFO:tasks.workunit.client.0.smithi110.stdout:8/74: mknod d5/d9/c11 0 2024-04-21T23:43:14.404 INFO:tasks.workunit.client.0.smithi110.stdout:5/57: fsync d7/fa 0 2024-04-21T23:43:14.433 INFO:tasks.workunit.client.0.smithi110.stdout:7/44: dwrite f6 [4194304,4194304] 0 2024-04-21T23:43:14.587 INFO:tasks.workunit.client.0.smithi110.stdout:8/75: readlink d5/l7 0 2024-04-21T23:43:14.587 INFO:tasks.workunit.client.0.smithi110.stdout:5/58: stat l3 0 2024-04-21T23:43:14.664 INFO:tasks.workunit.client.0.smithi110.stdout:3/64: mknod d6/d12/d14/c15 0 2024-04-21T23:43:14.759 INFO:tasks.workunit.client.0.smithi110.stdout:6/62: unlink fd 0 2024-04-21T23:43:14.769 INFO:tasks.workunit.client.0.smithi110.stdout:9/59: dwrite d1/d4/d6/fe [0,4194304] 0 2024-04-21T23:43:14.903 INFO:tasks.workunit.client.0.smithi110.stdout:4/39: creat d1/d6/ff x:0 0 0 2024-04-21T23:43:15.330 INFO:tasks.workunit.client.0.smithi110.stdout:7/45: mkdir d10/d15 0 2024-04-21T23:43:15.490 INFO:tasks.workunit.client.0.smithi110.stdout:8/76: creat d5/f12 x:0 0 0 2024-04-21T23:43:15.655 INFO:tasks.workunit.client.0.smithi110.stdout:1/56: write d1/d4/fc [4059290,44665] 0 2024-04-21T23:43:15.789 INFO:tasks.workunit.client.0.smithi110.stdout:3/65: dread f1 [0,4194304] 0 2024-04-21T23:43:15.953 INFO:tasks.workunit.client.0.smithi110.stdout:0/71: dread d0/f11 [0,4194304] 0 2024-04-21T23:43:15.977 INFO:tasks.workunit.client.0.smithi110.stdout:0/72: readlink d0/ld 0 2024-04-21T23:43:15.990 INFO:tasks.workunit.client.0.smithi110.stdout:0/73: stat d0/fa 0 2024-04-21T23:43:16.085 INFO:tasks.workunit.client.0.smithi110.stdout:7/46: chown fc 0 1 2024-04-21T23:43:16.396 INFO:tasks.workunit.client.0.smithi110.stdout:8/77: mknod d5/da/c13 0 2024-04-21T23:43:16.458 INFO:tasks.workunit.client.0.smithi110.stdout:5/59: write d7/fa [258562,25390] 0 2024-04-21T23:43:16.624 INFO:tasks.workunit.client.0.smithi110.stdout:2/51: write d9/f13 [690124,70130] 0 2024-04-21T23:43:16.861 INFO:tasks.workunit.client.0.smithi110.stdout:3/66: mkdir d6/d12/d16 0 2024-04-21T23:43:16.951 INFO:tasks.workunit.client.0.smithi110.stdout:0/74: rename d0/ff to d0/f12 0 2024-04-21T23:43:17.770 INFO:tasks.workunit.client.0.smithi110.stdout:5/60: unlink f2 0 2024-04-21T23:43:17.780 INFO:tasks.workunit.client.0.smithi110.stdout:1/57: creat d1/d4/d10/f12 x:0 0 0 2024-04-21T23:43:17.889 INFO:tasks.workunit.client.0.smithi110.stdout:2/52: unlink d9/fc 0 2024-04-21T23:43:17.902 INFO:tasks.workunit.client.0.smithi110.stdout:3/67: unlink d6/fa 0 2024-04-21T23:43:17.950 INFO:tasks.workunit.client.0.smithi110.stdout:0/75: rename d0/fe to d0/f13 0 2024-04-21T23:43:18.138 INFO:tasks.workunit.client.0.smithi110.stdout:6/63: dwrite f1 [0,4194304] 0 2024-04-21T23:43:18.154 INFO:tasks.workunit.client.0.smithi110.stdout:4/40: dwrite d1/f8 [0,4194304] 0 2024-04-21T23:43:18.177 INFO:tasks.workunit.client.0.smithi110.stdout:9/60: unlink d1/f9 0 2024-04-21T23:43:18.530 INFO:tasks.workunit.client.0.smithi110.stdout:8/78: getdents d5/d10 0 2024-04-21T23:43:18.607 INFO:tasks.workunit.client.0.smithi110.stdout:1/58: creat d1/d4/f13 x:0 0 0 2024-04-21T23:43:18.631 INFO:tasks.workunit.client.0.smithi110.stdout:0/76: dread d0/f12 [0,4194304] 0 2024-04-21T23:43:19.174 INFO:tasks.workunit.client.0.smithi110.stdout:9/61: write d1/f7 [1193700,85050] 0 2024-04-21T23:43:19.504 INFO:tasks.workunit.client.0.smithi110.stdout:0/77: mkdir d0/d14 0 2024-04-21T23:43:19.539 INFO:tasks.workunit.client.0.smithi110.stdout:8/79: rename d5/da/fd to d5/d9/f14 0 2024-04-21T23:43:19.610 INFO:tasks.workunit.client.0.smithi110.stdout:2/53: write d9/fe [5050249,93056] 0 2024-04-21T23:43:19.750 INFO:tasks.workunit.client.0.smithi110.stdout:6/64: write ff [74956,56375] 0 2024-04-21T23:43:19.791 INFO:tasks.workunit.client.0.smithi110.stdout:9/62: fsync d1/d4/fb 0 2024-04-21T23:43:19.815 INFO:tasks.workunit.client.0.smithi110.stdout:7/47: dwrite f9 [0,4194304] 0 2024-04-21T23:43:19.863 INFO:tasks.workunit.client.0.smithi110.stdout:4/41: write d1/fe [901358,111410] 0 2024-04-21T23:43:19.889 INFO:tasks.workunit.client.0.smithi110.stdout:5/61: getdents d7/d9 0 2024-04-21T23:43:20.052 INFO:tasks.workunit.client.0.smithi110.stdout:3/68: dwrite d6/fe [0,4194304] 0 2024-04-21T23:43:20.215 INFO:tasks.workunit.client.0.smithi110.stdout:7/48: read f9 [2957945,41162] 0 2024-04-21T23:43:20.251 INFO:tasks.workunit.client.0.smithi110.stdout:0/78: fsync d0/f12 0 2024-04-21T23:43:20.252 INFO:tasks.workunit.client.0.smithi110.stdout:4/42: chown f0 5 1 2024-04-21T23:43:20.447 INFO:tasks.workunit.client.0.smithi110.stdout:8/80: dread d5/f6 [0,4194304] 0 2024-04-21T23:43:20.491 INFO:tasks.workunit.client.0.smithi110.stdout:4/43: chown d1/d6/ff 912 1 2024-04-21T23:43:20.588 INFO:tasks.workunit.client.0.smithi110.stdout:6/65: creat f12 x:0 0 0 2024-04-21T23:43:20.717 INFO:tasks.workunit.client.0.smithi110.stdout:8/81: chown d5/fe 139727276 1 2024-04-21T23:43:20.803 INFO:tasks.workunit.client.0.smithi110.stdout:1/59: getdents d1/d4 0 2024-04-21T23:43:20.846 INFO:tasks.workunit.client.0.smithi110.stdout:2/54: dwrite d9/f10 [0,4194304] 0 2024-04-21T23:43:20.964 INFO:tasks.workunit.client.0.smithi110.stdout:9/63: readlink d1/d4/l11 0 2024-04-21T23:43:20.974 INFO:tasks.workunit.client.0.smithi110.stdout:8/82: chown d5/f6 3 1 2024-04-21T23:43:20.996 INFO:tasks.workunit.client.0.smithi110.stdout:8/83: readlink d5/l7 0 2024-04-21T23:43:21.095 INFO:tasks.workunit.client.0.smithi110.stdout:2/55: sync 2024-04-21T23:43:21.693 INFO:tasks.workunit.client.0.smithi110.stdout:0/79: write d0/fb [424802,86716] 0 2024-04-21T23:43:21.995 INFO:tasks.workunit.client.0.smithi110.stdout:4/44: symlink d1/d6/l10 0 2024-04-21T23:43:22.014 INFO:tasks.workunit.client.0.smithi110.stdout:4/45: chown d1/fd 55 1 2024-04-21T23:43:22.392 INFO:tasks.workunit.client.0.smithi110.stdout:5/62: link d7/fa d7/d9/fd 0 2024-04-21T23:43:22.427 INFO:tasks.workunit.client.0.smithi110.stdout:7/49: mknod d10/d15/c16 0 2024-04-21T23:43:22.543 INFO:tasks.workunit.client.0.smithi110.stdout:5/63: dread d7/d9/fd [0,4194304] 0 2024-04-21T23:43:22.564 INFO:tasks.workunit.client.0.smithi110.stdout:2/56: unlink d9/f11 0 2024-04-21T23:43:22.645 INFO:tasks.workunit.client.0.smithi110.stdout:5/64: truncate d7/d9/fd 1271846 0 2024-04-21T23:43:22.683 INFO:tasks.workunit.client.0.smithi110.stdout:6/66: write f4 [1975638,12044] 0 2024-04-21T23:43:23.098 INFO:tasks.workunit.client.0.smithi110.stdout:7/50: symlink d10/l17 0 2024-04-21T23:43:23.212 INFO:tasks.workunit.client.0.smithi110.stdout:6/67: mknod c13 0 2024-04-21T23:43:23.346 INFO:tasks.workunit.client.0.smithi110.stdout:5/65: rename d7/lc to d7/d9/le 0 2024-04-21T23:43:23.507 INFO:tasks.workunit.client.0.smithi110.stdout:3/69: creat d6/d12/d16/f17 x:0 0 0 2024-04-21T23:43:23.527 INFO:tasks.workunit.client.0.smithi110.stdout:9/64: link d1/d4/fb d1/d4/d6/d12/f13 0 2024-04-21T23:43:23.527 INFO:tasks.workunit.client.0.smithi110.stdout:1/60: getdents d1/d4 0 2024-04-21T23:43:23.569 INFO:tasks.workunit.client.0.smithi110.stdout:4/46: mkdir d1/d11 0 2024-04-21T23:43:23.658 INFO:tasks.workunit.client.0.smithi110.stdout:4/47: readlink d1/d6/l7 0 2024-04-21T23:43:23.767 INFO:tasks.workunit.client.0.smithi110.stdout:5/66: mkdir d7/d9/df 0 2024-04-21T23:43:23.772 INFO:tasks.workunit.client.0.smithi110.stdout:6/68: dread - f10 zero size 2024-04-21T23:43:23.947 INFO:tasks.workunit.client.0.smithi110.stdout:5/67: sync 2024-04-21T23:43:23.990 INFO:tasks.workunit.client.0.smithi110.stdout:8/84: getdents d5 0 2024-04-21T23:43:24.024 INFO:tasks.workunit.client.0.smithi110.stdout:1/61: mkdir d1/d2/d14 0 2024-04-21T23:43:24.102 INFO:tasks.workunit.client.0.smithi110.stdout:9/65: unlink d1/d4/l11 0 2024-04-21T23:43:24.331 INFO:tasks.workunit.client.0.smithi110.stdout:0/80: dwrite d0/fc [0,4194304] 0 2024-04-21T23:43:24.552 INFO:tasks.workunit.client.0.smithi110.stdout:5/68: creat d7/f10 x:0 0 0 2024-04-21T23:43:24.699 INFO:tasks.workunit.client.0.smithi110.stdout:4/48: mkdir d1/d11/d12 0 2024-04-21T23:43:24.834 INFO:tasks.workunit.client.0.smithi110.stdout:1/62: creat d1/d4/d10/f15 x:0 0 0 2024-04-21T23:43:24.849 INFO:tasks.workunit.client.0.smithi110.stdout:4/49: dread d1/fe [0,4194304] 0 2024-04-21T23:43:24.979 INFO:tasks.workunit.client.0.smithi110.stdout:7/51: write f9 [5031381,74702] 0 2024-04-21T23:43:25.116 INFO:tasks.workunit.client.0.smithi110.stdout:2/57: truncate d9/fa 1292686 0 2024-04-21T23:43:25.642 INFO:tasks.workunit.client.0.smithi110.stdout:8/85: mknod d5/d10/c15 0 2024-04-21T23:43:26.087 INFO:tasks.workunit.client.0.smithi110.stdout:6/69: link l2 l14 0 2024-04-21T23:43:26.199 INFO:tasks.workunit.client.0.smithi110.stdout:7/52: mknod d10/c18 0 2024-04-21T23:43:26.278 INFO:tasks.workunit.client.0.smithi110.stdout:3/70: dwrite d6/f8 [0,4194304] 0 2024-04-21T23:43:26.445 INFO:tasks.workunit.client.0.smithi110.stdout:2/58: creat d9/f17 x:0 0 0 2024-04-21T23:43:26.596 INFO:tasks.workunit.client.0.smithi110.stdout:0/81: symlink d0/d14/l15 0 2024-04-21T23:43:26.804 INFO:tasks.workunit.client.0.smithi110.stdout:7/53: dwrite d10/f12 [0,4194304] 0 2024-04-21T23:43:26.817 INFO:tasks.workunit.client.0.smithi110.stdout:3/71: dread f1 [4194304,4194304] 0 2024-04-21T23:43:26.982 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:43:26.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:43:27.058 INFO:tasks.workunit.client.0.smithi110.stdout:0/82: dread d0/f11 [0,4194304] 0 2024-04-21T23:43:27.195 INFO:tasks.workunit.client.0.smithi110.stdout:0/83: dread d0/fa [0,4194304] 0 2024-04-21T23:43:27.224 INFO:tasks.workunit.client.0.smithi110.stdout:0/84: fsync d0/fb 0 2024-04-21T23:43:27.684 INFO:tasks.workunit.client.0.smithi110.stdout:1/63: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:43:27.800 INFO:tasks.workunit.client.0.smithi110.stdout:6/70: creat f15 x:0 0 0 2024-04-21T23:43:28.072 INFO:tasks.workunit.client.0.smithi110.stdout:9/66: link d1/d4/dc/fd d1/d4/f14 0 2024-04-21T23:43:28.105 INFO:tasks.workunit.client.0.smithi110.stdout:2/59: fdatasync d9/f13 0 2024-04-21T23:43:28.161 INFO:tasks.workunit.client.0.smithi110.stdout:6/71: dwrite f15 [0,4194304] 0 2024-04-21T23:43:28.661 INFO:tasks.workunit.client.0.smithi110.stdout:5/69: dwrite f5 [0,4194304] 0 2024-04-21T23:43:28.835 INFO:tasks.workunit.client.0.smithi110.stdout:0/85: mkdir d0/d16 0 2024-04-21T23:43:28.919 INFO:tasks.workunit.client.0.smithi110.stdout:3/72: chown d6/fe 0 1 2024-04-21T23:43:28.953 INFO:tasks.workunit.client.0.smithi110.stdout:5/70: dread d7/fa [0,4194304] 0 2024-04-21T23:43:29.117 INFO:tasks.workunit.client.0.smithi110.stdout:3/73: dread f0 [0,4194304] 0 2024-04-21T23:43:29.432 INFO:tasks.workunit.client.0.smithi110.stdout:6/72: mkdir d16 0 2024-04-21T23:43:29.947 INFO:tasks.workunit.client.0.smithi110.stdout:4/50: link d1/f5 d1/f13 0 2024-04-21T23:43:30.062 INFO:tasks.workunit.client.0.smithi110.stdout:0/86: creat d0/f17 x:0 0 0 2024-04-21T23:43:30.324 INFO:tasks.workunit.client.0.smithi110.stdout:1/64: mkdir d1/d2/d14/d16 0 2024-04-21T23:43:30.324 INFO:tasks.workunit.client.0.smithi110.stdout:5/71: creat d7/d9/f11 x:0 0 0 2024-04-21T23:43:30.878 INFO:tasks.workunit.client.0.smithi110.stdout:6/73: rename f8 to d16/f17 0 2024-04-21T23:43:30.982 INFO:tasks.workunit.client.0.smithi110.stdout:6/74: read f15 [275781,81666] 0 2024-04-21T23:43:31.114 INFO:tasks.workunit.client.0.smithi110.stdout:8/86: getdents d5/d9 0 2024-04-21T23:43:31.153 INFO:tasks.workunit.client.0.smithi110.stdout:7/54: write f8 [146767,116370] 0 2024-04-21T23:43:31.317 INFO:tasks.workunit.client.0.smithi110.stdout:2/60: dwrite d9/f15 [0,4194304] 0 2024-04-21T23:43:31.456 INFO:tasks.workunit.client.0.smithi110.stdout:7/55: write f8 [257640,60329] 0 2024-04-21T23:43:31.998 INFO:tasks.workunit.client.0.smithi110.stdout:3/74: dwrite f3 [8388608,4194304] 0 2024-04-21T23:43:32.461 INFO:tasks.workunit.client.0.smithi110.stdout:1/65: mknod d1/c17 0 2024-04-21T23:43:32.529 INFO:tasks.workunit.client.0.smithi110.stdout:7/56: creat d10/f19 x:0 0 0 2024-04-21T23:43:32.554 INFO:tasks.workunit.client.0.smithi110.stdout:9/67: getdents d1/d4/d6/d12 0 2024-04-21T23:43:32.613 INFO:tasks.workunit.client.0.smithi110.stdout:0/87: write d0/f12 [3700174,52285] 0 2024-04-21T23:43:32.799 INFO:tasks.workunit.client.0.smithi110.stdout:2/61: mknod d9/d16/c18 0 2024-04-21T23:43:32.843 INFO:tasks.workunit.client.0.smithi110.stdout:8/87: dread d5/f6 [0,4194304] 0 2024-04-21T23:43:33.103 INFO:tasks.workunit.client.0.smithi110.stdout:4/51: dwrite d1/d6/ff [0,4194304] 0 2024-04-21T23:43:33.240 INFO:tasks.workunit.client.0.smithi110.stdout:3/75: symlink d6/l18 0 2024-04-21T23:43:33.569 INFO:tasks.workunit.client.0.smithi110.stdout:6/75: dwrite f10 [0,4194304] 0 2024-04-21T23:43:33.706 INFO:tasks.workunit.client.0.smithi110.stdout:1/66: symlink d1/l18 0 2024-04-21T23:43:33.759 INFO:tasks.workunit.client.0.smithi110.stdout:8/88: fsync d5/d9/f14 0 2024-04-21T23:43:33.893 INFO:tasks.workunit.client.0.smithi110.stdout:9/68: unlink d1/d4/fb 0 2024-04-21T23:43:33.976 INFO:tasks.workunit.client.0.smithi110.stdout:5/72: creat d7/f12 x:0 0 0 2024-04-21T23:43:34.009 INFO:tasks.workunit.client.0.smithi110.stdout:8/89: dread d5/fe [0,4194304] 0 2024-04-21T23:43:34.045 INFO:tasks.workunit.client.0.smithi110.stdout:7/57: rename lf to d10/l1a 0 2024-04-21T23:43:34.063 INFO:tasks.workunit.client.0.smithi110.stdout:7/58: chown d10/f14 162632 1 2024-04-21T23:43:34.108 INFO:tasks.workunit.client.0.smithi110.stdout:4/52: read d1/f8 [715936,33115] 0 2024-04-21T23:43:34.148 INFO:tasks.workunit.client.0.smithi110.stdout:3/76: chown d6/c11 10283 1 2024-04-21T23:43:34.294 INFO:tasks.workunit.client.0.smithi110.stdout:0/88: creat d0/d16/f18 x:0 0 0 2024-04-21T23:43:34.515 INFO:tasks.workunit.client.0.smithi110.stdout:6/76: mkdir d16/d18 0 2024-04-21T23:43:34.752 INFO:tasks.workunit.client.0.smithi110.stdout:5/73: mkdir d7/d9/d13 0 2024-04-21T23:43:34.854 INFO:tasks.workunit.client.0.smithi110.stdout:9/69: truncate d1/d4/f14 30577 0 2024-04-21T23:43:35.058 INFO:tasks.workunit.client.0.smithi110.stdout:7/59: unlink d10/c11 0 2024-04-21T23:43:35.382 INFO:tasks.workunit.client.0.smithi110.stdout:7/60: sync 2024-04-21T23:43:35.515 INFO:tasks.workunit.client.0.smithi110.stdout:0/89: creat d0/f19 x:0 0 0 2024-04-21T23:43:35.863 INFO:tasks.workunit.client.0.smithi110.stdout:6/77: creat d16/f19 x:0 0 0 2024-04-21T23:43:36.418 INFO:tasks.workunit.client.0.smithi110.stdout:7/61: rename d10/f12 to d10/d15/f1b 0 2024-04-21T23:43:36.437 INFO:tasks.workunit.client.0.smithi110.stdout:8/90: dwrite d5/ff [0,4194304] 0 2024-04-21T23:43:36.563 INFO:tasks.workunit.client.0.smithi110.stdout:8/91: chown d5/d10 108 1 2024-04-21T23:43:36.591 INFO:tasks.workunit.client.0.smithi110.stdout:0/90: mknod d0/c1a 0 2024-04-21T23:43:36.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/53: write d1/f13 [418169,9292] 0 2024-04-21T23:43:36.642 INFO:tasks.workunit.client.0.smithi110.stdout:4/54: chown d1/d11/d12 647240 1 2024-04-21T23:43:36.951 INFO:tasks.workunit.client.0.smithi110.stdout:0/91: dwrite d0/d16/f18 [0,4194304] 0 2024-04-21T23:43:36.999 INFO:tasks.workunit.client.0.smithi110.stdout:2/62: getdents d9 0 2024-04-21T23:43:37.334 INFO:tasks.workunit.client.0.smithi110.stdout:8/92: symlink d5/da/l16 0 2024-04-21T23:43:37.348 INFO:tasks.workunit.client.0.smithi110.stdout:7/62: chown fd 9 1 2024-04-21T23:43:37.509 INFO:tasks.workunit.client.0.smithi110.stdout:4/55: dread d1/fd [0,4194304] 0 2024-04-21T23:43:37.569 INFO:tasks.workunit.client.0.smithi110.stdout:4/56: dread d1/fd [0,4194304] 0 2024-04-21T23:43:38.154 INFO:tasks.workunit.client.0.smithi110.stdout:1/67: link d1/d4/f9 d1/d4/d10/f19 0 2024-04-21T23:43:38.235 INFO:tasks.workunit.client.0.smithi110.stdout:5/74: rmdir d7/d9/df 0 2024-04-21T23:43:38.260 INFO:tasks.workunit.client.0.smithi110.stdout:5/75: dread - d7/f12 zero size 2024-04-21T23:43:38.500 INFO:tasks.workunit.client.0.smithi110.stdout:3/77: getdents d6/d12 0 2024-04-21T23:43:38.578 INFO:tasks.workunit.client.0.smithi110.stdout:9/70: write d1/d4/f14 [757661,32767] 0 2024-04-21T23:43:38.643 INFO:tasks.workunit.client.0.smithi110.stdout:9/71: fdatasync d1/d4/f14 0 2024-04-21T23:43:38.691 INFO:tasks.workunit.client.0.smithi110.stdout:9/72: chown d1/d4/dc/fd 340 1 2024-04-21T23:43:38.857 INFO:tasks.workunit.client.0.smithi110.stdout:8/93: rename d5/d10 to d5/da/d17 0 2024-04-21T23:43:38.873 INFO:tasks.workunit.client.0.smithi110.stdout:4/57: unlink d1/d6/l10 0 2024-04-21T23:43:38.958 INFO:tasks.workunit.client.0.smithi110.stdout:4/58: fsync d1/f13 0 2024-04-21T23:43:39.016 INFO:tasks.workunit.client.0.smithi110.stdout:8/94: dread d5/d9/f14 [0,4194304] 0 2024-04-21T23:43:39.045 INFO:tasks.workunit.client.0.smithi110.stdout:8/95: dread - d5/f12 zero size 2024-04-21T23:43:39.148 INFO:tasks.workunit.client.0.smithi110.stdout:6/78: rmdir d16/d18 0 2024-04-21T23:43:39.329 INFO:tasks.workunit.client.0.smithi110.stdout:8/96: chown d5/d9/f14 5437 1 2024-04-21T23:43:39.454 INFO:tasks.workunit.client.0.smithi110.stdout:7/63: truncate f2 530359 0 2024-04-21T23:43:39.536 INFO:tasks.workunit.client.0.smithi110.stdout:0/92: dwrite d0/f11 [0,4194304] 0 2024-04-21T23:43:39.561 INFO:tasks.workunit.client.0.smithi110.stdout:1/68: rename d1/l18 to d1/d4/l1a 0 2024-04-21T23:43:39.673 INFO:tasks.workunit.client.0.smithi110.stdout:2/63: link l2 d9/d16/l19 0 2024-04-21T23:43:39.688 INFO:tasks.workunit.client.0.smithi110.stdout:7/64: sync 2024-04-21T23:43:39.698 INFO:tasks.workunit.client.0.smithi110.stdout:6/79: fdatasync f12 0 2024-04-21T23:43:39.700 INFO:tasks.workunit.client.0.smithi110.stdout:5/76: unlink d7/d9/le 0 2024-04-21T23:43:39.708 INFO:tasks.workunit.client.0.smithi110.stdout:4/59: dwrite d1/f13 [0,4194304] 0 2024-04-21T23:43:39.826 INFO:tasks.workunit.client.0.smithi110.stdout:6/80: sync 2024-04-21T23:43:39.828 INFO:tasks.workunit.client.0.smithi110.stdout:5/77: chown l3 108 1 2024-04-21T23:43:39.834 INFO:tasks.workunit.client.0.smithi110.stdout:9/73: dread - d1/d4/d6/d12/f13 zero size 2024-04-21T23:43:39.869 INFO:tasks.workunit.client.0.smithi110.stdout:9/74: write d1/d4/dc/fd [417984,78180] 0 2024-04-21T23:43:39.879 INFO:tasks.workunit.client.0.smithi110.stdout:4/60: sync 2024-04-21T23:43:40.072 INFO:tasks.workunit.client.0.smithi110.stdout:3/78: creat d6/f19 x:0 0 0 2024-04-21T23:43:40.439 INFO:tasks.workunit.client.0.smithi110.stdout:5/78: creat d7/f14 x:0 0 0 2024-04-21T23:43:40.507 INFO:tasks.workunit.client.0.smithi110.stdout:5/79: dread - d7/f12 zero size 2024-04-21T23:43:40.551 INFO:tasks.workunit.client.0.smithi110.stdout:5/80: truncate d7/f14 862246 0 2024-04-21T23:43:40.682 INFO:tasks.workunit.client.0.smithi110.stdout:4/61: symlink d1/d11/l14 0 2024-04-21T23:43:40.986 INFO:tasks.workunit.client.0.smithi110.stdout:3/79: truncate f0 1379755 0 2024-04-21T23:43:41.000 INFO:tasks.workunit.client.0.smithi110.stdout:3/80: chown d6/l18 715133 1 2024-04-21T23:43:41.155 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:51:21.415 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.161 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:51:21.422 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.265 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:51:21.460 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.268 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:51:21.464 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.276 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:51:21.536 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.312 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:51:21.508 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.316 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:51:21.512 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.331 INFO:tasks.workunit.client.0.smithi110.stdout:8/97: dwrite d5/f12 [0,4194304] 0 2024-04-21T23:43:41.360 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:51:21.555 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.412 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:51:21.607 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:43:41.492 INFO:tasks.workunit.client.0.smithi110.stdout:0/93: write d0/fa [1833665,111249] 0 2024-04-21T23:43:41.624 INFO:tasks.workunit.client.0.smithi110.stdout:0/94: sync 2024-04-21T23:43:41.821 INFO:tasks.workunit.client.0.smithi110.stdout:1/69: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:43:41.918 INFO:tasks.workunit.client.0.smithi110.stdout:7/65: dwrite d10/f13 [0,4194304] 0 2024-04-21T23:43:41.928 INFO:tasks.workunit.client.0.smithi110.stdout:3/81: read - d6/d12/d16/f17 zero size 2024-04-21T23:43:42.013 INFO:tasks.workunit.client.0.smithi110.stdout:4/62: mknod d1/c15 0 2024-04-21T23:43:42.088 INFO:tasks.workunit.client.0.smithi110.stdout:8/98: mknod d5/d9/c18 0 2024-04-21T23:43:42.255 INFO:tasks.workunit.client.0.smithi110.stdout:0/95: mknod d0/c1b 0 2024-04-21T23:43:42.353 INFO:tasks.workunit.client.0.smithi110.stdout:6/81: getdents d16 0 2024-04-21T23:43:42.382 INFO:tasks.workunit.client.0.smithi110.stdout:9/75: dwrite d1/f7 [0,4194304] 0 2024-04-21T23:43:42.573 INFO:tasks.workunit.client.0.smithi110.stdout:2/64: dwrite d9/fa [0,4194304] 0 2024-04-21T23:43:42.729 INFO:tasks.workunit.client.0.smithi110.stdout:7/66: read f5 [5976721,126268] 0 2024-04-21T23:43:42.732 INFO:tasks.workunit.client.0.smithi110.stdout:1/70: rename d1/d4 to d1/d2/d1b 0 2024-04-21T23:43:42.748 INFO:tasks.workunit.client.0.smithi110.stdout:7/67: stat d10 0 2024-04-21T23:43:42.876 INFO:tasks.workunit.client.0.smithi110.stdout:4/63: mknod d1/d6/c16 0 2024-04-21T23:43:42.878 INFO:tasks.workunit.client.0.smithi110.stdout:3/82: creat d6/d12/f1a x:0 0 0 2024-04-21T23:43:43.267 INFO:tasks.workunit.client.0.smithi110.stdout:8/99: symlink d5/da/d17/l19 0 2024-04-21T23:43:43.310 INFO:tasks.workunit.client.0.smithi110.stdout:5/81: getdents d7 0 2024-04-21T23:43:43.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/96: creat d0/d14/f1c x:0 0 0 2024-04-21T23:43:43.585 INFO:tasks.workunit.client.0.smithi110.stdout:9/76: creat d1/f15 x:0 0 0 2024-04-21T23:43:43.825 INFO:tasks.workunit.client.0.smithi110.stdout:7/68: mknod d10/c1c 0 2024-04-21T23:43:44.101 INFO:tasks.workunit.client.0.smithi110.stdout:8/100: mknod d5/c1a 0 2024-04-21T23:43:44.114 INFO:tasks.workunit.client.0.smithi110.stdout:5/82: fdatasync d7/fa 0 2024-04-21T23:43:44.158 INFO:tasks.workunit.client.0.smithi110.stdout:0/97: rename d0/l4 to d0/l1d 0 2024-04-21T23:43:44.173 INFO:tasks.workunit.client.0.smithi110.stdout:9/77: truncate d1/d4/d6/fe 2887151 0 2024-04-21T23:43:44.310 INFO:tasks.workunit.client.0.smithi110.stdout:7/69: rename d10/f14 to d10/f1d 0 2024-04-21T23:43:44.310 INFO:tasks.workunit.client.0.smithi110.stdout:9/78: read - d1/d4/d6/d12/f13 zero size 2024-04-21T23:43:44.346 INFO:tasks.workunit.client.0.smithi110.stdout:4/64: symlink d1/d11/d12/l17 0 2024-04-21T23:43:44.415 INFO:tasks.workunit.client.0.smithi110.stdout:4/65: stat d1 0 2024-04-21T23:43:44.572 INFO:tasks.workunit.client.0.smithi110.stdout:8/101: dwrite d5/f12 [0,4194304] 0 2024-04-21T23:43:44.733 INFO:tasks.workunit.client.0.smithi110.stdout:5/83: chown d7/l8 12611915 1 2024-04-21T23:43:44.785 INFO:tasks.workunit.client.0.smithi110.stdout:0/98: creat d0/f1e x:0 0 0 2024-04-21T23:43:44.900 INFO:tasks.workunit.client.0.smithi110.stdout:7/70: mknod d10/c1e 0 2024-04-21T23:43:45.173 INFO:tasks.workunit.client.0.smithi110.stdout:9/79: dwrite d1/f7 [0,4194304] 0 2024-04-21T23:43:45.424 INFO:tasks.workunit.client.0.smithi110.stdout:6/82: write d16/f19 [853915,11191] 0 2024-04-21T23:43:45.462 INFO:tasks.workunit.client.0.smithi110.stdout:3/83: write f3 [2775906,118716] 0 2024-04-21T23:43:45.549 INFO:tasks.workunit.client.0.smithi110.stdout:4/66: dwrite d1/f13 [0,4194304] 0 2024-04-21T23:43:45.793 INFO:tasks.workunit.client.0.smithi110.stdout:0/99: dread d0/f11 [0,4194304] 0 2024-04-21T23:43:45.823 INFO:tasks.workunit.client.0.smithi110.stdout:9/80: chown d1/l2 278396190 1 2024-04-21T23:43:45.901 INFO:tasks.workunit.client.0.smithi110.stdout:7/71: read - fe zero size 2024-04-21T23:43:46.147 INFO:tasks.workunit.client.0.smithi110.stdout:1/71: link d1/d2/d1b/l1a d1/l1c 0 2024-04-21T23:43:46.318 INFO:tasks.workunit.client.0.smithi110.stdout:4/67: dread f0 [0,4194304] 0 2024-04-21T23:43:46.366 INFO:tasks.workunit.client.0.smithi110.stdout:2/65: dwrite f5 [0,4194304] 0 2024-04-21T23:43:46.676 INFO:tasks.workunit.client.0.smithi110.stdout:5/84: symlink d7/d9/d13/l15 0 2024-04-21T23:43:46.695 INFO:tasks.workunit.client.0.smithi110.stdout:3/84: mknod d6/d12/d14/c1b 0 2024-04-21T23:43:46.774 INFO:tasks.workunit.client.0.smithi110.stdout:4/68: write d1/f8 [3256053,46871] 0 2024-04-21T23:43:46.946 INFO:tasks.workunit.client.0.smithi110.stdout:5/85: dread - d7/f10 zero size 2024-04-21T23:43:47.013 INFO:tasks.workunit.client.0.smithi110.stdout:9/81: dwrite d1/f7 [4194304,4194304] 0 2024-04-21T23:43:47.216 INFO:tasks.workunit.client.0.smithi110.stdout:9/82: sync 2024-04-21T23:43:47.256 INFO:tasks.workunit.client.0.smithi110.stdout:7/72: symlink d10/d15/l1f 0 2024-04-21T23:43:47.269 INFO:tasks.workunit.client.0.smithi110.stdout:8/102: dwrite d5/fe [0,4194304] 0 2024-04-21T23:43:47.409 INFO:tasks.workunit.client.0.smithi110.stdout:6/83: rename l14 to d16/l1a 0 2024-04-21T23:43:47.550 INFO:tasks.workunit.client.0.smithi110.stdout:2/66: mkdir d9/d1a 0 2024-04-21T23:43:47.608 INFO:tasks.workunit.client.0.smithi110.stdout:1/72: read d1/d2/d1b/f11 [4006712,50177] 0 2024-04-21T23:43:47.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/103: read d5/f12 [1607841,48089] 0 2024-04-21T23:43:47.715 INFO:tasks.workunit.client.0.smithi110.stdout:4/69: dread d1/f8 [0,4194304] 0 2024-04-21T23:43:47.968 INFO:tasks.workunit.client.0.smithi110.stdout:2/67: dread d9/f15 [0,4194304] 0 2024-04-21T23:43:48.010 INFO:tasks.workunit.client.0.smithi110.stdout:4/70: dread d1/fc [0,4194304] 0 2024-04-21T23:43:48.035 INFO:tasks.workunit.client.0.smithi110.stdout:3/85: symlink d6/d12/d16/l1c 0 2024-04-21T23:43:48.064 INFO:tasks.workunit.client.0.smithi110.stdout:0/100: write d0/fb [684357,22649] 0 2024-04-21T23:43:48.553 INFO:tasks.workunit.client.0.smithi110.stdout:9/83: truncate d1/d4/f14 1515208 0 2024-04-21T23:43:48.609 INFO:tasks.workunit.client.0.smithi110.stdout:8/104: mknod d5/da/d17/c1b 0 2024-04-21T23:43:48.753 INFO:tasks.workunit.client.0.smithi110.stdout:2/68: mkdir d9/d16/d1b 0 2024-04-21T23:43:48.860 INFO:tasks.workunit.client.0.smithi110.stdout:3/86: fsync f1 0 2024-04-21T23:43:49.086 INFO:tasks.workunit.client.0.smithi110.stdout:4/71: creat d1/d11/d12/f18 x:0 0 0 2024-04-21T23:43:49.163 INFO:tasks.workunit.client.0.smithi110.stdout:0/101: mknod d0/d16/c1f 0 2024-04-21T23:43:49.297 INFO:tasks.workunit.client.0.smithi110.stdout:4/72: dread d1/f8 [0,4194304] 0 2024-04-21T23:43:49.322 INFO:tasks.workunit.client.0.smithi110.stdout:4/73: chown d1/f13 1004 1 2024-04-21T23:43:49.380 INFO:tasks.workunit.client.0.smithi110.stdout:7/73: fsync d10/f1d 0 2024-04-21T23:43:49.667 INFO:tasks.workunit.client.0.smithi110.stdout:6/84: truncate f9 475747 0 2024-04-21T23:43:49.764 INFO:tasks.workunit.client.0.smithi110.stdout:1/73: mkdir d1/d1d 0 2024-04-21T23:43:49.850 INFO:tasks.workunit.client.0.smithi110.stdout:5/86: dwrite d7/f12 [0,4194304] 0 2024-04-21T23:43:49.891 INFO:tasks.workunit.client.0.smithi110.stdout:1/74: sync 2024-04-21T23:43:50.074 INFO:tasks.workunit.client.0.smithi110.stdout:2/69: mkdir d9/d16/d1c 0 2024-04-21T23:43:50.255 INFO:tasks.workunit.client.0.smithi110.stdout:3/87: stat d6/lc 0 2024-04-21T23:43:50.676 INFO:tasks.workunit.client.0.smithi110.stdout:4/74: creat d1/d11/d12/f19 x:0 0 0 2024-04-21T23:43:50.713 INFO:tasks.workunit.client.0.smithi110.stdout:4/75: read - d1/d11/d12/f18 zero size 2024-04-21T23:43:50.811 INFO:tasks.workunit.client.0.smithi110.stdout:7/74: fdatasync d10/f19 0 2024-04-21T23:43:50.840 INFO:tasks.workunit.client.0.smithi110.stdout:7/75: dread - d10/f1d zero size 2024-04-21T23:43:51.066 INFO:tasks.workunit.client.0.smithi110.stdout:6/85: dread f10 [0,4194304] 0 2024-04-21T23:43:51.665 INFO:tasks.workunit.client.0.smithi110.stdout:8/105: dwrite d5/da/fc [0,4194304] 0 2024-04-21T23:43:51.775 INFO:tasks.workunit.client.0.smithi110.stdout:1/75: truncate d1/d2/d1b/f9 1529321 0 2024-04-21T23:43:51.803 INFO:tasks.workunit.client.0.smithi110.stdout:0/102: link d0/f11 d0/f20 0 2024-04-21T23:43:51.824 INFO:tasks.workunit.client.0.smithi110.stdout:4/76: creat d1/d11/f1a x:0 0 0 2024-04-21T23:43:51.961 INFO:tasks.workunit.client.0.smithi110.stdout:6/86: fsync f1 0 2024-04-21T23:43:52.503 INFO:tasks.workunit.client.0.smithi110.stdout:2/70: mkdir d9/d1a/d1d 0 2024-04-21T23:43:52.693 INFO:tasks.workunit.client.0.smithi110.stdout:9/84: write d1/d4/f14 [1018051,9188] 0 2024-04-21T23:43:52.890 INFO:tasks.workunit.client.0.smithi110.stdout:4/77: symlink d1/d6/l1b 0 2024-04-21T23:43:53.148 INFO:tasks.workunit.client.0.smithi110.stdout:8/106: mknod d5/c1c 0 2024-04-21T23:43:53.656 INFO:tasks.workunit.client.0.smithi110.stdout:2/71: creat d9/d1a/f1e x:0 0 0 2024-04-21T23:43:53.792 INFO:tasks.workunit.client.0.smithi110.stdout:3/88: creat d6/f1d x:0 0 0 2024-04-21T23:43:53.813 INFO:tasks.workunit.client.0.smithi110.stdout:3/89: chown d6/fe 0 1 2024-04-21T23:43:54.064 INFO:tasks.workunit.client.0.smithi110.stdout:4/78: rmdir d1/d11/d12 39 2024-04-21T23:43:54.680 INFO:tasks.workunit.client.0.smithi110.stdout:5/87: getdents d7/d9/d13 0 2024-04-21T23:43:54.879 INFO:tasks.workunit.client.0.smithi110.stdout:3/90: fdatasync f3 0 2024-04-21T23:43:54.957 INFO:tasks.workunit.client.0.smithi110.stdout:7/76: getdents d10/d15 0 2024-04-21T23:43:55.115 INFO:tasks.workunit.client.0.smithi110.stdout:4/79: fdatasync d1/f8 0 2024-04-21T23:43:55.220 INFO:tasks.workunit.client.0.smithi110.stdout:6/87: write f15 [1771450,114244] 0 2024-04-21T23:43:55.549 INFO:tasks.workunit.client.0.smithi110.stdout:9/85: creat d1/d4/d6/d12/f16 x:0 0 0 2024-04-21T23:43:55.604 INFO:tasks.workunit.client.0.smithi110.stdout:9/86: write d1/d4/dc/fd [104730,67994] 0 2024-04-21T23:43:55.638 INFO:tasks.workunit.client.0.smithi110.stdout:9/87: chown d1/f7 982 1 2024-04-21T23:43:55.820 INFO:tasks.workunit.client.0.smithi110.stdout:7/77: rename d10/d15/l1f to d10/d15/l20 0 2024-04-21T23:43:55.881 INFO:tasks.workunit.client.0.smithi110.stdout:0/103: getdents d0 0 2024-04-21T23:43:55.894 INFO:tasks.workunit.client.0.smithi110.stdout:7/78: stat f6 0 2024-04-21T23:43:55.949 INFO:tasks.workunit.client.0.smithi110.stdout:2/72: unlink d9/f17 0 2024-04-21T23:43:56.011 INFO:tasks.workunit.client.0.smithi110.stdout:4/80: write d1/d11/d12/f18 [222308,16261] 0 2024-04-21T23:43:56.063 INFO:tasks.workunit.client.0.smithi110.stdout:1/76: getdents d1/d2/d14 0 2024-04-21T23:43:56.528 INFO:tasks.workunit.client.0.smithi110.stdout:8/107: dwrite d5/f6 [0,4194304] 0 2024-04-21T23:43:56.635 INFO:tasks.workunit.client.0.smithi110.stdout:3/91: fsync d6/fd 0 2024-04-21T23:43:56.665 INFO:tasks.workunit.client.0.smithi110.stdout:9/88: symlink d1/l17 0 2024-04-21T23:43:56.702 INFO:tasks.workunit.client.0.smithi110.stdout:9/89: readlink d1/l17 0 2024-04-21T23:43:56.853 INFO:tasks.workunit.client.0.smithi110.stdout:7/79: creat d10/d15/f21 x:0 0 0 2024-04-21T23:43:56.880 INFO:tasks.workunit.client.0.smithi110.stdout:7/80: chown d10/d15/c16 33 1 2024-04-21T23:43:56.958 INFO:tasks.workunit.client.0.smithi110.stdout:9/90: sync 2024-04-21T23:43:57.005 INFO:tasks.workunit.client.0.smithi110.stdout:4/81: fsync d1/fe 0 2024-04-21T23:43:57.049 INFO:tasks.workunit.client.0.smithi110.stdout:5/88: write f5 [3168040,84952] 0 2024-04-21T23:43:57.099 INFO:tasks.workunit.client.0.smithi110.stdout:2/73: dread d9/fa [0,4194304] 0 2024-04-21T23:43:57.100 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:43:57.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:43:57.144 INFO:tasks.workunit.client.0.smithi110.stdout:9/91: write d1/d4/f14 [536013,92382] 0 2024-04-21T23:43:57.495 INFO:tasks.workunit.client.0.smithi110.stdout:8/108: creat d5/f1d x:0 0 0 2024-04-21T23:43:57.678 INFO:tasks.workunit.client.0.smithi110.stdout:7/81: mkdir d10/d15/d22 0 2024-04-21T23:43:57.685 INFO:tasks.workunit.client.0.smithi110.stdout:6/88: write f1 [540347,4206] 0 2024-04-21T23:43:58.050 INFO:tasks.workunit.client.0.smithi110.stdout:4/82: mkdir d1/d6/d1c 0 2024-04-21T23:43:58.460 INFO:tasks.workunit.client.0.smithi110.stdout:0/104: creat d0/f21 x:0 0 0 2024-04-21T23:43:58.486 INFO:tasks.workunit.client.0.smithi110.stdout:9/92: read d1/d4/d6/fe [939201,76060] 0 2024-04-21T23:43:58.511 INFO:tasks.workunit.client.0.smithi110.stdout:0/105: fdatasync d0/f21 0 2024-04-21T23:43:58.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/82: creat d10/f23 x:0 0 0 2024-04-21T23:43:58.867 INFO:tasks.workunit.client.0.smithi110.stdout:7/83: chown fe 3564 1 2024-04-21T23:43:59.015 INFO:tasks.workunit.client.0.smithi110.stdout:6/89: rename fa to d16/f1b 0 2024-04-21T23:43:59.185 INFO:tasks.workunit.client.0.smithi110.stdout:4/83: mknod d1/d6/c1d 0 2024-04-21T23:43:59.286 INFO:tasks.workunit.client.0.smithi110.stdout:3/92: write d6/f8 [734480,129226] 0 2024-04-21T23:43:59.325 INFO:tasks.workunit.client.0.smithi110.stdout:3/93: dread - d6/f1d zero size 2024-04-21T23:43:59.349 INFO:tasks.workunit.client.0.smithi110.stdout:3/94: chown d6/f8 23964 1 2024-04-21T23:43:59.442 INFO:tasks.workunit.client.0.smithi110.stdout:2/74: creat d9/d16/d1b/f1f x:0 0 0 2024-04-21T23:43:59.536 INFO:tasks.workunit.client.0.smithi110.stdout:9/93: symlink d1/l18 0 2024-04-21T23:43:59.795 INFO:tasks.workunit.client.0.smithi110.stdout:7/84: read f8 [504180,130524] 0 2024-04-21T23:44:00.073 INFO:tasks.workunit.client.0.smithi110.stdout:5/89: dwrite d7/d9/fd [0,4194304] 0 2024-04-21T23:44:00.272 INFO:tasks.workunit.client.0.smithi110.stdout:8/109: write d5/f12 [4157181,127838] 0 2024-04-21T23:44:00.321 INFO:tasks.workunit.client.0.smithi110.stdout:8/110: fdatasync d5/f12 0 2024-04-21T23:44:00.493 INFO:tasks.workunit.client.0.smithi110.stdout:9/94: rename d1/d4/d6/d12 to d1/d19 0 2024-04-21T23:44:00.687 INFO:tasks.workunit.client.0.smithi110.stdout:9/95: dread d1/d4/dc/fd [0,4194304] 0 2024-04-21T23:44:00.706 INFO:tasks.workunit.client.0.smithi110.stdout:9/96: chown d1/d19 138102465 1 2024-04-21T23:44:00.744 INFO:tasks.workunit.client.0.smithi110.stdout:9/97: write d1/d19/f16 [418095,56797] 0 2024-04-21T23:44:00.837 INFO:tasks.workunit.client.0.smithi110.stdout:4/84: truncate d1/f8 2147348 0 2024-04-21T23:44:00.881 INFO:tasks.workunit.client.0.smithi110.stdout:2/75: mknod d9/d16/d1c/c20 0 2024-04-21T23:44:00.937 INFO:tasks.workunit.client.0.smithi110.stdout:8/111: symlink d5/da/l1e 0 2024-04-21T23:44:00.945 INFO:tasks.workunit.client.0.smithi110.stdout:4/85: stat d1/f3 0 2024-04-21T23:44:01.172 INFO:tasks.workunit.client.0.smithi110.stdout:7/85: dread d10/d15/f1b [0,4194304] 0 2024-04-21T23:44:01.180 INFO:tasks.workunit.client.0.smithi110.stdout:1/77: dwrite d1/d2/d1b/d10/f19 [0,4194304] 0 2024-04-21T23:44:01.408 INFO:tasks.workunit.client.0.smithi110.stdout:0/106: write d0/d16/f18 [1867817,48427] 0 2024-04-21T23:44:01.466 INFO:tasks.workunit.client.0.smithi110.stdout:3/95: write d6/d12/d16/f17 [925263,120291] 0 2024-04-21T23:44:01.670 INFO:tasks.workunit.client.0.smithi110.stdout:9/98: write d1/d4/d6/fe [2289801,66374] 0 2024-04-21T23:44:01.864 INFO:tasks.workunit.client.0.smithi110.stdout:2/76: creat d9/d1a/f21 x:0 0 0 2024-04-21T23:44:01.919 INFO:tasks.workunit.client.0.smithi110.stdout:6/90: dwrite d16/f19 [0,4194304] 0 2024-04-21T23:44:01.974 INFO:tasks.workunit.client.0.smithi110.stdout:9/99: stat d1/d4/d6/fe 0 2024-04-21T23:44:02.125 INFO:tasks.workunit.client.0.smithi110.stdout:7/86: symlink d10/l24 0 2024-04-21T23:44:02.286 INFO:tasks.workunit.client.0.smithi110.stdout:0/107: chown d0/d14 0 1 2024-04-21T23:44:02.311 INFO:tasks.workunit.client.0.smithi110.stdout:5/90: dwrite d7/f12 [4194304,4194304] 0 2024-04-21T23:44:02.450 INFO:tasks.workunit.client.0.smithi110.stdout:9/100: chown d1/d19/f13 843 1 2024-04-21T23:44:02.486 INFO:tasks.workunit.client.0.smithi110.stdout:1/78: symlink d1/d1d/l1e 0 2024-04-21T23:44:02.700 INFO:tasks.workunit.client.0.smithi110.stdout:3/96: truncate f0 2139240 0 2024-04-21T23:44:02.909 INFO:tasks.workunit.client.0.smithi110.stdout:4/86: rename d1/d6/l1b to d1/l1e 0 2024-04-21T23:44:03.060 INFO:tasks.workunit.client.0.smithi110.stdout:8/112: dwrite d5/da/fc [0,4194304] 0 2024-04-21T23:44:03.438 INFO:tasks.workunit.client.0.smithi110.stdout:9/101: rmdir d1 39 2024-04-21T23:44:03.859 INFO:tasks.workunit.client.0.smithi110.stdout:7/87: rename fc to d10/d15/f25 0 2024-04-21T23:44:04.269 INFO:tasks.workunit.client.0.smithi110.stdout:5/91: write d7/d9/f11 [965919,42052] 0 2024-04-21T23:44:04.303 INFO:tasks.workunit.client.0.smithi110.stdout:2/77: write d9/ff [1194725,103326] 0 2024-04-21T23:44:04.325 INFO:tasks.workunit.client.0.smithi110.stdout:1/79: write d1/d2/d1b/d10/f12 [695030,29930] 0 2024-04-21T23:44:04.692 INFO:tasks.workunit.client.0.smithi110.stdout:6/91: getdents d16 0 2024-04-21T23:44:04.706 INFO:tasks.workunit.client.0.smithi110.stdout:7/88: write f9 [1109776,94171] 0 2024-04-21T23:44:04.743 INFO:tasks.workunit.client.0.smithi110.stdout:8/113: write d5/ff [1670791,60094] 0 2024-04-21T23:44:04.761 INFO:tasks.workunit.client.0.smithi110.stdout:0/108: write d0/f20 [4285189,41031] 0 2024-04-21T23:44:04.850 INFO:tasks.workunit.client.0.smithi110.stdout:2/78: mknod d9/d16/c22 0 2024-04-21T23:44:04.855 INFO:tasks.workunit.client.0.smithi110.stdout:4/87: dread d1/d6/ff [0,4194304] 0 2024-04-21T23:44:04.924 INFO:tasks.workunit.client.0.smithi110.stdout:1/80: write d1/d2/d1b/f11 [1285057,83868] 0 2024-04-21T23:44:05.000 INFO:tasks.workunit.client.0.smithi110.stdout:3/97: getdents d6/d12/d16 0 2024-04-21T23:44:05.008 INFO:tasks.workunit.client.0.smithi110.stdout:5/92: write d7/f14 [1291920,1107] 0 2024-04-21T23:44:05.052 INFO:tasks.workunit.client.0.smithi110.stdout:0/109: rmdir d0/d14 39 2024-04-21T23:44:05.069 INFO:tasks.workunit.client.0.smithi110.stdout:8/114: readlink d5/da/l16 0 2024-04-21T23:44:05.273 INFO:tasks.workunit.client.0.smithi110.stdout:6/92: write f15 [4920475,60949] 0 2024-04-21T23:44:05.277 INFO:tasks.workunit.client.0.smithi110.stdout:7/89: mknod d10/d15/c26 0 2024-04-21T23:44:05.322 INFO:tasks.workunit.client.0.smithi110.stdout:9/102: dwrite d1/d4/d6/fe [0,4194304] 0 2024-04-21T23:44:05.463 INFO:tasks.workunit.client.0.smithi110.stdout:4/88: creat d1/d6/f1f x:0 0 0 2024-04-21T23:44:05.480 INFO:tasks.workunit.client.0.smithi110.stdout:0/110: rmdir d0 39 2024-04-21T23:44:05.577 INFO:tasks.workunit.client.0.smithi110.stdout:5/93: creat d7/d9/f16 x:0 0 0 2024-04-21T23:44:05.587 INFO:tasks.workunit.client.0.smithi110.stdout:2/79: truncate d9/fa 832944 0 2024-04-21T23:44:05.632 INFO:tasks.workunit.client.0.smithi110.stdout:8/115: chown d5/da/d17/c15 543766 1 2024-04-21T23:44:05.786 INFO:tasks.workunit.client.0.smithi110.stdout:4/89: read d1/f3 [332221,88144] 0 2024-04-21T23:44:05.798 INFO:tasks.workunit.client.0.smithi110.stdout:1/81: dread d1/d2/d1b/f9 [0,4194304] 0 2024-04-21T23:44:05.911 INFO:tasks.workunit.client.0.smithi110.stdout:6/93: truncate f4 1464799 0 2024-04-21T23:44:05.957 INFO:tasks.workunit.client.0.smithi110.stdout:9/103: fdatasync d1/d19/f13 0 2024-04-21T23:44:06.275 INFO:tasks.workunit.client.0.smithi110.stdout:9/104: sync 2024-04-21T23:44:06.277 INFO:tasks.workunit.client.0.smithi110.stdout:0/111: chown d0/f13 0 1 2024-04-21T23:44:06.350 INFO:tasks.workunit.client.0.smithi110.stdout:9/105: chown d1/l17 31727111 1 2024-04-21T23:44:06.462 INFO:tasks.workunit.client.0.smithi110.stdout:8/116: truncate d5/f6 646594 0 2024-04-21T23:44:06.472 INFO:tasks.workunit.client.0.smithi110.stdout:4/90: dread d1/f5 [0,4194304] 0 2024-04-21T23:44:06.475 INFO:tasks.workunit.client.0.smithi110.stdout:7/90: truncate d10/d15/f21 950820 0 2024-04-21T23:44:06.500 INFO:tasks.workunit.client.0.smithi110.stdout:5/94: rename d7/d9/d13 to d7/d9/d17 0 2024-04-21T23:44:06.760 INFO:tasks.workunit.client.0.smithi110.stdout:6/94: rename d16/f19 to d16/f1c 0 2024-04-21T23:44:06.774 INFO:tasks.workunit.client.0.smithi110.stdout:3/98: link c4 d6/d12/d16/c1e 0 2024-04-21T23:44:06.796 INFO:tasks.workunit.client.0.smithi110.stdout:7/91: dread f5 [4194304,4194304] 0 2024-04-21T23:44:06.826 INFO:tasks.workunit.client.0.smithi110.stdout:5/95: dread d7/f14 [0,4194304] 0 2024-04-21T23:44:07.226 INFO:tasks.workunit.client.0.smithi110.stdout:2/80: dwrite d9/fe [0,4194304] 0 2024-04-21T23:44:07.460 INFO:tasks.workunit.client.0.smithi110.stdout:2/81: dread d9/fe [0,4194304] 0 2024-04-21T23:44:07.561 INFO:tasks.workunit.client.0.smithi110.stdout:4/91: fsync d1/d6/ff 0 2024-04-21T23:44:07.904 INFO:tasks.workunit.client.0.smithi110.stdout:1/82: write d1/d2/d1b/f13 [517839,101068] 0 2024-04-21T23:44:07.993 INFO:tasks.workunit.client.0.smithi110.stdout:6/95: mkdir d16/d1d 0 2024-04-21T23:44:08.086 INFO:tasks.workunit.client.0.smithi110.stdout:3/99: fdatasync d6/fe 0 2024-04-21T23:44:08.111 INFO:tasks.workunit.client.0.smithi110.stdout:3/100: stat d6/fd 0 2024-04-21T23:44:08.243 INFO:tasks.workunit.client.0.smithi110.stdout:3/101: dread f1 [0,4194304] 0 2024-04-21T23:44:08.416 INFO:tasks.workunit.client.0.smithi110.stdout:7/92: mkdir d10/d27 0 2024-04-21T23:44:08.582 INFO:tasks.workunit.client.0.smithi110.stdout:5/96: rename d7/f12 to d7/d9/d17/f18 0 2024-04-21T23:44:09.059 INFO:tasks.workunit.client.0.smithi110.stdout:2/82: fdatasync f5 0 2024-04-21T23:44:09.252 INFO:tasks.workunit.client.0.smithi110.stdout:0/112: truncate d0/d16/f18 2868924 0 2024-04-21T23:44:09.407 INFO:tasks.workunit.client.0.smithi110.stdout:1/83: rmdir d1/d2/d14 39 2024-04-21T23:44:09.414 INFO:tasks.workunit.client.0.smithi110.stdout:0/113: sync 2024-04-21T23:44:09.470 INFO:tasks.workunit.client.0.smithi110.stdout:6/96: mkdir d16/d1e 0 2024-04-21T23:44:09.548 INFO:tasks.workunit.client.0.smithi110.stdout:6/97: sync 2024-04-21T23:44:09.558 INFO:tasks.workunit.client.0.smithi110.stdout:6/98: chown f15 325979251 1 2024-04-21T23:44:09.749 INFO:tasks.workunit.client.0.smithi110.stdout:3/102: creat d6/d12/d16/f1f x:0 0 0 2024-04-21T23:44:09.895 INFO:tasks.workunit.client.0.smithi110.stdout:7/93: truncate fe 669426 0 2024-04-21T23:44:10.159 INFO:tasks.workunit.client.0.smithi110.stdout:5/97: unlink d7/d9/cb 0 2024-04-21T23:44:10.483 INFO:tasks.workunit.client.0.smithi110.stdout:2/83: symlink d9/l23 0 2024-04-21T23:44:10.688 INFO:tasks.workunit.client.0.smithi110.stdout:4/92: mkdir d1/d11/d20 0 2024-04-21T23:44:10.713 INFO:tasks.workunit.client.0.smithi110.stdout:0/114: mknod d0/d16/c22 0 2024-04-21T23:44:10.726 INFO:tasks.workunit.client.0.smithi110.stdout:9/106: getdents d1/d4/d6 0 2024-04-21T23:44:10.758 INFO:tasks.workunit.client.0.smithi110.stdout:3/103: fdatasync d6/fd 0 2024-04-21T23:44:10.768 INFO:tasks.workunit.client.0.smithi110.stdout:1/84: read d1/f3 [1463104,76963] 0 2024-04-21T23:44:10.841 INFO:tasks.workunit.client.0.smithi110.stdout:5/98: mknod d7/c19 0 2024-04-21T23:44:10.851 INFO:tasks.workunit.client.0.smithi110.stdout:9/107: stat d1/f7 0 2024-04-21T23:44:11.052 INFO:tasks.workunit.client.0.smithi110.stdout:8/117: getdents d5/d9 0 2024-04-21T23:44:11.492 INFO:tasks.workunit.client.0.smithi110.stdout:6/99: mknod d16/d1d/c1f 0 2024-04-21T23:44:11.519 INFO:tasks.workunit.client.0.smithi110.stdout:7/94: mknod d10/d15/d22/c28 0 2024-04-21T23:44:12.356 INFO:tasks.workunit.client.0.smithi110.stdout:2/84: mknod d9/d1a/d1d/c24 0 2024-04-21T23:44:12.370 INFO:tasks.workunit.client.0.smithi110.stdout:9/108: dread - d1/f15 zero size 2024-04-21T23:44:12.492 INFO:tasks.workunit.client.0.smithi110.stdout:9/109: chown d1/l2 310 1 2024-04-21T23:44:12.532 INFO:tasks.workunit.client.0.smithi110.stdout:8/118: dread d5/ff [0,4194304] 0 2024-04-21T23:44:12.550 INFO:tasks.workunit.client.0.smithi110.stdout:9/110: chown d1/l2 0 1 2024-04-21T23:44:12.622 INFO:tasks.workunit.client.0.smithi110.stdout:8/119: chown d5/da/d17/l19 122046731 1 2024-04-21T23:44:12.863 INFO:tasks.workunit.client.0.smithi110.stdout:4/93: mknod d1/d11/d20/c21 0 2024-04-21T23:44:12.879 INFO:tasks.workunit.client.0.smithi110.stdout:6/100: symlink d16/d1e/l20 0 2024-04-21T23:44:12.915 INFO:tasks.workunit.client.0.smithi110.stdout:7/95: creat d10/d27/f29 x:0 0 0 2024-04-21T23:44:13.344 INFO:tasks.workunit.client.0.smithi110.stdout:8/120: creat d5/d9/f1f x:0 0 0 2024-04-21T23:44:13.363 INFO:tasks.workunit.client.0.smithi110.stdout:1/85: creat d1/d2/d14/d16/f1f x:0 0 0 2024-04-21T23:44:13.410 INFO:tasks.workunit.client.0.smithi110.stdout:7/96: rmdir d10/d15/d22 39 2024-04-21T23:44:13.518 INFO:tasks.workunit.client.0.smithi110.stdout:1/86: sync 2024-04-21T23:44:13.941 INFO:tasks.workunit.client.0.smithi110.stdout:8/121: creat d5/da/d17/f20 x:0 0 0 2024-04-21T23:44:13.971 INFO:tasks.workunit.client.0.smithi110.stdout:8/122: chown d5/f12 5 1 2024-04-21T23:44:14.125 INFO:tasks.workunit.client.0.smithi110.stdout:4/94: mknod d1/d6/d1c/c22 0 2024-04-21T23:44:14.295 INFO:tasks.workunit.client.0.smithi110.stdout:7/97: fsync d10/d15/f1b 0 2024-04-21T23:44:14.652 INFO:tasks.workunit.client.0.smithi110.stdout:5/99: dwrite d7/f10 [0,4194304] 0 2024-04-21T23:44:14.693 INFO:tasks.workunit.client.0.smithi110.stdout:2/85: write d9/f13 [1358329,108514] 0 2024-04-21T23:44:14.942 INFO:tasks.workunit.client.0.smithi110.stdout:3/104: dwrite f0 [0,4194304] 0 2024-04-21T23:44:15.058 INFO:tasks.workunit.client.0.smithi110.stdout:8/123: dread d5/f6 [0,4194304] 0 2024-04-21T23:44:15.092 INFO:tasks.workunit.client.0.smithi110.stdout:9/111: write d1/d19/f16 [587168,126924] 0 2024-04-21T23:44:15.093 INFO:tasks.workunit.client.0.smithi110.stdout:5/100: chown d7/d9/d17 24889 1 2024-04-21T23:44:15.134 INFO:tasks.workunit.client.0.smithi110.stdout:1/87: creat d1/dd/f20 x:0 0 0 2024-04-21T23:44:15.202 INFO:tasks.workunit.client.0.smithi110.stdout:1/88: write d1/d2/d14/d16/f1f [458958,77081] 0 2024-04-21T23:44:15.337 INFO:tasks.workunit.client.0.smithi110.stdout:6/101: write f10 [1689377,49668] 0 2024-04-21T23:44:15.740 INFO:tasks.workunit.client.0.smithi110.stdout:3/105: truncate f1 2600423 0 2024-04-21T23:44:15.847 INFO:tasks.workunit.client.0.smithi110.stdout:4/95: rename d1/d6 to d1/d11/d20/d23 0 2024-04-21T23:44:15.864 INFO:tasks.workunit.client.0.smithi110.stdout:4/96: chown d1/f5 79 1 2024-04-21T23:44:16.051 INFO:tasks.workunit.client.0.smithi110.stdout:5/101: symlink d7/d9/l1a 0 2024-04-21T23:44:16.218 INFO:tasks.workunit.client.0.smithi110.stdout:2/86: rename d9/d16 to d9/d25 0 2024-04-21T23:44:16.520 INFO:tasks.workunit.client.0.smithi110.stdout:3/106: truncate d6/f1d 705118 0 2024-04-21T23:44:16.979 INFO:tasks.workunit.client.0.smithi110.stdout:2/87: dread - d9/d25/d1b/f1f zero size 2024-04-21T23:44:17.118 INFO:tasks.workunit.client.0.smithi110.stdout:3/107: rmdir d6/d12/d16 39 2024-04-21T23:44:17.511 INFO:tasks.workunit.client.0.smithi110.stdout:6/102: link f1 d16/d1d/f21 0 2024-04-21T23:44:17.670 INFO:tasks.workunit.client.0.smithi110.stdout:3/108: mknod d6/d12/d14/c20 0 2024-04-21T23:44:17.685 INFO:tasks.workunit.client.0.smithi110.stdout:7/98: write fe [274475,50375] 0 2024-04-21T23:44:17.723 INFO:tasks.workunit.client.0.smithi110.stdout:3/109: readlink d6/l18 0 2024-04-21T23:44:17.773 INFO:tasks.workunit.client.0.smithi110.stdout:9/112: getdents d1 0 2024-04-21T23:44:17.859 INFO:tasks.workunit.client.0.smithi110.stdout:9/113: truncate d1/d19/f16 1175904 0 2024-04-21T23:44:18.007 INFO:tasks.workunit.client.0.smithi110.stdout:9/114: dread d1/d4/d6/fe [0,4194304] 0 2024-04-21T23:44:18.125 INFO:tasks.workunit.client.0.smithi110.stdout:9/115: dread d1/d19/f16 [0,4194304] 0 2024-04-21T23:44:18.155 INFO:tasks.workunit.client.0.smithi110.stdout:9/116: read d1/d4/d6/fe [1461098,22206] 0 2024-04-21T23:44:18.363 INFO:tasks.workunit.client.0.smithi110.stdout:6/103: rmdir d16/d1e 39 2024-04-21T23:44:18.392 INFO:tasks.workunit.client.0.smithi110.stdout:8/124: write d5/f1d [308567,76198] 0 2024-04-21T23:44:18.501 INFO:tasks.workunit.client.0.smithi110.stdout:4/97: write d1/fe [480789,108779] 0 2024-04-21T23:44:18.528 INFO:tasks.workunit.client.0.smithi110.stdout:2/88: write f1 [6609780,128771] 0 2024-04-21T23:44:18.692 INFO:tasks.workunit.client.0.smithi110.stdout:0/115: write d0/d16/f18 [1768929,6152] 0 2024-04-21T23:44:18.699 INFO:tasks.workunit.client.0.smithi110.stdout:3/110: symlink d6/d12/d14/l21 0 2024-04-21T23:44:18.745 INFO:tasks.workunit.client.0.smithi110.stdout:2/89: readlink d9/l12 0 2024-04-21T23:44:18.887 INFO:tasks.workunit.client.0.smithi110.stdout:9/117: symlink d1/l1a 0 2024-04-21T23:44:19.111 INFO:tasks.workunit.client.0.smithi110.stdout:7/99: creat d10/d15/d22/f2a x:0 0 0 2024-04-21T23:44:19.282 INFO:tasks.workunit.client.0.smithi110.stdout:1/89: dwrite d1/d2/d1b/d10/f15 [0,4194304] 0 2024-04-21T23:44:19.422 INFO:tasks.workunit.client.0.smithi110.stdout:5/102: dwrite d7/fa [0,4194304] 0 2024-04-21T23:44:19.656 INFO:tasks.workunit.client.0.smithi110.stdout:6/104: write f11 [732134,46266] 0 2024-04-21T23:44:19.680 INFO:tasks.workunit.client.0.smithi110.stdout:2/90: dread - d9/d1a/f21 zero size 2024-04-21T23:44:19.695 INFO:tasks.workunit.client.0.smithi110.stdout:8/125: write d5/fe [1600399,32198] 0 2024-04-21T23:44:19.761 INFO:tasks.workunit.client.0.smithi110.stdout:2/91: stat d9/ff 0 2024-04-21T23:44:19.765 INFO:tasks.workunit.client.0.smithi110.stdout:8/126: stat d5/d9 0 2024-04-21T23:44:19.807 INFO:tasks.workunit.client.0.smithi110.stdout:4/98: rename d1/d11/d20/c21 to d1/d11/d20/c24 0 2024-04-21T23:44:19.813 INFO:tasks.workunit.client.0.smithi110.stdout:7/100: mkdir d10/d2b 0 2024-04-21T23:44:19.876 INFO:tasks.workunit.client.0.smithi110.stdout:7/101: chown f8 6255369 1 2024-04-21T23:44:19.906 INFO:tasks.workunit.client.0.smithi110.stdout:3/111: symlink d6/d12/d16/l22 0 2024-04-21T23:44:19.909 INFO:tasks.workunit.client.0.smithi110.stdout:7/102: dread - d10/f19 zero size 2024-04-21T23:44:20.227 INFO:tasks.workunit.client.0.smithi110.stdout:6/105: rmdir d16 39 2024-04-21T23:44:20.236 INFO:tasks.workunit.client.0.smithi110.stdout:1/90: creat d1/d2/d1b/d10/f21 x:0 0 0 2024-04-21T23:44:20.432 INFO:tasks.workunit.client.0.smithi110.stdout:8/127: creat d5/d9/f21 x:0 0 0 2024-04-21T23:44:20.442 INFO:tasks.workunit.client.0.smithi110.stdout:9/118: dwrite d1/d19/f16 [0,4194304] 0 2024-04-21T23:44:20.613 INFO:tasks.workunit.client.0.smithi110.stdout:5/103: write f5 [2877700,17613] 0 2024-04-21T23:44:20.784 INFO:tasks.workunit.client.0.smithi110.stdout:8/128: dread d5/ff [0,4194304] 0 2024-04-21T23:44:20.829 INFO:tasks.workunit.client.0.smithi110.stdout:2/92: rename d9/f13 to d9/d1a/f26 0 2024-04-21T23:44:20.952 INFO:tasks.workunit.client.0.smithi110.stdout:2/93: chown d9 107 1 2024-04-21T23:44:20.964 INFO:tasks.workunit.client.0.smithi110.stdout:1/91: unlink d1/f3 0 2024-04-21T23:44:21.105 INFO:tasks.workunit.client.0.smithi110.stdout:9/119: symlink d1/l1b 0 2024-04-21T23:44:21.167 INFO:tasks.workunit.client.0.smithi110.stdout:4/99: dread d1/d11/d12/f18 [0,4194304] 0 2024-04-21T23:44:21.401 INFO:tasks.workunit.client.0.smithi110.stdout:5/104: dwrite d7/d9/fd [4194304,4194304] 0 2024-04-21T23:44:21.601 INFO:tasks.workunit.client.0.smithi110.stdout:0/116: getdents d0/d16 0 2024-04-21T23:44:21.644 INFO:tasks.workunit.client.0.smithi110.stdout:7/103: dread fd [0,4194304] 0 2024-04-21T23:44:21.680 INFO:tasks.workunit.client.0.smithi110.stdout:3/112: write d6/d12/d16/f1f [564242,67632] 0 2024-04-21T23:44:21.686 INFO:tasks.workunit.client.0.smithi110.stdout:1/92: rename d1/d2/d1b to d1/d2/d1b/d10/d22 22 2024-04-21T23:44:21.769 INFO:tasks.workunit.client.0.smithi110.stdout:6/106: write f15 [5923586,113299] 0 2024-04-21T23:44:21.798 INFO:tasks.workunit.client.0.smithi110.stdout:0/117: sync 2024-04-21T23:44:21.847 INFO:tasks.workunit.client.0.smithi110.stdout:2/94: write d9/fa [3248344,118746] 0 2024-04-21T23:44:21.924 INFO:tasks.workunit.client.0.smithi110.stdout:4/100: fdatasync d1/f8 0 2024-04-21T23:44:22.157 INFO:tasks.workunit.client.0.smithi110.stdout:8/129: dwrite d5/d9/f21 [0,4194304] 0 2024-04-21T23:44:22.336 INFO:tasks.workunit.client.0.smithi110.stdout:1/93: mkdir d1/dd/d23 0 2024-04-21T23:44:22.340 INFO:tasks.workunit.client.0.smithi110.stdout:5/105: dread - d7/d9/f16 zero size 2024-04-21T23:44:22.417 INFO:tasks.workunit.client.0.smithi110.stdout:8/130: stat d5/f1d 0 2024-04-21T23:44:22.448 INFO:tasks.workunit.client.0.smithi110.stdout:5/106: sync 2024-04-21T23:44:22.512 INFO:tasks.workunit.client.0.smithi110.stdout:7/104: mkdir d10/d15/d22/d2c 0 2024-04-21T23:44:22.519 INFO:tasks.workunit.client.0.smithi110.stdout:2/95: dread d9/d1a/f26 [0,4194304] 0 2024-04-21T23:44:22.646 INFO:tasks.workunit.client.0.smithi110.stdout:8/131: dread d5/f1d [0,4194304] 0 2024-04-21T23:44:22.709 INFO:tasks.workunit.client.0.smithi110.stdout:0/118: unlink d0/f20 0 2024-04-21T23:44:22.714 INFO:tasks.workunit.client.0.smithi110.stdout:7/105: truncate d10/d15/d22/f2a 768831 0 2024-04-21T23:44:23.012 INFO:tasks.workunit.client.0.smithi110.stdout:3/113: creat d6/d12/d16/f23 x:0 0 0 2024-04-21T23:44:23.301 INFO:tasks.workunit.client.0.smithi110.stdout:4/101: mknod d1/d11/d20/d23/c25 0 2024-04-21T23:44:23.826 INFO:tasks.workunit.client.0.smithi110.stdout:2/96: rmdir d9/d25/d1b 39 2024-04-21T23:44:23.867 INFO:tasks.workunit.client.0.smithi110.stdout:9/120: dwrite d1/d19/f13 [0,4194304] 0 2024-04-21T23:44:24.009 INFO:tasks.workunit.client.0.smithi110.stdout:2/97: chown d9/d25/d1c 187731 1 2024-04-21T23:44:24.053 INFO:tasks.workunit.client.0.smithi110.stdout:8/132: fdatasync d5/da/d17/f20 0 2024-04-21T23:44:25.232 INFO:tasks.workunit.client.0.smithi110.stdout:2/98: mknod d9/d1a/c27 0 2024-04-21T23:44:25.509 INFO:tasks.workunit.client.0.smithi110.stdout:0/119: mkdir d0/d14/d23 0 2024-04-21T23:44:25.740 INFO:tasks.workunit.client.0.smithi110.stdout:8/133: unlink d5/d9/f21 0 2024-04-21T23:44:26.145 INFO:tasks.workunit.client.0.smithi110.stdout:3/114: write d6/fe [847651,56734] 0 2024-04-21T23:44:26.181 INFO:tasks.workunit.client.0.smithi110.stdout:4/102: write d1/f8 [142233,12655] 0 2024-04-21T23:44:26.246 INFO:tasks.workunit.client.0.smithi110.stdout:9/121: symlink d1/d19/l1c 0 2024-04-21T23:44:26.360 INFO:tasks.workunit.client.0.smithi110.stdout:7/106: link d10/d27/f29 d10/d27/f2d 0 2024-04-21T23:44:26.637 INFO:tasks.workunit.client.0.smithi110.stdout:0/120: dread d0/f11 [0,4194304] 0 2024-04-21T23:44:26.698 INFO:tasks.workunit.client.0.smithi110.stdout:8/134: creat d5/da/d17/f22 x:0 0 0 2024-04-21T23:44:26.719 INFO:tasks.workunit.client.0.smithi110.stdout:8/135: chown d5/l7 26551962 1 2024-04-21T23:44:26.764 INFO:tasks.workunit.client.0.smithi110.stdout:6/107: getdents d16/d1d 0 2024-04-21T23:44:26.873 INFO:tasks.workunit.client.0.smithi110.stdout:8/136: sync 2024-04-21T23:44:27.025 INFO:tasks.workunit.client.0.smithi110.stdout:5/107: getdents d7/d9 0 2024-04-21T23:44:27.092 INFO:tasks.workunit.client.0.smithi110.stdout:5/108: write d7/fa [3753956,103763] 0 2024-04-21T23:44:27.205 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:44:27.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:44:27.444 INFO:tasks.workunit.client.0.smithi110.stdout:4/103: mkdir d1/d11/d12/d26 0 2024-04-21T23:44:27.647 INFO:tasks.workunit.client.0.smithi110.stdout:9/122: mkdir d1/d4/d6/d1d 0 2024-04-21T23:44:28.178 INFO:tasks.workunit.client.0.smithi110.stdout:6/108: dread f3 [0,4194304] 0 2024-04-21T23:44:28.336 INFO:tasks.workunit.client.0.smithi110.stdout:2/99: write f5 [3118525,10408] 0 2024-04-21T23:44:28.365 INFO:tasks.workunit.client.0.smithi110.stdout:2/100: stat d9/l12 0 2024-04-21T23:44:28.576 INFO:tasks.workunit.client.0.smithi110.stdout:5/109: mknod d7/c1b 0 2024-04-21T23:44:28.850 INFO:tasks.workunit.client.0.smithi110.stdout:5/110: dwrite d7/fa [4194304,4194304] 0 2024-04-21T23:44:29.067 INFO:tasks.workunit.client.0.smithi110.stdout:4/104: dread d1/d11/d20/d23/ff [0,4194304] 0 2024-04-21T23:44:29.122 INFO:tasks.workunit.client.0.smithi110.stdout:7/107: unlink cb 0 2024-04-21T23:44:29.158 INFO:tasks.workunit.client.0.smithi110.stdout:7/108: chown d10/f19 1 1 2024-04-21T23:44:29.376 INFO:tasks.workunit.client.0.smithi110.stdout:0/121: creat d0/d14/d23/f24 x:0 0 0 2024-04-21T23:44:29.837 INFO:tasks.workunit.client.0.smithi110.stdout:2/101: creat d9/d25/d1c/f28 x:0 0 0 2024-04-21T23:44:29.871 INFO:tasks.workunit.client.0.smithi110.stdout:2/102: rename d9 to d9/d25/d1c/d29 22 2024-04-21T23:44:30.192 INFO:tasks.workunit.client.0.smithi110.stdout:1/94: dwrite d1/d2/d1b/d10/f19 [0,4194304] 0 2024-04-21T23:44:30.206 INFO:tasks.workunit.client.0.smithi110.stdout:9/123: symlink d1/d4/d6/d1d/l1e 0 2024-04-21T23:44:30.326 INFO:tasks.workunit.client.0.smithi110.stdout:5/111: fsync d7/d9/f11 0 2024-04-21T23:44:30.541 INFO:tasks.workunit.client.0.smithi110.stdout:4/105: mkdir d1/d11/d20/d23/d27 0 2024-04-21T23:44:30.681 INFO:tasks.workunit.client.0.smithi110.stdout:4/106: chown d1/d11/d20/d23 58 1 2024-04-21T23:44:30.726 INFO:tasks.workunit.client.0.smithi110.stdout:8/137: dwrite d5/d9/f1f [0,4194304] 0 2024-04-21T23:44:30.877 INFO:tasks.workunit.client.0.smithi110.stdout:2/103: rename l3 to d9/d25/d1c/l2a 0 2024-04-21T23:44:30.930 INFO:tasks.workunit.client.0.smithi110.stdout:8/138: chown d5/da/d17 139149414 1 2024-04-21T23:44:30.931 INFO:tasks.workunit.client.0.smithi110.stdout:4/107: chown d1/d11/d20/d23/d1c 306281 1 2024-04-21T23:44:30.975 INFO:tasks.workunit.client.0.smithi110.stdout:3/115: getdents d6/d12/d16 0 2024-04-21T23:44:31.169 INFO:tasks.workunit.client.0.smithi110.stdout:9/124: fsync d1/d4/f14 0 2024-04-21T23:44:31.327 INFO:tasks.workunit.client.0.smithi110.stdout:1/95: fdatasync d1/d2/d14/d16/f1f 0 2024-04-21T23:44:31.354 INFO:tasks.workunit.client.0.smithi110.stdout:5/112: truncate d7/f14 1143588 0 2024-04-21T23:44:31.504 INFO:tasks.workunit.client.0.smithi110.stdout:0/122: mkdir d0/d25 0 2024-04-21T23:44:31.820 INFO:tasks.workunit.client.0.smithi110.stdout:2/104: truncate d9/f15 1677561 0 2024-04-21T23:44:32.084 INFO:tasks.workunit.client.0.smithi110.stdout:4/108: truncate d1/fc 4216733 0 2024-04-21T23:44:32.362 INFO:tasks.workunit.client.0.smithi110.stdout:6/109: write f10 [1085390,86494] 0 2024-04-21T23:44:32.507 INFO:tasks.workunit.client.0.smithi110.stdout:0/123: truncate d0/f13 751998 0 2024-04-21T23:44:32.633 INFO:tasks.workunit.client.0.smithi110.stdout:6/110: sync 2024-04-21T23:44:32.850 INFO:tasks.workunit.client.0.smithi110.stdout:4/109: fsync d1/d11/d20/d23/ff 0 2024-04-21T23:44:33.159 INFO:tasks.workunit.client.0.smithi110.stdout:7/109: write d10/d15/f25 [834499,48304] 0 2024-04-21T23:44:33.212 INFO:tasks.workunit.client.0.smithi110.stdout:9/125: rmdir d1/d4 39 2024-04-21T23:44:33.258 INFO:tasks.workunit.client.0.smithi110.stdout:0/124: creat d0/d16/f26 x:0 0 0 2024-04-21T23:44:34.190 INFO:tasks.workunit.client.0.smithi110.stdout:6/111: symlink d16/l22 0 2024-04-21T23:44:34.305 INFO:tasks.workunit.client.0.smithi110.stdout:8/139: dwrite d5/f12 [4194304,4194304] 0 2024-04-21T23:44:34.669 INFO:tasks.workunit.client.0.smithi110.stdout:3/116: dwrite d6/f19 [0,4194304] 0 2024-04-21T23:44:34.993 INFO:tasks.workunit.client.0.smithi110.stdout:6/112: dread f10 [0,4194304] 0 2024-04-21T23:44:35.069 INFO:tasks.workunit.client.0.smithi110.stdout:9/126: write d1/d19/f16 [687666,95949] 0 2024-04-21T23:44:35.231 INFO:tasks.workunit.client.0.smithi110.stdout:7/110: creat d10/d15/f2e x:0 0 0 2024-04-21T23:44:35.793 INFO:tasks.workunit.client.0.smithi110.stdout:1/96: dwrite d1/d2/d1b/d10/f15 [0,4194304] 0 2024-04-21T23:44:35.823 INFO:tasks.workunit.client.0.smithi110.stdout:5/113: dwrite f5 [0,4194304] 0 2024-04-21T23:44:35.912 INFO:tasks.workunit.client.0.smithi110.stdout:2/105: dwrite d9/ff [0,4194304] 0 2024-04-21T23:44:36.063 INFO:tasks.workunit.client.0.smithi110.stdout:5/114: chown d7/d9/d17/l15 3553194 1 2024-04-21T23:44:36.113 INFO:tasks.workunit.client.0.smithi110.stdout:4/110: creat d1/f28 x:0 0 0 2024-04-21T23:44:36.137 INFO:tasks.workunit.client.0.smithi110.stdout:4/111: chown d1/cb 0 1 2024-04-21T23:44:36.439 INFO:tasks.workunit.client.0.smithi110.stdout:6/113: mknod d16/d1d/c23 0 2024-04-21T23:44:36.679 INFO:tasks.workunit.client.0.smithi110.stdout:0/125: getdents d0/d14/d23 0 2024-04-21T23:44:36.961 INFO:tasks.workunit.client.0.smithi110.stdout:2/106: mkdir d9/d1a/d1d/d2b 0 2024-04-21T23:44:37.372 INFO:tasks.workunit.client.0.smithi110.stdout:9/127: read d1/d4/d6/fe [301402,109864] 0 2024-04-21T23:44:37.652 INFO:tasks.workunit.client.0.smithi110.stdout:8/140: write d5/da/d17/f20 [593395,91433] 0 2024-04-21T23:44:37.674 INFO:tasks.workunit.client.0.smithi110.stdout:6/114: dread d16/d1d/f21 [0,4194304] 0 2024-04-21T23:44:37.958 INFO:tasks.workunit.client.0.smithi110.stdout:7/111: write d10/f23 [422609,111722] 0 2024-04-21T23:44:38.406 INFO:tasks.workunit.client.0.smithi110.stdout:9/128: truncate d1/d4/d6/fe 2524917 0 2024-04-21T23:44:38.474 INFO:tasks.workunit.client.0.smithi110.stdout:8/141: creat d5/d9/f23 x:0 0 0 2024-04-21T23:44:38.521 INFO:tasks.workunit.client.0.smithi110.stdout:4/112: dwrite d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:44:38.708 INFO:tasks.workunit.client.0.smithi110.stdout:0/126: unlink d0/l3 0 2024-04-21T23:44:38.736 INFO:tasks.workunit.client.0.smithi110.stdout:5/115: dwrite d7/d9/f11 [0,4194304] 0 2024-04-21T23:44:38.888 INFO:tasks.workunit.client.0.smithi110.stdout:8/142: dread d5/f6 [0,4194304] 0 2024-04-21T23:44:38.957 INFO:tasks.workunit.client.0.smithi110.stdout:8/143: write d5/da/d17/f20 [1506609,107395] 0 2024-04-21T23:44:39.111 INFO:tasks.workunit.client.0.smithi110.stdout:1/97: link d1/ff d1/dd/d23/f24 0 2024-04-21T23:44:39.293 INFO:tasks.workunit.client.0.smithi110.stdout:6/115: mkdir d16/d1e/d24 0 2024-04-21T23:44:39.728 INFO:tasks.workunit.client.0.smithi110.stdout:9/129: creat d1/d4/dc/f1f x:0 0 0 2024-04-21T23:44:39.777 INFO:tasks.workunit.client.0.smithi110.stdout:9/130: chown d1/l1b 455237 1 2024-04-21T23:44:39.792 INFO:tasks.workunit.client.0.smithi110.stdout:4/113: rmdir d1/d11/d20/d23 39 2024-04-21T23:44:39.819 INFO:tasks.workunit.client.0.smithi110.stdout:9/131: readlink d1/l2 0 2024-04-21T23:44:39.962 INFO:tasks.workunit.client.0.smithi110.stdout:5/116: dread d7/fa [0,4194304] 0 2024-04-21T23:44:40.004 INFO:tasks.workunit.client.0.smithi110.stdout:7/112: write f5 [801189,98759] 0 2024-04-21T23:44:40.231 INFO:tasks.workunit.client.0.smithi110.stdout:8/144: dread d5/da/fc [0,4194304] 0 2024-04-21T23:44:40.231 INFO:tasks.workunit.client.0.smithi110.stdout:1/98: fdatasync d1/d2/d1b/d10/f12 0 2024-04-21T23:44:40.277 INFO:tasks.workunit.client.0.smithi110.stdout:8/145: write d5/d9/f23 [769227,76936] 0 2024-04-21T23:44:40.336 INFO:tasks.workunit.client.0.smithi110.stdout:6/116: fdatasync f10 0 2024-04-21T23:44:40.399 INFO:tasks.workunit.client.0.smithi110.stdout:1/99: read d1/d2/d1b/d10/f15 [1331204,33501] 0 2024-04-21T23:44:40.684 INFO:tasks.workunit.client.0.smithi110.stdout:9/132: creat d1/d4/d6/d1d/f20 x:0 0 0 2024-04-21T23:44:40.707 INFO:tasks.workunit.client.0.smithi110.stdout:9/133: chown d1/d4/dc 1293 1 2024-04-21T23:44:40.730 INFO:tasks.workunit.client.0.smithi110.stdout:9/134: dread - d1/d4/d6/d1d/f20 zero size 2024-04-21T23:44:40.859 INFO:tasks.workunit.client.0.smithi110.stdout:7/113: fdatasync f9 0 2024-04-21T23:44:40.951 INFO:tasks.workunit.client.0.smithi110.stdout:5/117: creat d7/d9/d17/f1c x:0 0 0 2024-04-21T23:44:40.973 INFO:tasks.workunit.client.0.smithi110.stdout:5/118: stat d7/d9/fd 0 2024-04-21T23:44:41.298 INFO:tasks.workunit.client.0.smithi110.stdout:8/146: dread d5/f1d [0,4194304] 0 2024-04-21T23:44:41.440 INFO:tasks.workunit.client.0.smithi110.stdout:0/127: write d0/f21 [225775,121417] 0 2024-04-21T23:44:41.529 INFO:tasks.workunit.client.0.smithi110.stdout:2/107: dwrite d9/d25/d1b/f1f [0,4194304] 0 2024-04-21T23:44:41.532 INFO:tasks.workunit.client.0.smithi110.stdout:0/128: chown d0 431023 1 2024-04-21T23:44:41.685 INFO:tasks.workunit.client.0.smithi110.stdout:6/117: dread - fe zero size 2024-04-21T23:44:41.921 INFO:tasks.workunit.client.0.smithi110.stdout:4/114: fsync f0 0 2024-04-21T23:44:41.950 INFO:tasks.workunit.client.0.smithi110.stdout:9/135: mknod d1/d4/c21 0 2024-04-21T23:44:42.060 INFO:tasks.workunit.client.0.smithi110.stdout:3/117: link d6/d12/d14/c1b d6/c24 0 2024-04-21T23:44:42.569 INFO:tasks.workunit.client.0.smithi110.stdout:5/119: rename d7/f10 to d7/d9/f1d 0 2024-04-21T23:44:42.967 INFO:tasks.workunit.client.0.smithi110.stdout:1/100: write d1/d2/d1b/d10/f19 [2802162,103497] 0 2024-04-21T23:44:43.309 INFO:tasks.workunit.client.0.smithi110.stdout:8/147: truncate d5/d9/f14 183070 0 2024-04-21T23:44:43.622 INFO:tasks.workunit.client.0.smithi110.stdout:2/108: mknod d9/d25/d1b/c2c 0 2024-04-21T23:44:43.627 INFO:tasks.workunit.client.0.smithi110.stdout:6/118: readlink d16/l1a 0 2024-04-21T23:44:44.029 INFO:tasks.workunit.client.0.smithi110.stdout:9/136: dread d1/d19/f13 [0,4194304] 0 2024-04-21T23:44:44.085 INFO:tasks.workunit.client.0.smithi110.stdout:9/137: fsync d1/d4/d6/d1d/f20 0 2024-04-21T23:44:44.163 INFO:tasks.workunit.client.0.smithi110.stdout:3/118: creat d6/d12/d14/f25 x:0 0 0 2024-04-21T23:44:44.342 INFO:tasks.workunit.client.0.smithi110.stdout:7/114: unlink f2 0 2024-04-21T23:44:44.356 INFO:tasks.workunit.client.0.smithi110.stdout:7/115: stat d10/d2b 0 2024-04-21T23:44:44.501 INFO:tasks.workunit.client.0.smithi110.stdout:5/120: creat d7/d9/f1e x:0 0 0 2024-04-21T23:44:44.860 INFO:tasks.workunit.client.0.smithi110.stdout:2/109: creat d9/d1a/f2d x:0 0 0 2024-04-21T23:44:44.947 INFO:tasks.workunit.client.0.smithi110.stdout:6/119: creat d16/d1d/f25 x:0 0 0 2024-04-21T23:44:45.343 INFO:tasks.workunit.client.0.smithi110.stdout:8/148: rename d5/d9 to d5/d24 0 2024-04-21T23:44:45.851 INFO:tasks.workunit.client.0.smithi110.stdout:5/121: mknod d7/d9/d17/c1f 0 2024-04-21T23:44:45.921 INFO:tasks.workunit.client.0.smithi110.stdout:5/122: truncate d7/d9/d17/f1c 630459 0 2024-04-21T23:44:46.461 INFO:tasks.workunit.client.0.smithi110.stdout:8/149: creat d5/d24/f25 x:0 0 0 2024-04-21T23:44:46.763 INFO:tasks.workunit.client.0.smithi110.stdout:0/129: dwrite d0/f12 [0,4194304] 0 2024-04-21T23:44:46.982 INFO:tasks.workunit.client.0.smithi110.stdout:1/101: creat d1/d2/f25 x:0 0 0 2024-04-21T23:44:47.450 INFO:tasks.workunit.client.0.smithi110.stdout:3/119: dwrite d6/f19 [0,4194304] 0 2024-04-21T23:44:47.616 INFO:tasks.workunit.client.0.smithi110.stdout:4/115: getdents d1/d11/d12 0 2024-04-21T23:44:47.904 INFO:tasks.workunit.client.0.smithi110.stdout:1/102: fsync d1/d2/d1b/d10/f15 0 2024-04-21T23:44:47.973 INFO:tasks.workunit.client.0.smithi110.stdout:7/116: dwrite d10/d15/f2e [0,4194304] 0 2024-04-21T23:44:48.251 INFO:tasks.workunit.client.0.smithi110.stdout:9/138: getdents d1/d4/d6/d1d 0 2024-04-21T23:44:48.533 INFO:tasks.workunit.client.0.smithi110.stdout:2/110: dwrite d9/d1a/f1e [0,4194304] 0 2024-04-21T23:44:48.808 INFO:tasks.workunit.client.0.smithi110.stdout:0/130: mkdir d0/d27 0 2024-04-21T23:44:48.904 INFO:tasks.workunit.client.0.smithi110.stdout:5/123: write d7/d9/fd [8870868,18116] 0 2024-04-21T23:44:48.947 INFO:tasks.workunit.client.0.smithi110.stdout:5/124: fsync d7/fa 0 2024-04-21T23:44:48.965 INFO:tasks.workunit.client.0.smithi110.stdout:6/120: link d16/f1b d16/d1e/d24/f26 0 2024-04-21T23:44:49.491 INFO:tasks.workunit.client.0.smithi110.stdout:7/117: unlink d10/d15/d22/f2a 0 2024-04-21T23:44:49.572 INFO:tasks.workunit.client.0.smithi110.stdout:7/118: chown d10/l17 9 1 2024-04-21T23:44:49.597 INFO:tasks.workunit.client.0.smithi110.stdout:7/119: stat fd 0 2024-04-21T23:44:49.656 INFO:tasks.workunit.client.0.smithi110.stdout:9/139: dread d1/d19/f16 [0,4194304] 0 2024-04-21T23:44:49.724 INFO:tasks.workunit.client.0.smithi110.stdout:4/116: mknod d1/d11/d20/c29 0 2024-04-21T23:44:50.121 INFO:tasks.workunit.client.0.smithi110.stdout:3/120: write d6/fe [3241605,57487] 0 2024-04-21T23:44:50.176 INFO:tasks.workunit.client.0.smithi110.stdout:2/111: dread f1 [4194304,4194304] 0 2024-04-21T23:44:50.302 INFO:tasks.workunit.client.0.smithi110.stdout:5/125: dread f5 [0,4194304] 0 2024-04-21T23:44:50.509 INFO:tasks.workunit.client.0.smithi110.stdout:8/150: rename d5/f12 to d5/da/d17/f26 0 2024-04-21T23:44:50.602 INFO:tasks.workunit.client.0.smithi110.stdout:7/120: dread f5 [0,4194304] 0 2024-04-21T23:44:50.738 INFO:tasks.workunit.client.0.smithi110.stdout:4/117: read d1/f5 [1905322,101861] 0 2024-04-21T23:44:50.880 INFO:tasks.workunit.client.0.smithi110.stdout:4/118: dread d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:44:50.973 INFO:tasks.workunit.client.0.smithi110.stdout:6/121: symlink d16/l27 0 2024-04-21T23:44:51.308 INFO:tasks.workunit.client.0.smithi110.stdout:2/112: dread f5 [0,4194304] 0 2024-04-21T23:44:51.314 INFO:tasks.workunit.client.0.smithi110.stdout:8/151: symlink d5/da/l27 0 2024-04-21T23:44:51.350 INFO:tasks.workunit.client.0.smithi110.stdout:7/121: symlink d10/d27/l2f 0 2024-04-21T23:44:51.429 INFO:tasks.workunit.client.0.smithi110.stdout:6/122: dread d16/d1d/f21 [0,4194304] 0 2024-04-21T23:44:51.590 INFO:tasks.workunit.client.0.smithi110.stdout:1/103: dwrite d1/d2/d14/d16/f1f [0,4194304] 0 2024-04-21T23:44:52.164 INFO:tasks.workunit.client.0.smithi110.stdout:4/119: mknod d1/c2a 0 2024-04-21T23:44:52.578 INFO:tasks.workunit.client.0.smithi110.stdout:0/131: dwrite d0/f9 [0,4194304] 0 2024-04-21T23:44:52.698 INFO:tasks.workunit.client.0.smithi110.stdout:1/104: dread - d1/dd/f20 zero size 2024-04-21T23:44:53.069 INFO:tasks.workunit.client.0.smithi110.stdout:5/126: getdents d7/d9 0 2024-04-21T23:44:53.323 INFO:tasks.workunit.client.0.smithi110.stdout:6/123: write f11 [1503026,47411] 0 2024-04-21T23:44:53.348 INFO:tasks.workunit.client.0.smithi110.stdout:6/124: stat d16/l22 0 2024-04-21T23:44:53.710 INFO:tasks.workunit.client.0.smithi110.stdout:2/113: dwrite d9/d1a/f21 [0,4194304] 0 2024-04-21T23:44:53.851 INFO:tasks.workunit.client.0.smithi110.stdout:0/132: symlink d0/d25/l28 0 2024-04-21T23:44:54.201 INFO:tasks.workunit.client.0.smithi110.stdout:6/125: rmdir d16/d1d 39 2024-04-21T23:44:54.212 INFO:tasks.workunit.client.0.smithi110.stdout:9/140: rename d1/d4/d6/d1d/f20 to d1/f22 0 2024-04-21T23:44:54.746 INFO:tasks.workunit.client.0.smithi110.stdout:4/120: write d1/fc [1778862,82326] 0 2024-04-21T23:44:54.790 INFO:tasks.workunit.client.0.smithi110.stdout:5/127: write d7/d9/f16 [613743,66112] 0 2024-04-21T23:44:54.846 INFO:tasks.workunit.client.0.smithi110.stdout:2/114: dread - d9/d1a/f2d zero size 2024-04-21T23:44:54.908 INFO:tasks.workunit.client.0.smithi110.stdout:5/128: dread - d7/d9/f1e zero size 2024-04-21T23:44:54.936 INFO:tasks.workunit.client.0.smithi110.stdout:0/133: rmdir d0 39 2024-04-21T23:44:54.962 INFO:tasks.workunit.client.0.smithi110.stdout:3/121: rename d6 to d6/d26 22 2024-04-21T23:44:55.183 INFO:tasks.workunit.client.0.smithi110.stdout:2/115: dread - d9/d25/d1c/f28 zero size 2024-04-21T23:44:55.286 INFO:tasks.workunit.client.0.smithi110.stdout:1/105: creat d1/f26 x:0 0 0 2024-04-21T23:44:55.333 INFO:tasks.workunit.client.0.smithi110.stdout:5/129: symlink d7/l20 0 2024-04-21T23:44:55.386 INFO:tasks.workunit.client.0.smithi110.stdout:5/130: chown d7 243013894 1 2024-04-21T23:44:55.560 INFO:tasks.workunit.client.0.smithi110.stdout:2/116: dwrite d9/d1a/f21 [0,4194304] 0 2024-04-21T23:44:55.712 INFO:tasks.workunit.client.0.smithi110.stdout:3/122: symlink d6/d12/d16/l27 0 2024-04-21T23:44:55.924 INFO:tasks.workunit.client.0.smithi110.stdout:1/106: chown d1/d2/d1b/f9 16270 1 2024-04-21T23:44:56.021 INFO:tasks.workunit.client.0.smithi110.stdout:5/131: unlink d7/d9/f1d 0 2024-04-21T23:44:56.261 INFO:tasks.workunit.client.0.smithi110.stdout:7/122: rename l4 to d10/d2b/l30 0 2024-04-21T23:44:56.332 INFO:tasks.workunit.client.0.smithi110.stdout:0/134: mkdir d0/d14/d29 0 2024-04-21T23:44:56.433 INFO:tasks.workunit.client.0.smithi110.stdout:6/126: write d16/f1b [733118,119521] 0 2024-04-21T23:44:56.622 INFO:tasks.workunit.client.0.smithi110.stdout:1/107: dread d1/d2/d1b/f9 [0,4194304] 0 2024-04-21T23:44:56.707 INFO:tasks.workunit.client.0.smithi110.stdout:5/132: creat d7/d9/f21 x:0 0 0 2024-04-21T23:44:56.713 INFO:tasks.workunit.client.0.smithi110.stdout:9/141: dwrite d1/d4/f14 [0,4194304] 0 2024-04-21T23:44:56.756 INFO:tasks.workunit.client.0.smithi110.stdout:7/123: sync 2024-04-21T23:44:56.962 INFO:tasks.workunit.client.0.smithi110.stdout:8/152: rename d5/da/cb to d5/da/d17/c28 0 2024-04-21T23:44:57.109 INFO:tasks.workunit.client.0.smithi110.stdout:4/121: dwrite d1/d11/d12/f18 [0,4194304] 0 2024-04-21T23:44:57.251 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:44:57.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:44:57.300 INFO:tasks.workunit.client.0.smithi110.stdout:3/123: dread f0 [0,4194304] 0 2024-04-21T23:44:57.302 INFO:tasks.workunit.client.0.smithi110.stdout:0/135: dread d0/fa [4194304,4194304] 0 2024-04-21T23:44:57.527 INFO:tasks.workunit.client.0.smithi110.stdout:5/133: dread d7/fa [0,4194304] 0 2024-04-21T23:44:57.582 INFO:tasks.workunit.client.0.smithi110.stdout:9/142: dread d1/d4/d6/fe [0,4194304] 0 2024-04-21T23:44:57.617 INFO:tasks.workunit.client.0.smithi110.stdout:9/143: stat d1/f7 0 2024-04-21T23:44:57.635 INFO:tasks.workunit.client.0.smithi110.stdout:9/144: stat d1/d4/c21 0 2024-04-21T23:44:57.664 INFO:tasks.workunit.client.0.smithi110.stdout:6/127: mkdir d16/d1d/d28 0 2024-04-21T23:44:57.896 INFO:tasks.workunit.client.0.smithi110.stdout:1/108: unlink d1/d2/d1b/d10/f19 0 2024-04-21T23:44:58.057 INFO:tasks.workunit.client.0.smithi110.stdout:4/122: unlink d1/f13 0 2024-04-21T23:44:58.441 INFO:tasks.workunit.client.0.smithi110.stdout:2/117: rename l2 to d9/d1a/d1d/d2b/l2e 0 2024-04-21T23:44:58.480 INFO:tasks.workunit.client.0.smithi110.stdout:8/153: truncate d5/d24/f25 365431 0 2024-04-21T23:44:58.742 INFO:tasks.workunit.client.0.smithi110.stdout:5/134: rmdir d7/d9/d17 39 2024-04-21T23:44:59.274 INFO:tasks.workunit.client.0.smithi110.stdout:1/109: mkdir d1/d2/d14/d16/d27 0 2024-04-21T23:45:00.046 INFO:tasks.workunit.client.0.smithi110.stdout:5/135: mkdir d7/d22 0 2024-04-21T23:45:00.146 INFO:tasks.workunit.client.0.smithi110.stdout:0/136: write d0/fa [315395,76004] 0 2024-04-21T23:45:00.757 INFO:tasks.workunit.client.0.smithi110.stdout:3/124: dwrite d6/d12/d16/f23 [0,4194304] 0 2024-04-21T23:45:00.770 INFO:tasks.workunit.client.0.smithi110.stdout:7/124: rename f8 to d10/d15/d22/d2c/f31 0 2024-04-21T23:45:00.926 INFO:tasks.workunit.client.0.smithi110.stdout:9/145: write d1/f15 [864726,121942] 0 2024-04-21T23:45:00.940 INFO:tasks.workunit.client.0.smithi110.stdout:0/137: readlink d0/l6 0 2024-04-21T23:45:01.294 INFO:tasks.workunit.client.0.smithi110.stdout:3/125: fsync f0 0 2024-04-21T23:45:01.320 INFO:tasks.workunit.client.0.smithi110.stdout:3/126: chown d6/c11 8169529 1 2024-04-21T23:45:01.484 INFO:tasks.workunit.client.0.smithi110.stdout:2/118: write d9/d1a/f1e [377607,14178] 0 2024-04-21T23:45:01.547 INFO:tasks.workunit.client.0.smithi110.stdout:2/119: write d9/d1a/f1e [4969567,116675] 0 2024-04-21T23:45:01.609 INFO:tasks.workunit.client.0.smithi110.stdout:2/120: write d9/d1a/f1e [2691105,39929] 0 2024-04-21T23:45:01.649 INFO:tasks.workunit.client.0.smithi110.stdout:4/123: rename d1/c2a to d1/d11/d20/d23/d1c/c2b 0 2024-04-21T23:45:01.778 INFO:tasks.workunit.client.0.smithi110.stdout:6/128: link d16/l27 d16/l29 0 2024-04-21T23:45:01.984 INFO:tasks.workunit.client.0.smithi110.stdout:6/129: chown d16/d1d/f25 3285552 1 2024-04-21T23:45:02.150 INFO:tasks.workunit.client.0.smithi110.stdout:5/136: rename d7/d9 to d7/d9/d23 22 2024-04-21T23:45:02.189 INFO:tasks.workunit.client.0.smithi110.stdout:8/154: dwrite d5/d24/f23 [0,4194304] 0 2024-04-21T23:45:02.326 INFO:tasks.workunit.client.0.smithi110.stdout:9/146: rename d1/d4 to d1/d4/d23 22 2024-04-21T23:45:02.423 INFO:tasks.workunit.client.0.smithi110.stdout:7/125: creat d10/d15/f32 x:0 0 0 2024-04-21T23:45:02.522 INFO:tasks.workunit.client.0.smithi110.stdout:1/110: dwrite d1/d2/d1b/d10/f12 [0,4194304] 0 2024-04-21T23:45:02.830 INFO:tasks.workunit.client.0.smithi110.stdout:6/130: dread f4 [0,4194304] 0 2024-04-21T23:45:02.963 INFO:tasks.workunit.client.0.smithi110.stdout:0/138: rmdir d0/d14/d29 0 2024-04-21T23:45:03.240 INFO:tasks.workunit.client.0.smithi110.stdout:5/137: fdatasync d7/fa 0 2024-04-21T23:45:03.268 INFO:tasks.workunit.client.0.smithi110.stdout:5/138: chown d7/d22 47 1 2024-04-21T23:45:03.456 INFO:tasks.workunit.client.0.smithi110.stdout:3/127: creat d6/d12/f28 x:0 0 0 2024-04-21T23:45:03.789 INFO:tasks.workunit.client.0.smithi110.stdout:7/126: creat d10/f33 x:0 0 0 2024-04-21T23:45:04.153 INFO:tasks.workunit.client.0.smithi110.stdout:2/121: dwrite d9/d25/d1b/f1f [0,4194304] 0 2024-04-21T23:45:04.174 INFO:tasks.workunit.client.0.smithi110.stdout:1/111: dread d1/d2/d1b/fc [0,4194304] 0 2024-04-21T23:45:04.394 INFO:tasks.workunit.client.0.smithi110.stdout:4/124: creat d1/d11/d20/f2c x:0 0 0 2024-04-21T23:45:04.476 INFO:tasks.workunit.client.0.smithi110.stdout:8/155: symlink d5/da/l29 0 2024-04-21T23:45:04.683 INFO:tasks.workunit.client.0.smithi110.stdout:5/139: mkdir d7/d24 0 2024-04-21T23:45:04.776 INFO:tasks.workunit.client.0.smithi110.stdout:4/125: dwrite d1/d11/d20/f2c [0,4194304] 0 2024-04-21T23:45:05.062 INFO:tasks.workunit.client.0.smithi110.stdout:0/139: write d0/f11 [4591551,129814] 0 2024-04-21T23:45:05.315 INFO:tasks.workunit.client.0.smithi110.stdout:7/127: rename d10/f13 to d10/f34 0 2024-04-21T23:45:05.357 INFO:tasks.workunit.client.0.smithi110.stdout:1/112: truncate d1/d2/d1b/d10/f15 3805164 0 2024-04-21T23:45:05.437 INFO:tasks.workunit.client.0.smithi110.stdout:8/156: creat d5/f2a x:0 0 0 2024-04-21T23:45:05.645 INFO:tasks.workunit.client.0.smithi110.stdout:9/147: dwrite d1/d19/f16 [4194304,4194304] 0 2024-04-21T23:45:05.825 INFO:tasks.workunit.client.0.smithi110.stdout:6/131: dwrite f12 [0,4194304] 0 2024-04-21T23:45:05.826 INFO:tasks.workunit.client.0.smithi110.stdout:3/128: rename d6/d12/d16/f17 to d6/d12/f29 0 2024-04-21T23:45:06.269 INFO:tasks.workunit.client.0.smithi110.stdout:5/140: mkdir d7/d9/d25 0 2024-04-21T23:45:06.286 INFO:tasks.workunit.client.0.smithi110.stdout:0/140: mkdir d0/d2a 0 2024-04-21T23:45:06.294 INFO:tasks.workunit.client.0.smithi110.stdout:1/113: rmdir d1/d1d 39 2024-04-21T23:45:06.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/126: rename d1/d11/f1a to d1/d11/d12/d26/f2d 0 2024-04-21T23:45:06.620 INFO:tasks.workunit.client.0.smithi110.stdout:8/157: rename d5 to d5/d24/d2b 22 2024-04-21T23:45:06.996 INFO:tasks.workunit.client.0.smithi110.stdout:2/122: dwrite d9/f15 [0,4194304] 0 2024-04-21T23:45:07.425 INFO:tasks.workunit.client.0.smithi110.stdout:7/128: dwrite d10/d15/f1b [4194304,4194304] 0 2024-04-21T23:45:07.531 INFO:tasks.workunit.client.0.smithi110.stdout:7/129: fsync d10/f33 0 2024-04-21T23:45:07.557 INFO:tasks.workunit.client.0.smithi110.stdout:5/141: unlink d7/d9/f1e 0 2024-04-21T23:45:07.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/129: truncate d6/f1d 596221 0 2024-04-21T23:45:07.619 INFO:tasks.workunit.client.0.smithi110.stdout:0/141: fdatasync d0/d16/f26 0 2024-04-21T23:45:07.659 INFO:tasks.workunit.client.0.smithi110.stdout:6/132: rename f11 to d16/d1e/f2a 0 2024-04-21T23:45:07.686 INFO:tasks.workunit.client.0.smithi110.stdout:8/158: creat d5/d24/f2c x:0 0 0 2024-04-21T23:45:07.710 INFO:tasks.workunit.client.0.smithi110.stdout:4/127: stat d1/l1e 0 2024-04-21T23:45:07.769 INFO:tasks.workunit.client.0.smithi110.stdout:4/128: readlink d1/d11/d12/l17 0 2024-04-21T23:45:08.146 INFO:tasks.workunit.client.0.smithi110.stdout:7/130: rmdir d10/d15 39 2024-04-21T23:45:08.161 INFO:tasks.workunit.client.0.smithi110.stdout:7/131: chown d10 5 1 2024-04-21T23:45:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:0/142: dread d0/fc [0,4194304] 0 2024-04-21T23:45:09.116 INFO:tasks.workunit.client.0.smithi110.stdout:3/130: creat d6/d12/d16/f2a x:0 0 0 2024-04-21T23:45:09.550 INFO:tasks.workunit.client.0.smithi110.stdout:7/132: mknod d10/d2b/c35 0 2024-04-21T23:45:10.015 INFO:tasks.workunit.client.0.smithi110.stdout:9/148: getdents d1/d4 0 2024-04-21T23:45:10.164 INFO:tasks.workunit.client.0.smithi110.stdout:9/149: dread d1/d19/f16 [0,4194304] 0 2024-04-21T23:45:10.233 INFO:tasks.workunit.client.0.smithi110.stdout:5/142: unlink d7/d9/d17/l15 0 2024-04-21T23:45:10.280 INFO:tasks.workunit.client.0.smithi110.stdout:0/143: creat d0/d16/f2b x:0 0 0 2024-04-21T23:45:10.582 INFO:tasks.workunit.client.0.smithi110.stdout:6/133: creat d16/d1d/d28/f2b x:0 0 0 2024-04-21T23:45:10.653 INFO:tasks.workunit.client.0.smithi110.stdout:3/131: mknod d6/d12/d14/c2b 0 2024-04-21T23:45:11.054 INFO:tasks.workunit.client.0.smithi110.stdout:2/123: creat d9/d25/f2f x:0 0 0 2024-04-21T23:45:11.344 INFO:tasks.workunit.client.0.smithi110.stdout:1/114: link d1/l1c d1/d1d/l28 0 2024-04-21T23:45:11.553 INFO:tasks.workunit.client.0.smithi110.stdout:2/124: dread d9/f10 [0,4194304] 0 2024-04-21T23:45:11.719 INFO:tasks.workunit.client.0.smithi110.stdout:4/129: dwrite d1/fe [0,4194304] 0 2024-04-21T23:45:11.877 INFO:tasks.workunit.client.0.smithi110.stdout:1/115: sync 2024-04-21T23:45:11.954 INFO:tasks.workunit.client.0.smithi110.stdout:4/130: sync 2024-04-21T23:45:12.078 INFO:tasks.workunit.client.0.smithi110.stdout:6/134: dread d16/f1b [0,4194304] 0 2024-04-21T23:45:12.498 INFO:tasks.workunit.client.0.smithi110.stdout:7/133: fsync d10/d15/f2e 0 2024-04-21T23:45:12.887 INFO:tasks.workunit.client.0.smithi110.stdout:5/143: unlink d7/fa 0 2024-04-21T23:45:12.949 INFO:tasks.workunit.client.0.smithi110.stdout:8/159: dwrite d5/d24/f25 [0,4194304] 0 2024-04-21T23:45:13.077 INFO:tasks.workunit.client.0.smithi110.stdout:2/125: truncate d9/fe 1475394 0 2024-04-21T23:45:13.258 INFO:tasks.workunit.client.0.smithi110.stdout:1/116: chown d1/l1c 103175 1 2024-04-21T23:45:13.322 INFO:tasks.workunit.client.0.smithi110.stdout:8/160: dread d5/da/fc [0,4194304] 0 2024-04-21T23:45:13.988 INFO:tasks.workunit.client.0.smithi110.stdout:5/144: truncate d7/d9/f11 4156449 0 2024-04-21T23:45:14.049 INFO:tasks.workunit.client.0.smithi110.stdout:2/126: read d9/d25/d1b/f1f [3260239,78242] 0 2024-04-21T23:45:14.141 INFO:tasks.workunit.client.0.smithi110.stdout:4/131: symlink d1/d11/d20/d23/d27/l2e 0 2024-04-21T23:45:14.160 INFO:tasks.workunit.client.0.smithi110.stdout:4/132: chown d1/cb 1553303 1 2024-04-21T23:45:14.454 INFO:tasks.workunit.client.0.smithi110.stdout:3/132: write d6/d12/d16/f1f [1473806,21788] 0 2024-04-21T23:45:14.532 INFO:tasks.workunit.client.0.smithi110.stdout:1/117: mkdir d1/d2/d14/d16/d29 0 2024-04-21T23:45:14.610 INFO:tasks.workunit.client.0.smithi110.stdout:8/161: stat d5/da/d17/c28 0 2024-04-21T23:45:14.893 INFO:tasks.workunit.client.0.smithi110.stdout:9/150: getdents d1/d4/d6/d1d 0 2024-04-21T23:45:15.193 INFO:tasks.workunit.client.0.smithi110.stdout:2/127: mknod d9/d1a/d1d/c30 0 2024-04-21T23:45:15.697 INFO:tasks.workunit.client.0.smithi110.stdout:6/135: dwrite d16/f1b [0,4194304] 0 2024-04-21T23:45:15.825 INFO:tasks.workunit.client.0.smithi110.stdout:8/162: rmdir d5/da 39 2024-04-21T23:45:15.997 INFO:tasks.workunit.client.0.smithi110.stdout:1/118: dread d1/d2/d1b/f11 [0,4194304] 0 2024-04-21T23:45:16.143 INFO:tasks.workunit.client.0.smithi110.stdout:5/145: fdatasync d7/d9/fd 0 2024-04-21T23:45:16.299 INFO:tasks.workunit.client.0.smithi110.stdout:2/128: fdatasync d9/d1a/f2d 0 2024-04-21T23:45:16.653 INFO:tasks.workunit.client.0.smithi110.stdout:0/144: creat d0/f2c x:0 0 0 2024-04-21T23:45:17.195 INFO:tasks.workunit.client.0.smithi110.stdout:1/119: readlink d1/d2/d1b/l7 0 2024-04-21T23:45:17.400 INFO:tasks.workunit.client.0.smithi110.stdout:5/146: unlink d7/l20 0 2024-04-21T23:45:17.410 INFO:tasks.workunit.client.0.smithi110.stdout:7/134: write d10/f34 [648341,85613] 0 2024-04-21T23:45:17.611 INFO:tasks.workunit.client.0.smithi110.stdout:2/129: rmdir d9/d25/d1b 39 2024-04-21T23:45:18.268 INFO:tasks.workunit.client.0.smithi110.stdout:3/133: creat d6/d12/f2c x:0 0 0 2024-04-21T23:45:18.419 INFO:tasks.workunit.client.0.smithi110.stdout:6/136: creat d16/d1e/d24/f2c x:0 0 0 2024-04-21T23:45:18.573 INFO:tasks.workunit.client.0.smithi110.stdout:9/151: write d1/d4/d6/fe [3287195,40518] 0 2024-04-21T23:45:18.946 INFO:tasks.workunit.client.0.smithi110.stdout:7/135: fdatasync fd 0 2024-04-21T23:45:18.983 INFO:tasks.workunit.client.0.smithi110.stdout:4/133: write d1/f5 [2090936,67944] 0 2024-04-21T23:45:19.442 INFO:tasks.workunit.client.0.smithi110.stdout:6/137: chown d16/l27 1251 1 2024-04-21T23:45:19.547 INFO:tasks.workunit.client.0.smithi110.stdout:1/120: truncate d1/ff 795626 0 2024-04-21T23:45:19.724 INFO:tasks.workunit.client.0.smithi110.stdout:9/152: creat d1/d4/d6/d1d/f24 x:0 0 0 2024-04-21T23:45:20.017 INFO:tasks.workunit.client.0.smithi110.stdout:7/136: mknod d10/d15/d22/c36 0 2024-04-21T23:45:20.157 INFO:tasks.workunit.client.0.smithi110.stdout:4/134: creat d1/d11/d20/d23/f2f x:0 0 0 2024-04-21T23:45:21.242 INFO:tasks.workunit.client.0.smithi110.stdout:6/138: truncate f9 210944 0 2024-04-21T23:45:21.330 INFO:tasks.workunit.client.0.smithi110.stdout:9/153: mknod d1/d19/c25 0 2024-04-21T23:45:21.505 INFO:tasks.workunit.client.0.smithi110.stdout:7/137: fdatasync d10/d27/f29 0 2024-04-21T23:45:21.557 INFO:tasks.workunit.client.0.smithi110.stdout:0/145: write d0/f1e [851406,88389] 0 2024-04-21T23:45:21.842 INFO:tasks.workunit.client.0.smithi110.stdout:7/138: dread d10/f34 [0,4194304] 0 2024-04-21T23:45:22.022 INFO:tasks.workunit.client.0.smithi110.stdout:9/154: creat d1/d4/f26 x:0 0 0 2024-04-21T23:45:22.068 INFO:tasks.workunit.client.0.smithi110.stdout:9/155: write d1/d4/f26 [801836,57462] 0 2024-04-21T23:45:22.403 INFO:tasks.workunit.client.0.smithi110.stdout:8/163: rename d5/da/d17/l19 to d5/l2d 0 2024-04-21T23:45:22.652 INFO:tasks.workunit.client.0.smithi110.stdout:0/146: rmdir d0/d16 39 2024-04-21T23:45:22.699 INFO:tasks.workunit.client.0.smithi110.stdout:3/134: creat d6/f2d x:0 0 0 2024-04-21T23:45:22.895 INFO:tasks.workunit.client.0.smithi110.stdout:6/139: fdatasync d16/d1e/f2a 0 2024-04-21T23:45:22.996 INFO:tasks.workunit.client.0.smithi110.stdout:9/156: creat d1/d4/d6/f27 x:0 0 0 2024-04-21T23:45:23.224 INFO:tasks.workunit.client.0.smithi110.stdout:5/147: dwrite d7/f14 [0,4194304] 0 2024-04-21T23:45:23.262 INFO:tasks.workunit.client.0.smithi110.stdout:2/130: dwrite d9/d25/d1b/f1f [4194304,4194304] 0 2024-04-21T23:45:23.452 INFO:tasks.workunit.client.0.smithi110.stdout:1/121: rename d1/d2/d1b/l7 to d1/d2/d14/d16/d29/l2a 0 2024-04-21T23:45:23.484 INFO:tasks.workunit.client.0.smithi110.stdout:7/139: symlink d10/d15/l37 0 2024-04-21T23:45:23.615 INFO:tasks.workunit.client.0.smithi110.stdout:9/157: symlink d1/d4/dc/l28 0 2024-04-21T23:45:23.617 INFO:tasks.workunit.client.0.smithi110.stdout:6/140: fsync d16/f1b 0 2024-04-21T23:45:23.634 INFO:tasks.workunit.client.0.smithi110.stdout:4/135: dwrite d1/d11/d20/d23/ff [0,4194304] 0 2024-04-21T23:45:23.922 INFO:tasks.workunit.client.0.smithi110.stdout:9/158: sync 2024-04-21T23:45:23.970 INFO:tasks.workunit.client.0.smithi110.stdout:0/147: truncate d0/f11 1957827 0 2024-04-21T23:45:24.208 INFO:tasks.workunit.client.0.smithi110.stdout:2/131: fdatasync d9/d25/f2f 0 2024-04-21T23:45:24.449 INFO:tasks.workunit.client.0.smithi110.stdout:8/164: rename d5/da/l27 to d5/da/d17/l2e 0 2024-04-21T23:45:24.475 INFO:tasks.workunit.client.0.smithi110.stdout:8/165: read d5/f1d [42589,111400] 0 2024-04-21T23:45:24.832 INFO:tasks.workunit.client.0.smithi110.stdout:3/135: truncate d6/d12/d14/f25 983247 0 2024-04-21T23:45:24.859 INFO:tasks.workunit.client.0.smithi110.stdout:6/141: creat d16/d1d/d28/f2d x:0 0 0 2024-04-21T23:45:24.910 INFO:tasks.workunit.client.0.smithi110.stdout:4/136: creat d1/d11/d12/d26/f30 x:0 0 0 2024-04-21T23:45:24.962 INFO:tasks.workunit.client.0.smithi110.stdout:7/140: dread f9 [0,4194304] 0 2024-04-21T23:45:25.031 INFO:tasks.workunit.client.0.smithi110.stdout:4/137: chown d1/l1e 73486092 1 2024-04-21T23:45:25.036 INFO:tasks.workunit.client.0.smithi110.stdout:7/141: chown f6 953062484 1 2024-04-21T23:45:25.780 INFO:tasks.workunit.client.0.smithi110.stdout:5/148: mknod d7/c26 0 2024-04-21T23:45:25.944 INFO:tasks.workunit.client.0.smithi110.stdout:8/166: fsync d5/da/d17/f22 0 2024-04-21T23:45:26.149 INFO:tasks.workunit.client.0.smithi110.stdout:3/136: creat d6/d12/d14/f2e x:0 0 0 2024-04-21T23:45:26.799 INFO:tasks.workunit.client.0.smithi110.stdout:6/142: rmdir d16/d1d 39 2024-04-21T23:45:26.937 INFO:tasks.workunit.client.0.smithi110.stdout:1/122: dread d1/d2/d1b/d10/f12 [0,4194304] 0 2024-04-21T23:45:27.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:45:27.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:45:27.359 INFO:tasks.workunit.client.0.smithi110.stdout:2/132: write d9/d1a/f21 [982626,87228] 0 2024-04-21T23:45:27.472 INFO:tasks.workunit.client.0.smithi110.stdout:6/143: mknod d16/d1e/c2e 0 2024-04-21T23:45:27.473 INFO:tasks.workunit.client.0.smithi110.stdout:1/123: mknod d1/d2/d14/d16/d29/c2b 0 2024-04-21T23:45:27.782 INFO:tasks.workunit.client.0.smithi110.stdout:9/159: getdents d1/d4 0 2024-04-21T23:45:27.798 INFO:tasks.workunit.client.0.smithi110.stdout:0/148: link d0/l8 d0/d25/l2d 0 2024-04-21T23:45:27.991 INFO:tasks.workunit.client.0.smithi110.stdout:2/133: fsync d9/f10 0 2024-04-21T23:45:28.102 INFO:tasks.workunit.client.0.smithi110.stdout:5/149: dread d7/d9/d17/f18 [4194304,4194304] 0 2024-04-21T23:45:28.245 INFO:tasks.workunit.client.0.smithi110.stdout:1/124: rmdir d1/d2/d14/d16 39 2024-04-21T23:45:28.311 INFO:tasks.workunit.client.0.smithi110.stdout:7/142: write f5 [7918930,115461] 0 2024-04-21T23:45:28.470 INFO:tasks.workunit.client.0.smithi110.stdout:8/167: dwrite d5/da/d17/f22 [0,4194304] 0 2024-04-21T23:45:28.615 INFO:tasks.workunit.client.0.smithi110.stdout:4/138: write d1/d11/d20/d23/f1f [429402,37467] 0 2024-04-21T23:45:28.767 INFO:tasks.workunit.client.0.smithi110.stdout:8/168: chown d5/da/l16 416992715 1 2024-04-21T23:45:28.822 INFO:tasks.workunit.client.0.smithi110.stdout:8/169: chown d5/d24/c11 0 1 2024-04-21T23:45:28.955 INFO:tasks.workunit.client.0.smithi110.stdout:6/144: creat d16/d1d/f2f x:0 0 0 2024-04-21T23:45:29.013 INFO:tasks.workunit.client.0.smithi110.stdout:5/150: rmdir d7 39 2024-04-21T23:45:29.285 INFO:tasks.workunit.client.0.smithi110.stdout:2/134: rename d9/d25/d1c/c20 to d9/d25/d1c/c31 0 2024-04-21T23:45:29.401 INFO:tasks.workunit.client.0.smithi110.stdout:7/143: mkdir d10/d15/d22/d38 0 2024-04-21T23:45:29.451 INFO:tasks.workunit.client.0.smithi110.stdout:2/135: dread f5 [0,4194304] 0 2024-04-21T23:45:30.407 INFO:tasks.workunit.client.0.smithi110.stdout:4/139: chown d1/d11/d20/c24 41913 1 2024-04-21T23:45:30.445 INFO:tasks.workunit.client.0.smithi110.stdout:4/140: rename d1 to d1/d11/d20/d23/d27/d31 22 2024-04-21T23:45:30.631 INFO:tasks.workunit.client.0.smithi110.stdout:1/125: truncate d1/d2/d1b/d10/f21 680958 0 2024-04-21T23:45:31.094 INFO:tasks.workunit.client.0.smithi110.stdout:8/170: unlink d5/d24/f25 0 2024-04-21T23:45:31.439 INFO:tasks.workunit.client.0.smithi110.stdout:7/144: dread d10/d15/f21 [0,4194304] 0 2024-04-21T23:45:31.496 INFO:tasks.workunit.client.0.smithi110.stdout:3/137: link d6/d12/f29 d6/d12/f2f 0 2024-04-21T23:45:31.554 INFO:tasks.workunit.client.0.smithi110.stdout:9/160: write d1/f22 [58690,102886] 0 2024-04-21T23:45:31.773 INFO:tasks.workunit.client.0.smithi110.stdout:4/141: rmdir d1/d11/d20 39 2024-04-21T23:45:31.808 INFO:tasks.workunit.client.0.smithi110.stdout:0/149: write d0/d16/f2b [718148,105249] 0 2024-04-21T23:45:32.097 INFO:tasks.workunit.client.0.smithi110.stdout:0/150: sync 2024-04-21T23:45:32.275 INFO:tasks.workunit.client.0.smithi110.stdout:5/151: unlink d7/f14 0 2024-04-21T23:45:32.305 INFO:tasks.workunit.client.0.smithi110.stdout:5/152: readlink d7/l8 0 2024-04-21T23:45:32.425 INFO:tasks.workunit.client.0.smithi110.stdout:7/145: mkdir d10/d2b/d39 0 2024-04-21T23:45:32.500 INFO:tasks.workunit.client.0.smithi110.stdout:3/138: dread - d6/d12/f1a zero size 2024-04-21T23:45:32.696 INFO:tasks.workunit.client.0.smithi110.stdout:6/145: write d16/d1d/f21 [4508038,54968] 0 2024-04-21T23:45:32.779 INFO:tasks.workunit.client.0.smithi110.stdout:1/126: readlink d1/d2/d14/d16/d29/l2a 0 2024-04-21T23:45:32.939 INFO:tasks.workunit.client.0.smithi110.stdout:4/142: dread d1/f5 [0,4194304] 0 2024-04-21T23:45:33.294 INFO:tasks.workunit.client.0.smithi110.stdout:8/171: dwrite d5/f2a [0,4194304] 0 2024-04-21T23:45:33.461 INFO:tasks.workunit.client.0.smithi110.stdout:1/127: creat d1/d2/d1b/d10/f2c x:0 0 0 2024-04-21T23:45:33.640 INFO:tasks.workunit.client.0.smithi110.stdout:0/151: symlink d0/d27/l2e 0 2024-04-21T23:45:33.754 INFO:tasks.workunit.client.0.smithi110.stdout:2/136: getdents d9 0 2024-04-21T23:45:33.845 INFO:tasks.workunit.client.0.smithi110.stdout:5/153: dread d7/d9/f11 [0,4194304] 0 2024-04-21T23:45:33.961 INFO:tasks.workunit.client.0.smithi110.stdout:0/152: chown d0/f12 8514 1 2024-04-21T23:45:33.993 INFO:tasks.workunit.client.0.smithi110.stdout:9/161: dwrite d1/d4/d6/f27 [0,4194304] 0 2024-04-21T23:45:34.551 INFO:tasks.workunit.client.0.smithi110.stdout:6/146: link f1 d16/d1d/d28/f30 0 2024-04-21T23:45:34.575 INFO:tasks.workunit.client.0.smithi110.stdout:8/172: creat d5/d24/f2f x:0 0 0 2024-04-21T23:45:34.640 INFO:tasks.workunit.client.0.smithi110.stdout:8/173: readlink d5/da/l1e 0 2024-04-21T23:45:35.147 INFO:tasks.workunit.client.0.smithi110.stdout:3/139: dwrite f1 [0,4194304] 0 2024-04-21T23:45:35.377 INFO:tasks.workunit.client.0.smithi110.stdout:2/137: symlink d9/d1a/d1d/d2b/l32 0 2024-04-21T23:45:35.456 INFO:tasks.workunit.client.0.smithi110.stdout:0/153: mknod d0/d14/d23/c2f 0 2024-04-21T23:45:35.462 INFO:tasks.workunit.client.0.smithi110.stdout:7/146: rmdir d10/d15/d22/d38 0 2024-04-21T23:45:35.469 INFO:tasks.workunit.client.0.smithi110.stdout:6/147: rmdir d16 39 2024-04-21T23:45:35.568 INFO:tasks.workunit.client.0.smithi110.stdout:1/128: unlink d1/d2/d1b/c8 0 2024-04-21T23:45:35.734 INFO:tasks.workunit.client.0.smithi110.stdout:8/174: rename d5/d24/c18 to d5/da/d17/c30 0 2024-04-21T23:45:35.748 INFO:tasks.workunit.client.0.smithi110.stdout:8/175: chown d5/d24 2012849 1 2024-04-21T23:45:35.770 INFO:tasks.workunit.client.0.smithi110.stdout:8/176: chown d5/da/d17/c28 1953 1 2024-04-21T23:45:36.050 INFO:tasks.workunit.client.0.smithi110.stdout:3/140: mkdir d6/d12/d16/d30 0 2024-04-21T23:45:36.067 INFO:tasks.workunit.client.0.smithi110.stdout:2/138: truncate d9/d1a/f2d 425982 0 2024-04-21T23:45:36.068 INFO:tasks.workunit.client.0.smithi110.stdout:5/154: getdents d7/d22 0 2024-04-21T23:45:36.166 INFO:tasks.workunit.client.0.smithi110.stdout:9/162: mkdir d1/d29 0 2024-04-21T23:45:36.502 INFO:tasks.workunit.client.0.smithi110.stdout:1/129: stat d1/d2/d1b/d10/f15 0 2024-04-21T23:45:36.621 INFO:tasks.workunit.client.0.smithi110.stdout:7/147: dread d10/f34 [0,4194304] 0 2024-04-21T23:45:36.706 INFO:tasks.workunit.client.0.smithi110.stdout:5/155: rename d7/d9/f11 to d7/f27 0 2024-04-21T23:45:36.926 INFO:tasks.workunit.client.0.smithi110.stdout:9/163: unlink d1/f22 0 2024-04-21T23:45:37.018 INFO:tasks.workunit.client.0.smithi110.stdout:4/143: link d1/d11/d20/d23/d1c/c22 d1/d11/d20/d23/d27/c32 0 2024-04-21T23:45:37.040 INFO:tasks.workunit.client.0.smithi110.stdout:4/144: chown d1/ca 21937614 1 2024-04-21T23:45:37.515 INFO:tasks.workunit.client.0.smithi110.stdout:1/130: chown d1/d2/d1b/f11 178 1 2024-04-21T23:45:37.720 INFO:tasks.workunit.client.0.smithi110.stdout:5/156: mknod d7/c28 0 2024-04-21T23:45:38.291 INFO:tasks.workunit.client.0.smithi110.stdout:9/164: rename d1/d4 to d1/d29/d2a 0 2024-04-21T23:45:38.355 INFO:tasks.workunit.client.0.smithi110.stdout:9/165: readlink d1/l18 0 2024-04-21T23:45:38.490 INFO:tasks.workunit.client.0.smithi110.stdout:9/166: write d1/d29/d2a/f26 [640399,25720] 0 2024-04-21T23:45:38.520 INFO:tasks.workunit.client.0.smithi110.stdout:6/148: dwrite f15 [0,4194304] 0 2024-04-21T23:45:38.633 INFO:tasks.workunit.client.0.smithi110.stdout:4/145: creat d1/d11/d20/d23/d27/f33 x:0 0 0 2024-04-21T23:45:38.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/177: creat d5/f31 x:0 0 0 2024-04-21T23:45:38.671 INFO:tasks.workunit.client.0.smithi110.stdout:3/141: write d6/fe [910580,58062] 0 2024-04-21T23:45:38.876 INFO:tasks.workunit.client.0.smithi110.stdout:0/154: write d0/f19 [1007420,109265] 0 2024-04-21T23:45:39.230 INFO:tasks.workunit.client.0.smithi110.stdout:7/148: dwrite d10/d15/f25 [0,4194304] 0 2024-04-21T23:45:39.409 INFO:tasks.workunit.client.0.smithi110.stdout:6/149: truncate d16/d1d/f21 4768671 0 2024-04-21T23:45:39.476 INFO:tasks.workunit.client.0.smithi110.stdout:9/167: mkdir d1/d29/d2a/d2b 0 2024-04-21T23:45:39.490 INFO:tasks.workunit.client.0.smithi110.stdout:8/178: symlink d5/da/l32 0 2024-04-21T23:45:39.527 INFO:tasks.workunit.client.0.smithi110.stdout:3/142: read d6/d12/d16/f23 [3393514,73407] 0 2024-04-21T23:45:39.740 INFO:tasks.workunit.client.0.smithi110.stdout:4/146: truncate d1/d11/d20/f2c 3284010 0 2024-04-21T23:45:39.857 INFO:tasks.workunit.client.0.smithi110.stdout:1/131: truncate d1/d2/d1b/f13 591150 0 2024-04-21T23:45:40.010 INFO:tasks.workunit.client.0.smithi110.stdout:5/157: symlink d7/d22/l29 0 2024-04-21T23:45:40.753 INFO:tasks.workunit.client.0.smithi110.stdout:2/139: link d9/d25/f2f d9/d25/f33 0 2024-04-21T23:45:40.778 INFO:tasks.workunit.client.0.smithi110.stdout:7/149: dread - d10/f33 zero size 2024-04-21T23:45:40.853 INFO:tasks.workunit.client.0.smithi110.stdout:8/179: mkdir d5/d24/d33 0 2024-04-21T23:45:40.868 INFO:tasks.workunit.client.0.smithi110.stdout:9/168: creat d1/d29/f2c x:0 0 0 2024-04-21T23:45:40.919 INFO:tasks.workunit.client.0.smithi110.stdout:3/143: creat d6/d12/d14/f31 x:0 0 0 2024-04-21T23:45:41.745 INFO:tasks.workunit.client.0.smithi110.stdout:0/155: write d0/d16/f26 [389533,112563] 0 2024-04-21T23:45:41.765 INFO:tasks.workunit.client.0.smithi110.stdout:2/140: fdatasync d9/d25/d1b/f1f 0 2024-04-21T23:45:41.886 INFO:tasks.workunit.client.0.smithi110.stdout:8/180: fsync d5/ff 0 2024-04-21T23:45:42.050 INFO:tasks.workunit.client.0.smithi110.stdout:2/141: dread d9/d25/d1b/f1f [0,4194304] 0 2024-04-21T23:45:42.067 INFO:tasks.workunit.client.0.smithi110.stdout:2/142: readlink d9/lb 0 2024-04-21T23:45:42.096 INFO:tasks.workunit.client.0.smithi110.stdout:2/143: read - d9/d25/d1c/f28 zero size 2024-04-21T23:45:42.359 INFO:tasks.workunit.client.0.smithi110.stdout:3/144: mkdir d6/d12/d14/d32 0 2024-04-21T23:45:42.474 INFO:tasks.workunit.client.0.smithi110.stdout:1/132: dwrite d1/d2/d14/d16/f1f [0,4194304] 0 2024-04-21T23:45:42.599 INFO:tasks.workunit.client.0.smithi110.stdout:7/150: symlink d10/d2b/d39/l3a 0 2024-04-21T23:45:42.781 INFO:tasks.workunit.client.0.smithi110.stdout:5/158: write d7/d9/d17/f18 [3710947,99198] 0 2024-04-21T23:45:42.896 INFO:tasks.workunit.client.0.smithi110.stdout:0/156: unlink d0/d16/f2b 0 2024-04-21T23:45:43.205 INFO:tasks.workunit.client.0.smithi110.stdout:4/147: creat d1/d11/d20/f34 x:0 0 0 2024-04-21T23:45:43.540 INFO:tasks.workunit.client.0.smithi110.stdout:6/150: getdents d16/d1d 0 2024-04-21T23:45:43.731 INFO:tasks.workunit.client.0.smithi110.stdout:3/145: dread d6/d12/d16/f1f [0,4194304] 0 2024-04-21T23:45:43.761 INFO:tasks.workunit.client.0.smithi110.stdout:3/146: chown d6/d12/f29 3851734 1 2024-04-21T23:45:43.771 INFO:tasks.workunit.client.0.smithi110.stdout:3/147: stat d6/f8 0 2024-04-21T23:45:43.791 INFO:tasks.workunit.client.0.smithi110.stdout:3/148: stat d6/lc 0 2024-04-21T23:45:43.826 INFO:tasks.workunit.client.0.smithi110.stdout:3/149: dread - d6/d12/f1a zero size 2024-04-21T23:45:43.842 INFO:tasks.workunit.client.0.smithi110.stdout:3/150: readlink d6/l18 0 2024-04-21T23:45:44.255 INFO:tasks.workunit.client.0.smithi110.stdout:0/157: readlink d0/d25/l2d 0 2024-04-21T23:45:44.789 INFO:tasks.workunit.client.0.smithi110.stdout:9/169: link d1/f15 d1/d29/d2a/d6/f2d 0 2024-04-21T23:45:45.006 INFO:tasks.workunit.client.0.smithi110.stdout:2/144: dwrite d9/ff [4194304,4194304] 0 2024-04-21T23:45:45.599 INFO:tasks.workunit.client.0.smithi110.stdout:7/151: dwrite d10/f19 [0,4194304] 0 2024-04-21T23:45:45.734 INFO:tasks.workunit.client.0.smithi110.stdout:1/133: dwrite d1/d2/d1b/d10/f15 [0,4194304] 0 2024-04-21T23:45:45.873 INFO:tasks.workunit.client.0.smithi110.stdout:5/159: truncate d7/d9/f21 234042 0 2024-04-21T23:45:45.875 INFO:tasks.workunit.client.0.smithi110.stdout:0/158: rename d0/d27/l2e to d0/d14/l30 0 2024-04-21T23:45:46.076 INFO:tasks.workunit.client.0.smithi110.stdout:9/170: fsync d1/d29/d2a/f26 0 2024-04-21T23:45:46.180 INFO:tasks.workunit.client.0.smithi110.stdout:4/148: write d1/fd [3857199,18160] 0 2024-04-21T23:45:46.691 INFO:tasks.workunit.client.0.smithi110.stdout:2/145: dread d9/d1a/f21 [0,4194304] 0 2024-04-21T23:45:46.784 INFO:tasks.workunit.client.0.smithi110.stdout:6/151: dwrite f12 [0,4194304] 0 2024-04-21T23:45:47.351 INFO:tasks.workunit.client.0.smithi110.stdout:3/151: link d6/d12/f2c d6/d12/d14/d32/f33 0 2024-04-21T23:45:47.401 INFO:tasks.workunit.client.0.smithi110.stdout:7/152: symlink d10/d15/l3b 0 2024-04-21T23:45:47.612 INFO:tasks.workunit.client.0.smithi110.stdout:2/146: rmdir d9/d25 39 2024-04-21T23:45:47.867 INFO:tasks.workunit.client.0.smithi110.stdout:8/181: symlink d5/l34 0 2024-04-21T23:45:48.389 INFO:tasks.workunit.client.0.smithi110.stdout:7/153: fsync d10/d15/f25 0 2024-04-21T23:45:48.481 INFO:tasks.workunit.client.0.smithi110.stdout:5/160: creat d7/d9/f2a x:0 0 0 2024-04-21T23:45:48.569 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:53:28.829 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.582 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:53:28.842 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.620 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:53:28.816 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.628 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:53:28.824 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.641 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:53:28.837 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.645 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:53:28.841 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/182: creat d5/da/f35 x:0 0 0 2024-04-21T23:45:48.686 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:53:28.946 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.787 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:53:28.984 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.843 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:53:29.039 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:45:48.969 INFO:tasks.workunit.client.0.smithi110.stdout:0/159: dwrite d0/d14/f1c [0,4194304] 0 2024-04-21T23:45:49.068 INFO:tasks.workunit.client.0.smithi110.stdout:4/149: write d1/d11/d20/d23/f2f [401336,50630] 0 2024-04-21T23:45:49.089 INFO:tasks.workunit.client.0.smithi110.stdout:4/150: chown d1/ca 84713385 1 2024-04-21T23:45:49.152 INFO:tasks.workunit.client.0.smithi110.stdout:7/154: symlink d10/d15/d22/d2c/l3c 0 2024-04-21T23:45:49.166 INFO:tasks.workunit.client.0.smithi110.stdout:1/134: write d1/dd/d23/f24 [1311097,11610] 0 2024-04-21T23:45:49.187 INFO:tasks.workunit.client.0.smithi110.stdout:5/161: symlink d7/d9/d17/l2b 0 2024-04-21T23:45:49.377 INFO:tasks.workunit.client.0.smithi110.stdout:3/152: write d6/f19 [1027761,52974] 0 2024-04-21T23:45:49.390 INFO:tasks.workunit.client.0.smithi110.stdout:9/171: link d1/d29/d2a/d6/f2d d1/d29/f2e 0 2024-04-21T23:45:49.428 INFO:tasks.workunit.client.0.smithi110.stdout:0/160: sync 2024-04-21T23:45:49.568 INFO:tasks.workunit.client.0.smithi110.stdout:7/155: dread d10/d15/f2e [0,4194304] 0 2024-04-21T23:45:49.616 INFO:tasks.workunit.client.0.smithi110.stdout:7/156: stat d10/d27/f2d 0 2024-04-21T23:45:49.978 INFO:tasks.workunit.client.0.smithi110.stdout:6/152: dwrite d16/f17 [0,4194304] 0 2024-04-21T23:45:50.098 INFO:tasks.workunit.client.0.smithi110.stdout:5/162: creat d7/d9/d17/f2c x:0 0 0 2024-04-21T23:45:50.391 INFO:tasks.workunit.client.0.smithi110.stdout:6/153: dwrite f12 [0,4194304] 0 2024-04-21T23:45:50.604 INFO:tasks.workunit.client.0.smithi110.stdout:6/154: chown c7 420472245 1 2024-04-21T23:45:50.733 INFO:tasks.workunit.client.0.smithi110.stdout:7/157: dread f5 [4194304,4194304] 0 2024-04-21T23:45:50.962 INFO:tasks.workunit.client.0.smithi110.stdout:5/163: mknod d7/d9/d17/c2d 0 2024-04-21T23:45:51.220 INFO:tasks.workunit.client.0.smithi110.stdout:9/172: mkdir d1/d29/d2a/d2b/d2f 0 2024-04-21T23:45:51.391 INFO:tasks.workunit.client.0.smithi110.stdout:0/161: rename d0/c10 to d0/d25/c31 0 2024-04-21T23:45:51.530 INFO:tasks.workunit.client.0.smithi110.stdout:2/147: dwrite d9/d1a/f2d [0,4194304] 0 2024-04-21T23:45:51.728 INFO:tasks.workunit.client.0.smithi110.stdout:0/162: chown d0/f2c 1045 1 2024-04-21T23:45:51.769 INFO:tasks.workunit.client.0.smithi110.stdout:4/151: dwrite d1/d11/d12/d26/f30 [0,4194304] 0 2024-04-21T23:45:51.882 INFO:tasks.workunit.client.0.smithi110.stdout:7/158: symlink d10/d15/d22/d2c/l3d 0 2024-04-21T23:45:51.997 INFO:tasks.workunit.client.0.smithi110.stdout:7/159: dread - d10/f1d zero size 2024-04-21T23:45:52.326 INFO:tasks.workunit.client.0.smithi110.stdout:8/183: dwrite d5/da/d17/f26 [0,4194304] 0 2024-04-21T23:45:52.489 INFO:tasks.workunit.client.0.smithi110.stdout:6/155: symlink d16/l31 0 2024-04-21T23:45:52.548 INFO:tasks.workunit.client.0.smithi110.stdout:1/135: dwrite d1/d2/d1b/f13 [0,4194304] 0 2024-04-21T23:45:52.637 INFO:tasks.workunit.client.0.smithi110.stdout:6/156: sync 2024-04-21T23:45:52.645 INFO:tasks.workunit.client.0.smithi110.stdout:9/173: mkdir d1/d29/d2a/dc/d30 0 2024-04-21T23:45:52.677 INFO:tasks.workunit.client.0.smithi110.stdout:4/152: rmdir d1 39 2024-04-21T23:45:52.677 INFO:tasks.workunit.client.0.smithi110.stdout:6/157: stat d16/d1d 0 2024-04-21T23:45:52.777 INFO:tasks.workunit.client.0.smithi110.stdout:4/153: sync 2024-04-21T23:45:52.918 INFO:tasks.workunit.client.0.smithi110.stdout:0/163: creat d0/d14/f32 x:0 0 0 2024-04-21T23:45:53.108 INFO:tasks.workunit.client.0.smithi110.stdout:3/153: rename d6/f1d to d6/f34 0 2024-04-21T23:45:53.170 INFO:tasks.workunit.client.0.smithi110.stdout:8/184: symlink d5/da/l36 0 2024-04-21T23:45:53.304 INFO:tasks.workunit.client.0.smithi110.stdout:2/148: fsync d9/d25/d1c/f28 0 2024-04-21T23:45:54.106 INFO:tasks.workunit.client.0.smithi110.stdout:0/164: creat d0/d25/f33 x:0 0 0 2024-04-21T23:45:54.109 INFO:tasks.workunit.client.0.smithi110.stdout:3/154: truncate d6/fd 4621669 0 2024-04-21T23:45:54.120 INFO:tasks.workunit.client.0.smithi110.stdout:5/164: dwrite d7/d9/f21 [0,4194304] 0 2024-04-21T23:45:54.282 INFO:tasks.workunit.client.0.smithi110.stdout:5/165: write d7/d9/f2a [321574,30313] 0 2024-04-21T23:45:54.372 INFO:tasks.workunit.client.0.smithi110.stdout:8/185: fdatasync d5/d24/f2c 0 2024-04-21T23:45:54.422 INFO:tasks.workunit.client.0.smithi110.stdout:5/166: truncate d7/d9/d17/f2c 455670 0 2024-04-21T23:45:54.813 INFO:tasks.workunit.client.0.smithi110.stdout:6/158: write d16/d1d/f2f [587099,114778] 0 2024-04-21T23:45:54.858 INFO:tasks.workunit.client.0.smithi110.stdout:6/159: dread - d16/d1d/f25 zero size 2024-04-21T23:45:54.976 INFO:tasks.workunit.client.0.smithi110.stdout:9/174: creat d1/d29/d2a/dc/d30/f31 x:0 0 0 2024-04-21T23:45:54.981 INFO:tasks.workunit.client.0.smithi110.stdout:7/160: creat d10/d15/f3e x:0 0 0 2024-04-21T23:45:55.049 INFO:tasks.workunit.client.0.smithi110.stdout:7/161: truncate d10/d15/f3e 902638 0 2024-04-21T23:45:55.199 INFO:tasks.workunit.client.0.smithi110.stdout:7/162: dread d10/f34 [0,4194304] 0 2024-04-21T23:45:55.263 INFO:tasks.workunit.client.0.smithi110.stdout:4/154: dread d1/d11/d20/d23/f1f [0,4194304] 0 2024-04-21T23:45:55.629 INFO:tasks.workunit.client.0.smithi110.stdout:0/165: dread d0/fb [0,4194304] 0 2024-04-21T23:45:55.650 INFO:tasks.workunit.client.0.smithi110.stdout:3/155: dread f1 [0,4194304] 0 2024-04-21T23:45:56.074 INFO:tasks.workunit.client.0.smithi110.stdout:8/186: unlink d5/da/l32 0 2024-04-21T23:45:56.214 INFO:tasks.workunit.client.0.smithi110.stdout:2/149: dwrite f1 [0,4194304] 0 2024-04-21T23:45:56.509 INFO:tasks.workunit.client.0.smithi110.stdout:6/160: fsync d16/d1d/f25 0 2024-04-21T23:45:56.708 INFO:tasks.workunit.client.0.smithi110.stdout:7/163: fsync d10/d15/f32 0 2024-04-21T23:45:56.890 INFO:tasks.workunit.client.0.smithi110.stdout:4/155: dread - d1/d11/d20/d23/d27/f33 zero size 2024-04-21T23:45:56.933 INFO:tasks.workunit.client.0.smithi110.stdout:6/161: dread f3 [0,4194304] 0 2024-04-21T23:45:57.386 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:45:57.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:45:57.503 INFO:tasks.workunit.client.0.smithi110.stdout:8/187: symlink d5/da/d17/l37 0 2024-04-21T23:45:57.521 INFO:tasks.workunit.client.0.smithi110.stdout:1/136: getdents d1/dd/d23 0 2024-04-21T23:45:57.708 INFO:tasks.workunit.client.0.smithi110.stdout:5/167: truncate d7/d9/fd 3654410 0 2024-04-21T23:45:58.058 INFO:tasks.workunit.client.0.smithi110.stdout:9/175: unlink d1/d29/d2a/d6/f2d 0 2024-04-21T23:45:58.932 INFO:tasks.workunit.client.0.smithi110.stdout:8/188: dread d5/da/d17/f26 [0,4194304] 0 2024-04-21T23:45:59.144 INFO:tasks.workunit.client.0.smithi110.stdout:0/166: creat d0/f34 x:0 0 0 2024-04-21T23:45:59.178 INFO:tasks.workunit.client.0.smithi110.stdout:2/150: write f5 [2055756,86305] 0 2024-04-21T23:45:59.408 INFO:tasks.workunit.client.0.smithi110.stdout:3/156: dwrite f1 [0,4194304] 0 2024-04-21T23:45:59.606 INFO:tasks.workunit.client.0.smithi110.stdout:5/168: creat d7/d24/f2e x:0 0 0 2024-04-21T23:46:00.010 INFO:tasks.workunit.client.0.smithi110.stdout:0/167: symlink d0/d14/l35 0 2024-04-21T23:46:00.020 INFO:tasks.workunit.client.0.smithi110.stdout:7/164: write d10/f1d [925594,41755] 0 2024-04-21T23:46:00.154 INFO:tasks.workunit.client.0.smithi110.stdout:2/151: fsync d9/f15 0 2024-04-21T23:46:00.178 INFO:tasks.workunit.client.0.smithi110.stdout:6/162: write d16/d1e/d24/f26 [697141,44980] 0 2024-04-21T23:46:00.361 INFO:tasks.workunit.client.0.smithi110.stdout:4/156: dwrite f0 [0,4194304] 0 2024-04-21T23:46:01.242 INFO:tasks.workunit.client.0.smithi110.stdout:9/176: creat d1/d19/f32 x:0 0 0 2024-04-21T23:46:01.253 INFO:tasks.workunit.client.0.smithi110.stdout:0/168: creat d0/d27/f36 x:0 0 0 2024-04-21T23:46:01.270 INFO:tasks.workunit.client.0.smithi110.stdout:0/169: chown d0/d16 729235 1 2024-04-21T23:46:01.374 INFO:tasks.workunit.client.0.smithi110.stdout:7/165: truncate d10/d15/f21 1660017 0 2024-04-21T23:46:01.588 INFO:tasks.workunit.client.0.smithi110.stdout:2/152: creat d9/d25/d1c/f34 x:0 0 0 2024-04-21T23:46:01.605 INFO:tasks.workunit.client.0.smithi110.stdout:6/163: symlink d16/d1e/l32 0 2024-04-21T23:46:02.013 INFO:tasks.workunit.client.0.smithi110.stdout:8/189: dwrite d5/da/fc [0,4194304] 0 2024-04-21T23:46:02.430 INFO:tasks.workunit.client.0.smithi110.stdout:7/166: creat d10/d15/d22/f3f x:0 0 0 2024-04-21T23:46:02.770 INFO:tasks.workunit.client.0.smithi110.stdout:1/137: creat d1/d2/f2d x:0 0 0 2024-04-21T23:46:02.785 INFO:tasks.workunit.client.0.smithi110.stdout:3/157: write d6/d12/f2f [1556509,77608] 0 2024-04-21T23:46:02.813 INFO:tasks.workunit.client.0.smithi110.stdout:7/167: sync 2024-04-21T23:46:02.826 INFO:tasks.workunit.client.0.smithi110.stdout:5/169: write d7/d9/d17/f1c [627528,96763] 0 2024-04-21T23:46:02.865 INFO:tasks.workunit.client.0.smithi110.stdout:3/158: fsync f1 0 2024-04-21T23:46:03.032 INFO:tasks.workunit.client.0.smithi110.stdout:4/157: rename d1/d11/d20/d23/d27 to d1/d35 0 2024-04-21T23:46:03.254 INFO:tasks.workunit.client.0.smithi110.stdout:9/177: rmdir d1/d29/d2a/d2b/d2f 0 2024-04-21T23:46:03.443 INFO:tasks.workunit.client.0.smithi110.stdout:1/138: symlink d1/dd/d23/l2e 0 2024-04-21T23:46:03.616 INFO:tasks.workunit.client.0.smithi110.stdout:5/170: truncate d7/d9/f2a 222039 0 2024-04-21T23:46:03.659 INFO:tasks.workunit.client.0.smithi110.stdout:4/158: symlink d1/d11/d12/l36 0 2024-04-21T23:46:03.784 INFO:tasks.workunit.client.0.smithi110.stdout:8/190: creat d5/f38 x:0 0 0 2024-04-21T23:46:03.844 INFO:tasks.workunit.client.0.smithi110.stdout:8/191: sync 2024-04-21T23:46:04.007 INFO:tasks.workunit.client.0.smithi110.stdout:3/159: creat d6/d12/d16/d30/f35 x:0 0 0 2024-04-21T23:46:04.025 INFO:tasks.workunit.client.0.smithi110.stdout:9/178: dread d1/f15 [0,4194304] 0 2024-04-21T23:46:04.111 INFO:tasks.workunit.client.0.smithi110.stdout:1/139: read d1/dd/d23/f24 [895169,30998] 0 2024-04-21T23:46:04.252 INFO:tasks.workunit.client.0.smithi110.stdout:5/171: read d7/d9/f21 [1398103,59315] 0 2024-04-21T23:46:04.302 INFO:tasks.workunit.client.0.smithi110.stdout:2/153: rename d9/cd to d9/d1a/c35 0 2024-04-21T23:46:04.516 INFO:tasks.workunit.client.0.smithi110.stdout:0/170: dwrite d0/d16/f26 [0,4194304] 0 2024-04-21T23:46:04.519 INFO:tasks.workunit.client.0.smithi110.stdout:2/154: read d9/d1a/f26 [16634,19404] 0 2024-04-21T23:46:04.693 INFO:tasks.workunit.client.0.smithi110.stdout:2/155: stat d9/d25/c22 0 2024-04-21T23:46:04.876 INFO:tasks.workunit.client.0.smithi110.stdout:6/164: dwrite fe [0,4194304] 0 2024-04-21T23:46:05.014 INFO:tasks.workunit.client.0.smithi110.stdout:4/159: mkdir d1/d11/d20/d37 0 2024-04-21T23:46:05.033 INFO:tasks.workunit.client.0.smithi110.stdout:5/172: symlink d7/l2f 0 2024-04-21T23:46:05.149 INFO:tasks.workunit.client.0.smithi110.stdout:4/160: chown d1/d11/d20/d23/ff 837435370 1 2024-04-21T23:46:05.234 INFO:tasks.workunit.client.0.smithi110.stdout:5/173: dread d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:46:05.812 INFO:tasks.workunit.client.0.smithi110.stdout:7/168: rename d10/l17 to d10/d27/l40 0 2024-04-21T23:46:05.828 INFO:tasks.workunit.client.0.smithi110.stdout:3/160: rename d6/d12 to d6/d12/d14/d36 22 2024-04-21T23:46:05.975 INFO:tasks.workunit.client.0.smithi110.stdout:9/179: symlink d1/l33 0 2024-04-21T23:46:06.347 INFO:tasks.workunit.client.0.smithi110.stdout:5/174: symlink d7/d9/d17/l30 0 2024-04-21T23:46:06.526 INFO:tasks.workunit.client.0.smithi110.stdout:1/140: write d1/ff [1590837,34128] 0 2024-04-21T23:46:06.855 INFO:tasks.workunit.client.0.smithi110.stdout:3/161: dread - d6/f2d zero size 2024-04-21T23:46:06.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/180: rmdir d1/d19 39 2024-04-21T23:46:07.011 INFO:tasks.workunit.client.0.smithi110.stdout:0/171: write d0/f9 [1678094,28992] 0 2024-04-21T23:46:07.247 INFO:tasks.workunit.client.0.smithi110.stdout:1/141: symlink d1/d2/d14/d16/d29/l2f 0 2024-04-21T23:46:07.442 INFO:tasks.workunit.client.0.smithi110.stdout:8/192: creat d5/f39 x:0 0 0 2024-04-21T23:46:07.536 INFO:tasks.workunit.client.0.smithi110.stdout:2/156: write f1 [5684646,48403] 0 2024-04-21T23:46:07.776 INFO:tasks.workunit.client.0.smithi110.stdout:3/162: fsync d6/d12/f1a 0 2024-04-21T23:46:08.016 INFO:tasks.workunit.client.0.smithi110.stdout:6/165: dwrite f3 [4194304,4194304] 0 2024-04-21T23:46:08.163 INFO:tasks.workunit.client.0.smithi110.stdout:0/172: read - d0/f34 zero size 2024-04-21T23:46:08.442 INFO:tasks.workunit.client.0.smithi110.stdout:8/193: read d5/f2a [3033499,1992] 0 2024-04-21T23:46:08.538 INFO:tasks.workunit.client.0.smithi110.stdout:6/166: dread d16/d1d/d28/f30 [0,4194304] 0 2024-04-21T23:46:08.563 INFO:tasks.workunit.client.0.smithi110.stdout:8/194: chown d5/l34 4 1 2024-04-21T23:46:08.596 INFO:tasks.workunit.client.0.smithi110.stdout:8/195: stat d5/d24/f1f 0 2024-04-21T23:46:08.959 INFO:tasks.workunit.client.0.smithi110.stdout:4/161: dwrite d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:46:08.964 INFO:tasks.workunit.client.0.smithi110.stdout:3/163: dread d6/d12/d14/f25 [0,4194304] 0 2024-04-21T23:46:09.244 INFO:tasks.workunit.client.0.smithi110.stdout:1/142: mkdir d1/d2/d30 0 2024-04-21T23:46:09.261 INFO:tasks.workunit.client.0.smithi110.stdout:2/157: fdatasync d9/fa 0 2024-04-21T23:46:09.289 INFO:tasks.workunit.client.0.smithi110.stdout:6/167: mkdir d16/d1e/d24/d33 0 2024-04-21T23:46:09.308 INFO:tasks.workunit.client.0.smithi110.stdout:8/196: truncate d5/d24/f1f 2117135 0 2024-04-21T23:46:09.358 INFO:tasks.workunit.client.0.smithi110.stdout:8/197: fdatasync d5/f38 0 2024-04-21T23:46:09.453 INFO:tasks.workunit.client.0.smithi110.stdout:2/158: sync 2024-04-21T23:46:09.524 INFO:tasks.workunit.client.0.smithi110.stdout:7/169: write d10/d27/f2d [800252,85342] 0 2024-04-21T23:46:09.540 INFO:tasks.workunit.client.0.smithi110.stdout:4/162: creat d1/d11/d12/d26/f38 x:0 0 0 2024-04-21T23:46:09.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/164: dread - d6/d12/d14/d32/f33 zero size 2024-04-21T23:46:09.722 INFO:tasks.workunit.client.0.smithi110.stdout:1/143: creat d1/d2/d14/d16/f31 x:0 0 0 2024-04-21T23:46:09.946 INFO:tasks.workunit.client.0.smithi110.stdout:4/163: dwrite d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:46:10.283 INFO:tasks.workunit.client.0.smithi110.stdout:3/165: fsync d6/f19 0 2024-04-21T23:46:10.401 INFO:tasks.workunit.client.0.smithi110.stdout:4/164: fsync d1/d11/d12/f19 0 2024-04-21T23:46:10.441 INFO:tasks.workunit.client.0.smithi110.stdout:5/175: dwrite f5 [0,4194304] 0 2024-04-21T23:46:10.618 INFO:tasks.workunit.client.0.smithi110.stdout:6/168: creat d16/d1e/d24/d33/f34 x:0 0 0 2024-04-21T23:46:10.689 INFO:tasks.workunit.client.0.smithi110.stdout:2/159: unlink d9/d25/l19 0 2024-04-21T23:46:10.720 INFO:tasks.workunit.client.0.smithi110.stdout:1/144: creat d1/d2/d14/d16/d29/f32 x:0 0 0 2024-04-21T23:46:10.845 INFO:tasks.workunit.client.0.smithi110.stdout:8/198: dread d5/fe [0,4194304] 0 2024-04-21T23:46:11.085 INFO:tasks.workunit.client.0.smithi110.stdout:9/181: write d1/d19/f16 [8827182,85953] 0 2024-04-21T23:46:11.118 INFO:tasks.workunit.client.0.smithi110.stdout:2/160: dwrite f1 [0,4194304] 0 2024-04-21T23:46:11.442 INFO:tasks.workunit.client.0.smithi110.stdout:3/166: rename d6/d12/f28 to d6/d12/d14/d32/f37 0 2024-04-21T23:46:11.669 INFO:tasks.workunit.client.0.smithi110.stdout:8/199: truncate d5/d24/f2c 37673 0 2024-04-21T23:46:11.758 INFO:tasks.workunit.client.0.smithi110.stdout:1/145: mknod d1/d2/d1b/c33 0 2024-04-21T23:46:11.785 INFO:tasks.workunit.client.0.smithi110.stdout:5/176: dread d7/d9/fd [0,4194304] 0 2024-04-21T23:46:11.808 INFO:tasks.workunit.client.0.smithi110.stdout:0/173: dwrite d0/d14/f1c [0,4194304] 0 2024-04-21T23:46:12.045 INFO:tasks.workunit.client.0.smithi110.stdout:0/174: sync 2024-04-21T23:46:12.339 INFO:tasks.workunit.client.0.smithi110.stdout:2/161: creat d9/d1a/d1d/f36 x:0 0 0 2024-04-21T23:46:12.712 INFO:tasks.workunit.client.0.smithi110.stdout:5/177: dread d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:46:12.871 INFO:tasks.workunit.client.0.smithi110.stdout:0/175: dread d0/f13 [0,4194304] 0 2024-04-21T23:46:13.090 INFO:tasks.workunit.client.0.smithi110.stdout:7/170: write d10/d15/f21 [2697753,47460] 0 2024-04-21T23:46:13.200 INFO:tasks.workunit.client.0.smithi110.stdout:5/178: fdatasync d7/d9/d17/f1c 0 2024-04-21T23:46:13.404 INFO:tasks.workunit.client.0.smithi110.stdout:4/165: truncate d1/d11/d12/f19 2508648 0 2024-04-21T23:46:13.488 INFO:tasks.workunit.client.0.smithi110.stdout:0/176: symlink d0/d14/l37 0 2024-04-21T23:46:13.579 INFO:tasks.workunit.client.0.smithi110.stdout:6/169: write f4 [577509,33712] 0 2024-04-21T23:46:13.716 INFO:tasks.workunit.client.0.smithi110.stdout:7/171: mknod d10/d15/d22/c41 0 2024-04-21T23:46:14.034 INFO:tasks.workunit.client.0.smithi110.stdout:0/177: mknod d0/d16/c38 0 2024-04-21T23:46:14.691 INFO:tasks.workunit.client.0.smithi110.stdout:0/178: mknod d0/d27/c39 0 2024-04-21T23:46:15.290 INFO:tasks.workunit.client.0.smithi110.stdout:9/182: dwrite d1/d29/d2a/f26 [0,4194304] 0 2024-04-21T23:46:15.437 INFO:tasks.workunit.client.0.smithi110.stdout:3/167: write d6/d12/d16/f1f [2238201,92857] 0 2024-04-21T23:46:15.533 INFO:tasks.workunit.client.0.smithi110.stdout:1/146: write d1/f26 [798363,29772] 0 2024-04-21T23:46:15.634 INFO:tasks.workunit.client.0.smithi110.stdout:5/179: rmdir d7/d9 39 2024-04-21T23:46:15.819 INFO:tasks.workunit.client.0.smithi110.stdout:9/183: creat d1/d29/f34 x:0 0 0 2024-04-21T23:46:15.885 INFO:tasks.workunit.client.0.smithi110.stdout:8/200: dwrite d5/f31 [0,4194304] 0 2024-04-21T23:46:16.060 INFO:tasks.workunit.client.0.smithi110.stdout:1/147: fdatasync d1/dd/d23/f24 0 2024-04-21T23:46:16.122 INFO:tasks.workunit.client.0.smithi110.stdout:1/148: chown d1/d2/d14/d16/d29/c2b 207878251 1 2024-04-21T23:46:16.145 INFO:tasks.workunit.client.0.smithi110.stdout:1/149: fdatasync d1/f26 0 2024-04-21T23:46:16.246 INFO:tasks.workunit.client.0.smithi110.stdout:5/180: mkdir d7/d24/d31 0 2024-04-21T23:46:16.295 INFO:tasks.workunit.client.0.smithi110.stdout:2/162: truncate f1 7015334 0 2024-04-21T23:46:16.378 INFO:tasks.workunit.client.0.smithi110.stdout:1/150: dread d1/ff [0,4194304] 0 2024-04-21T23:46:16.913 INFO:tasks.workunit.client.0.smithi110.stdout:8/201: symlink d5/da/l3a 0 2024-04-21T23:46:17.101 INFO:tasks.workunit.client.0.smithi110.stdout:6/170: write d16/d1d/d28/f2b [673951,129331] 0 2024-04-21T23:46:17.471 INFO:tasks.workunit.client.0.smithi110.stdout:4/166: dwrite f0 [4194304,4194304] 0 2024-04-21T23:46:17.697 INFO:tasks.workunit.client.0.smithi110.stdout:7/172: dwrite d10/d15/f1b [0,4194304] 0 2024-04-21T23:46:18.089 INFO:tasks.workunit.client.0.smithi110.stdout:8/202: mkdir d5/da/d17/d3b 0 2024-04-21T23:46:18.545 INFO:tasks.workunit.client.0.smithi110.stdout:0/179: dwrite d0/f1e [0,4194304] 0 2024-04-21T23:46:19.113 INFO:tasks.workunit.client.0.smithi110.stdout:4/167: creat d1/f39 x:0 0 0 2024-04-21T23:46:19.344 INFO:tasks.workunit.client.0.smithi110.stdout:3/168: dwrite d6/fe [0,4194304] 0 2024-04-21T23:46:19.592 INFO:tasks.workunit.client.0.smithi110.stdout:6/171: write f1 [4668043,46996] 0 2024-04-21T23:46:19.615 INFO:tasks.workunit.client.0.smithi110.stdout:5/181: write d7/d9/fd [400243,114164] 0 2024-04-21T23:46:20.525 INFO:tasks.workunit.client.0.smithi110.stdout:0/180: write d0/f21 [1336865,118800] 0 2024-04-21T23:46:20.612 INFO:tasks.workunit.client.0.smithi110.stdout:2/163: dwrite d9/d1a/f2d [0,4194304] 0 2024-04-21T23:46:20.619 INFO:tasks.workunit.client.0.smithi110.stdout:1/151: dwrite d1/d2/d1b/d10/f15 [0,4194304] 0 2024-04-21T23:46:20.623 INFO:tasks.workunit.client.0.smithi110.stdout:9/184: dwrite d1/f7 [0,4194304] 0 2024-04-21T23:46:21.003 INFO:tasks.workunit.client.0.smithi110.stdout:7/173: rename fe to d10/d15/d22/f42 0 2024-04-21T23:46:21.053 INFO:tasks.workunit.client.0.smithi110.stdout:3/169: creat d6/f38 x:0 0 0 2024-04-21T23:46:21.084 INFO:tasks.workunit.client.0.smithi110.stdout:6/172: write d16/f17 [313966,54208] 0 2024-04-21T23:46:21.107 INFO:tasks.workunit.client.0.smithi110.stdout:5/182: write d7/d9/d17/f2c [782561,27762] 0 2024-04-21T23:46:21.202 INFO:tasks.workunit.client.0.smithi110.stdout:0/181: chown d0/d14/d23 537190 1 2024-04-21T23:46:21.346 INFO:tasks.workunit.client.0.smithi110.stdout:4/168: dread d1/d11/d20/d23/ff [0,4194304] 0 2024-04-21T23:46:21.359 INFO:tasks.workunit.client.0.smithi110.stdout:9/185: chown d1/d29/d2a/f26 0 1 2024-04-21T23:46:21.423 INFO:tasks.workunit.client.0.smithi110.stdout:8/203: dwrite d5/f39 [0,4194304] 0 2024-04-21T23:46:21.725 INFO:tasks.workunit.client.0.smithi110.stdout:3/170: unlink d6/fe 0 2024-04-21T23:46:21.751 INFO:tasks.workunit.client.0.smithi110.stdout:1/152: unlink d1/d2/d1b/d10/f15 0 2024-04-21T23:46:22.025 INFO:tasks.workunit.client.0.smithi110.stdout:2/164: mkdir d9/d37 0 2024-04-21T23:46:22.056 INFO:tasks.workunit.client.0.smithi110.stdout:6/173: mknod d16/d1e/c35 0 2024-04-21T23:46:22.058 INFO:tasks.workunit.client.0.smithi110.stdout:0/182: creat d0/d14/d23/f3a x:0 0 0 2024-04-21T23:46:22.128 INFO:tasks.workunit.client.0.smithi110.stdout:6/174: stat d16/d1d/f2f 0 2024-04-21T23:46:22.144 INFO:tasks.workunit.client.0.smithi110.stdout:9/186: rename d1/l2 to d1/d29/d2a/d6/d1d/l35 0 2024-04-21T23:46:22.246 INFO:tasks.workunit.client.0.smithi110.stdout:7/174: mkdir d10/d43 0 2024-04-21T23:46:22.247 INFO:tasks.workunit.client.0.smithi110.stdout:0/183: dread - d0/d14/d23/f3a zero size 2024-04-21T23:46:22.274 INFO:tasks.workunit.client.0.smithi110.stdout:1/153: symlink d1/d2/d1b/d10/l34 0 2024-04-21T23:46:22.680 INFO:tasks.workunit.client.0.smithi110.stdout:5/183: symlink d7/d24/d31/l32 0 2024-04-21T23:46:22.688 INFO:tasks.workunit.client.0.smithi110.stdout:5/184: stat d7 0 2024-04-21T23:46:23.061 INFO:tasks.workunit.client.0.smithi110.stdout:4/169: dwrite d1/d11/d20/f34 [0,4194304] 0 2024-04-21T23:46:23.382 INFO:tasks.workunit.client.0.smithi110.stdout:9/187: mknod d1/d29/d2a/dc/c36 0 2024-04-21T23:46:23.394 INFO:tasks.workunit.client.0.smithi110.stdout:6/175: creat d16/d1e/f36 x:0 0 0 2024-04-21T23:46:23.502 INFO:tasks.workunit.client.0.smithi110.stdout:0/184: mkdir d0/d14/d23/d3b 0 2024-04-21T23:46:23.558 INFO:tasks.workunit.client.0.smithi110.stdout:2/165: mknod d9/c38 0 2024-04-21T23:46:23.616 INFO:tasks.workunit.client.0.smithi110.stdout:3/171: dwrite d6/f19 [4194304,4194304] 0 2024-04-21T23:46:23.760 INFO:tasks.workunit.client.0.smithi110.stdout:7/175: dread d10/d15/f3e [0,4194304] 0 2024-04-21T23:46:23.850 INFO:tasks.workunit.client.0.smithi110.stdout:2/166: dread - d9/d25/f33 zero size 2024-04-21T23:46:23.976 INFO:tasks.workunit.client.0.smithi110.stdout:8/204: truncate d5/f39 1983743 0 2024-04-21T23:46:24.312 INFO:tasks.workunit.client.0.smithi110.stdout:0/185: dread d0/d14/f1c [0,4194304] 0 2024-04-21T23:46:24.824 INFO:tasks.workunit.client.0.smithi110.stdout:6/176: truncate d16/d1d/d28/f2d 339888 0 2024-04-21T23:46:25.011 INFO:tasks.workunit.client.0.smithi110.stdout:6/177: chown d16/d1e/d24/d33/f34 392912900 1 2024-04-21T23:46:25.038 INFO:tasks.workunit.client.0.smithi110.stdout:1/154: creat d1/d2/d1b/f35 x:0 0 0 2024-04-21T23:46:25.108 INFO:tasks.workunit.client.0.smithi110.stdout:4/170: dwrite d1/d11/d12/d26/f30 [0,4194304] 0 2024-04-21T23:46:25.140 INFO:tasks.workunit.client.0.smithi110.stdout:8/205: rename d5/da/d17/f26 to d5/d24/f3c 0 2024-04-21T23:46:25.326 INFO:tasks.workunit.client.0.smithi110.stdout:7/176: write d10/d15/f25 [684692,69101] 0 2024-04-21T23:46:25.352 INFO:tasks.workunit.client.0.smithi110.stdout:7/177: chown d10/l24 41 1 2024-04-21T23:46:25.596 INFO:tasks.workunit.client.0.smithi110.stdout:0/186: rmdir d0/d25 39 2024-04-21T23:46:25.774 INFO:tasks.workunit.client.0.smithi110.stdout:2/167: write d9/d25/d1c/f34 [15173,5540] 0 2024-04-21T23:46:25.999 INFO:tasks.workunit.client.0.smithi110.stdout:0/187: dread d0/fc [0,4194304] 0 2024-04-21T23:46:26.346 INFO:tasks.workunit.client.0.smithi110.stdout:6/178: truncate f12 1344305 0 2024-04-21T23:46:26.929 INFO:tasks.workunit.client.0.smithi110.stdout:8/206: unlink d5/da/d17/f20 0 2024-04-21T23:46:26.980 INFO:tasks.workunit.client.0.smithi110.stdout:7/178: readlink la 0 2024-04-21T23:46:27.028 INFO:tasks.workunit.client.0.smithi110.stdout:1/155: dread d1/d2/d1b/d10/f21 [0,4194304] 0 2024-04-21T23:46:27.313 INFO:tasks.workunit.client.0.smithi110.stdout:3/172: creat d6/d12/d16/f39 x:0 0 0 2024-04-21T23:46:27.377 INFO:tasks.workunit.client.0.smithi110.stdout:0/188: rename d0/d14/l15 to d0/d27/l3c 0 2024-04-21T23:46:27.389 INFO:tasks.workunit.client.0.smithi110.stdout:9/188: link d1/d29/d2a/d6/fe d1/d29/d2a/dc/d30/f37 0 2024-04-21T23:46:27.425 INFO:tasks.workunit.client.0.smithi110.stdout:1/156: dread d1/d2/d1b/f11 [0,4194304] 0 2024-04-21T23:46:27.476 INFO:tasks.workunit.client.0.smithi110.stdout:0/189: chown d0/l6 7495805 1 2024-04-21T23:46:27.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:46:27.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:46:27.788 INFO:tasks.workunit.client.0.smithi110.stdout:1/157: sync 2024-04-21T23:46:28.032 INFO:tasks.workunit.client.0.smithi110.stdout:6/179: dread fe [0,4194304] 0 2024-04-21T23:46:28.092 INFO:tasks.workunit.client.0.smithi110.stdout:5/185: link d7/f27 d7/d9/f33 0 2024-04-21T23:46:28.323 INFO:tasks.workunit.client.0.smithi110.stdout:2/168: mknod d9/d25/c39 0 2024-04-21T23:46:28.515 INFO:tasks.workunit.client.0.smithi110.stdout:9/189: unlink d1/d29/d2a/f14 0 2024-04-21T23:46:28.762 INFO:tasks.workunit.client.0.smithi110.stdout:3/173: truncate d6/d12/d14/f25 1580007 0 2024-04-21T23:46:29.103 INFO:tasks.workunit.client.0.smithi110.stdout:6/180: unlink f1 0 2024-04-21T23:46:29.208 INFO:tasks.workunit.client.0.smithi110.stdout:8/207: mkdir d5/d24/d33/d3d 0 2024-04-21T23:46:29.357 INFO:tasks.workunit.client.0.smithi110.stdout:7/179: fsync d10/d15/d22/d2c/f31 0 2024-04-21T23:46:29.773 INFO:tasks.workunit.client.0.smithi110.stdout:9/190: rename d1/l1a to d1/d29/d2a/dc/d30/l38 0 2024-04-21T23:46:29.789 INFO:tasks.workunit.client.0.smithi110.stdout:1/158: symlink d1/d2/d14/l36 0 2024-04-21T23:46:29.821 INFO:tasks.workunit.client.0.smithi110.stdout:0/190: write d0/d14/f32 [619468,25332] 0 2024-04-21T23:46:30.062 INFO:tasks.workunit.client.0.smithi110.stdout:4/171: getdents d1/d11/d12/d26 0 2024-04-21T23:46:30.348 INFO:tasks.workunit.client.0.smithi110.stdout:5/186: mknod d7/d9/c34 0 2024-04-21T23:46:31.122 INFO:tasks.workunit.client.0.smithi110.stdout:3/174: write f3 [3816851,64316] 0 2024-04-21T23:46:31.248 INFO:tasks.workunit.client.0.smithi110.stdout:7/180: dread d10/f1d [0,4194304] 0 2024-04-21T23:46:31.446 INFO:tasks.workunit.client.0.smithi110.stdout:2/169: mkdir d9/d37/d3a 0 2024-04-21T23:46:31.497 INFO:tasks.workunit.client.0.smithi110.stdout:0/191: readlink d0/d27/l3c 0 2024-04-21T23:46:31.498 INFO:tasks.workunit.client.0.smithi110.stdout:1/159: dread - d1/d2/d1b/d10/f2c zero size 2024-04-21T23:46:31.569 INFO:tasks.workunit.client.0.smithi110.stdout:1/160: chown d1/d2/d1b/f11 251 1 2024-04-21T23:46:31.959 INFO:tasks.workunit.client.0.smithi110.stdout:5/187: rmdir d7 39 2024-04-21T23:46:32.885 INFO:tasks.workunit.client.0.smithi110.stdout:9/191: dwrite d1/d29/d2a/f26 [0,4194304] 0 2024-04-21T23:46:33.006 INFO:tasks.workunit.client.0.smithi110.stdout:7/181: creat d10/d15/d22/f44 x:0 0 0 2024-04-21T23:46:33.272 INFO:tasks.workunit.client.0.smithi110.stdout:6/181: symlink d16/l37 0 2024-04-21T23:46:33.417 INFO:tasks.workunit.client.0.smithi110.stdout:1/161: truncate d1/dd/f20 574107 0 2024-04-21T23:46:33.710 INFO:tasks.workunit.client.0.smithi110.stdout:4/172: dwrite d1/d11/d12/d26/f38 [0,4194304] 0 2024-04-21T23:46:33.848 INFO:tasks.workunit.client.0.smithi110.stdout:4/173: chown d1/d35 370 1 2024-04-21T23:46:33.881 INFO:tasks.workunit.client.0.smithi110.stdout:9/192: mkdir d1/d29/d2a/d39 0 2024-04-21T23:46:34.071 INFO:tasks.workunit.client.0.smithi110.stdout:6/182: read f6 [580474,65922] 0 2024-04-21T23:46:34.203 INFO:tasks.workunit.client.0.smithi110.stdout:8/208: dwrite d5/d24/f14 [0,4194304] 0 2024-04-21T23:46:34.377 INFO:tasks.workunit.client.0.smithi110.stdout:2/170: write d9/f10 [176325,120855] 0 2024-04-21T23:46:34.414 INFO:tasks.workunit.client.0.smithi110.stdout:3/175: creat d6/f3a x:0 0 0 2024-04-21T23:46:34.534 INFO:tasks.workunit.client.0.smithi110.stdout:2/171: chown d9/c14 4 1 2024-04-21T23:46:34.566 INFO:tasks.workunit.client.0.smithi110.stdout:4/174: symlink d1/d35/l3a 0 2024-04-21T23:46:34.569 INFO:tasks.workunit.client.0.smithi110.stdout:8/209: dread d5/f1d [0,4194304] 0 2024-04-21T23:46:34.730 INFO:tasks.workunit.client.0.smithi110.stdout:9/193: rename d1/l33 to d1/d29/d2a/dc/d30/l3a 0 2024-04-21T23:46:34.877 INFO:tasks.workunit.client.0.smithi110.stdout:7/182: write f5 [2450919,125151] 0 2024-04-21T23:46:34.928 INFO:tasks.workunit.client.0.smithi110.stdout:0/192: dwrite d0/d14/d23/f3a [0,4194304] 0 2024-04-21T23:46:35.076 INFO:tasks.workunit.client.0.smithi110.stdout:7/183: stat d10/f1d 0 2024-04-21T23:46:35.092 INFO:tasks.workunit.client.0.smithi110.stdout:9/194: read d1/d29/d2a/dc/d30/f37 [75715,87306] 0 2024-04-21T23:46:35.158 INFO:tasks.workunit.client.0.smithi110.stdout:7/184: dread d10/f1d [0,4194304] 0 2024-04-21T23:46:35.269 INFO:tasks.workunit.client.0.smithi110.stdout:1/162: read d1/dd/f20 [227968,36027] 0 2024-04-21T23:46:35.353 INFO:tasks.workunit.client.0.smithi110.stdout:4/175: truncate d1/f28 471828 0 2024-04-21T23:46:35.946 INFO:tasks.workunit.client.0.smithi110.stdout:9/195: fdatasync d1/d19/f13 0 2024-04-21T23:46:36.037 INFO:tasks.workunit.client.0.smithi110.stdout:2/172: write d9/d1a/f1e [4371849,42842] 0 2024-04-21T23:46:36.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/176: creat d6/d12/d14/d32/f3b x:0 0 0 2024-04-21T23:46:36.324 INFO:tasks.workunit.client.0.smithi110.stdout:7/185: dread d10/f23 [0,4194304] 0 2024-04-21T23:46:36.814 INFO:tasks.workunit.client.0.smithi110.stdout:5/188: getdents d7/d22 0 2024-04-21T23:46:36.828 INFO:tasks.workunit.client.0.smithi110.stdout:5/189: readlink d7/l2f 0 2024-04-21T23:46:36.984 INFO:tasks.workunit.client.0.smithi110.stdout:0/193: mknod d0/d14/d23/d3b/c3d 0 2024-04-21T23:46:37.152 INFO:tasks.workunit.client.0.smithi110.stdout:9/196: truncate d1/d29/f2e 1834299 0 2024-04-21T23:46:37.535 INFO:tasks.workunit.client.0.smithi110.stdout:6/183: getdents d16/d1e/d24/d33 0 2024-04-21T23:46:37.545 INFO:tasks.workunit.client.0.smithi110.stdout:1/163: write d1/d2/f25 [376784,99887] 0 2024-04-21T23:46:37.613 INFO:tasks.workunit.client.0.smithi110.stdout:6/184: chown f3 334241 1 2024-04-21T23:46:37.697 INFO:tasks.workunit.client.0.smithi110.stdout:8/210: creat d5/f3e x:0 0 0 2024-04-21T23:46:38.130 INFO:tasks.workunit.client.0.smithi110.stdout:4/176: write d1/d11/d20/d23/f1f [54762,126190] 0 2024-04-21T23:46:38.166 INFO:tasks.workunit.client.0.smithi110.stdout:4/177: readlink d1/d35/l2e 0 2024-04-21T23:46:38.256 INFO:tasks.workunit.client.0.smithi110.stdout:2/173: unlink d9/d1a/c35 0 2024-04-21T23:46:38.339 INFO:tasks.workunit.client.0.smithi110.stdout:7/186: mkdir d10/d45 0 2024-04-21T23:46:38.386 INFO:tasks.workunit.client.0.smithi110.stdout:7/187: chown d10/d15/d22/c28 3185 1 2024-04-21T23:46:38.565 INFO:tasks.workunit.client.0.smithi110.stdout:5/190: mkdir d7/d35 0 2024-04-21T23:46:38.638 INFO:tasks.workunit.client.0.smithi110.stdout:0/194: mknod d0/d25/c3e 0 2024-04-21T23:46:38.808 INFO:tasks.workunit.client.0.smithi110.stdout:4/178: creat d1/d11/d12/d26/f3b x:0 0 0 2024-04-21T23:46:38.808 INFO:tasks.workunit.client.0.smithi110.stdout:9/197: read d1/d29/f2e [1832623,101351] 0 2024-04-21T23:46:38.878 INFO:tasks.workunit.client.0.smithi110.stdout:4/179: readlink d1/d11/d20/d23/l7 0 2024-04-21T23:46:38.911 INFO:tasks.workunit.client.0.smithi110.stdout:4/180: dread - d1/d11/d12/d26/f3b zero size 2024-04-21T23:46:39.000 INFO:tasks.workunit.client.0.smithi110.stdout:2/174: creat d9/d25/d1b/f3b x:0 0 0 2024-04-21T23:46:39.081 INFO:tasks.workunit.client.0.smithi110.stdout:1/164: mknod d1/d2/d1b/c37 0 2024-04-21T23:46:39.184 INFO:tasks.workunit.client.0.smithi110.stdout:2/175: dread d9/d1a/f26 [0,4194304] 0 2024-04-21T23:46:39.200 INFO:tasks.workunit.client.0.smithi110.stdout:1/165: chown d1/d2/d14/d16 508934 1 2024-04-21T23:46:39.276 INFO:tasks.workunit.client.0.smithi110.stdout:7/188: chown d10/d27/l40 17 1 2024-04-21T23:46:39.280 INFO:tasks.workunit.client.0.smithi110.stdout:6/185: read d16/d1d/f21 [2855300,108886] 0 2024-04-21T23:46:39.669 INFO:tasks.workunit.client.0.smithi110.stdout:5/191: read - d7/d24/f2e zero size 2024-04-21T23:46:39.933 INFO:tasks.workunit.client.0.smithi110.stdout:9/198: readlink d1/d29/d2a/d6/d1d/l35 0 2024-04-21T23:46:40.265 INFO:tasks.workunit.client.0.smithi110.stdout:4/181: mkdir d1/d11/d20/d23/d3c 0 2024-04-21T23:46:40.346 INFO:tasks.workunit.client.0.smithi110.stdout:3/177: getdents d6 0 2024-04-21T23:46:40.351 INFO:tasks.workunit.client.0.smithi110.stdout:1/166: creat d1/d2/d1b/d10/f38 x:0 0 0 2024-04-21T23:46:40.377 INFO:tasks.workunit.client.0.smithi110.stdout:2/176: creat d9/d25/d1c/f3c x:0 0 0 2024-04-21T23:46:40.545 INFO:tasks.workunit.client.0.smithi110.stdout:1/167: dread d1/dd/f20 [0,4194304] 0 2024-04-21T23:46:40.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/199: symlink d1/d29/d2a/d6/l3b 0 2024-04-21T23:46:41.029 INFO:tasks.workunit.client.0.smithi110.stdout:8/211: link d5/fe d5/f3f 0 2024-04-21T23:46:41.131 INFO:tasks.workunit.client.0.smithi110.stdout:6/186: mkdir d16/d1d/d38 0 2024-04-21T23:46:41.165 INFO:tasks.workunit.client.0.smithi110.stdout:6/187: dread - d16/d1e/d24/d33/f34 zero size 2024-04-21T23:46:41.485 INFO:tasks.workunit.client.0.smithi110.stdout:3/178: fsync d6/d12/d16/d30/f35 0 2024-04-21T23:46:41.512 INFO:tasks.workunit.client.0.smithi110.stdout:3/179: chown d6/lf 7 1 2024-04-21T23:46:41.813 INFO:tasks.workunit.client.0.smithi110.stdout:2/177: rename d9/d25/d1b/f1f to d9/d25/d1b/f3d 0 2024-04-21T23:46:41.854 INFO:tasks.workunit.client.0.smithi110.stdout:7/189: dwrite d10/d15/f2e [4194304,4194304] 0 2024-04-21T23:46:42.111 INFO:tasks.workunit.client.0.smithi110.stdout:5/192: write d7/d9/d17/f18 [699807,121323] 0 2024-04-21T23:46:42.197 INFO:tasks.workunit.client.0.smithi110.stdout:0/195: creat d0/f3f x:0 0 0 2024-04-21T23:46:42.318 INFO:tasks.workunit.client.0.smithi110.stdout:5/193: dread d7/d9/f21 [0,4194304] 0 2024-04-21T23:46:42.345 INFO:tasks.workunit.client.0.smithi110.stdout:5/194: chown d7/d24/f2e 4198654 1 2024-04-21T23:46:42.372 INFO:tasks.workunit.client.0.smithi110.stdout:9/200: truncate d1/d29/d2a/dc/f1f 270516 0 2024-04-21T23:46:43.418 INFO:tasks.workunit.client.0.smithi110.stdout:2/178: mknod d9/d25/d1b/c3e 0 2024-04-21T23:46:43.568 INFO:tasks.workunit.client.0.smithi110.stdout:7/190: mkdir d10/d2b/d46 0 2024-04-21T23:46:43.699 INFO:tasks.workunit.client.0.smithi110.stdout:0/196: mknod d0/d16/c40 0 2024-04-21T23:46:43.933 INFO:tasks.workunit.client.0.smithi110.stdout:8/212: mknod d5/c40 0 2024-04-21T23:46:44.031 INFO:tasks.workunit.client.0.smithi110.stdout:6/188: read d16/d1d/d28/f2b [131146,27707] 0 2024-04-21T23:46:44.350 INFO:tasks.workunit.client.0.smithi110.stdout:9/201: rename d1/d29/d2a/d39 to d1/d29/d2a/d3c 0 2024-04-21T23:46:44.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/168: creat d1/f39 x:0 0 0 2024-04-21T23:46:44.838 INFO:tasks.workunit.client.0.smithi110.stdout:0/197: fsync d0/d16/f26 0 2024-04-21T23:46:44.975 INFO:tasks.workunit.client.0.smithi110.stdout:5/195: truncate d7/f27 4768434 0 2024-04-21T23:46:45.077 INFO:tasks.workunit.client.0.smithi110.stdout:0/198: readlink d0/d27/l3c 0 2024-04-21T23:46:45.106 INFO:tasks.workunit.client.0.smithi110.stdout:3/180: dwrite d6/f19 [0,4194304] 0 2024-04-21T23:46:45.306 INFO:tasks.workunit.client.0.smithi110.stdout:0/199: fsync d0/f3f 0 2024-04-21T23:46:45.309 INFO:tasks.workunit.client.0.smithi110.stdout:2/179: dread f5 [0,4194304] 0 2024-04-21T23:46:45.437 INFO:tasks.workunit.client.0.smithi110.stdout:8/213: mknod d5/d24/d33/c41 0 2024-04-21T23:46:45.498 INFO:tasks.workunit.client.0.smithi110.stdout:4/182: getdents d1/d11/d12 0 2024-04-21T23:46:45.630 INFO:tasks.workunit.client.0.smithi110.stdout:7/191: mkdir d10/d43/d47 0 2024-04-21T23:46:45.659 INFO:tasks.workunit.client.0.smithi110.stdout:7/192: readlink d10/d15/l37 0 2024-04-21T23:46:45.787 INFO:tasks.workunit.client.0.smithi110.stdout:5/196: creat d7/d24/f36 x:0 0 0 2024-04-21T23:46:46.011 INFO:tasks.workunit.client.0.smithi110.stdout:3/181: unlink d6/lc 0 2024-04-21T23:46:46.437 INFO:tasks.workunit.client.0.smithi110.stdout:2/180: dread d9/d25/d1b/f3d [4194304,4194304] 0 2024-04-21T23:46:46.546 INFO:tasks.workunit.client.0.smithi110.stdout:6/189: write d16/f17 [826599,23929] 0 2024-04-21T23:46:46.693 INFO:tasks.workunit.client.0.smithi110.stdout:6/190: dread f6 [0,4194304] 0 2024-04-21T23:46:46.769 INFO:tasks.workunit.client.0.smithi110.stdout:8/214: dread d5/f31 [0,4194304] 0 2024-04-21T23:46:46.860 INFO:tasks.workunit.client.0.smithi110.stdout:1/169: write d1/d2/d14/d16/d29/f32 [1021474,21015] 0 2024-04-21T23:46:47.009 INFO:tasks.workunit.client.0.smithi110.stdout:8/215: chown d5/f3e 401 1 2024-04-21T23:46:47.368 INFO:tasks.workunit.client.0.smithi110.stdout:6/191: dread f10 [0,4194304] 0 2024-04-21T23:46:47.594 INFO:tasks.workunit.client.0.smithi110.stdout:8/216: symlink d5/d24/l42 0 2024-04-21T23:46:47.708 INFO:tasks.workunit.client.0.smithi110.stdout:3/182: chown d6/d12/d16/d30 1775023962 1 2024-04-21T23:46:47.739 INFO:tasks.workunit.client.0.smithi110.stdout:9/202: dwrite d1/f15 [0,4194304] 0 2024-04-21T23:46:47.874 INFO:tasks.workunit.client.0.smithi110.stdout:2/181: dread d9/f10 [0,4194304] 0 2024-04-21T23:46:48.013 INFO:tasks.workunit.client.0.smithi110.stdout:7/193: mknod d10/c48 0 2024-04-21T23:46:48.036 INFO:tasks.workunit.client.0.smithi110.stdout:4/183: creat d1/d11/f3d x:0 0 0 2024-04-21T23:46:48.067 INFO:tasks.workunit.client.0.smithi110.stdout:2/182: chown d9/d1a/c27 6907276 1 2024-04-21T23:46:48.414 INFO:tasks.workunit.client.0.smithi110.stdout:6/192: creat d16/d1e/d24/d33/f39 x:0 0 0 2024-04-21T23:46:48.681 INFO:tasks.workunit.client.0.smithi110.stdout:5/197: dwrite d7/d9/f2a [0,4194304] 0 2024-04-21T23:46:49.060 INFO:tasks.workunit.client.0.smithi110.stdout:7/194: mknod d10/d15/d22/c49 0 2024-04-21T23:46:49.073 INFO:tasks.workunit.client.0.smithi110.stdout:1/170: dwrite d1/d2/d1b/f13 [0,4194304] 0 2024-04-21T23:46:49.204 INFO:tasks.workunit.client.0.smithi110.stdout:2/183: mknod d9/d25/d1b/c3f 0 2024-04-21T23:46:49.228 INFO:tasks.workunit.client.0.smithi110.stdout:4/184: rename d1/d35/l2e to d1/d11/d20/d23/d3c/l3e 0 2024-04-21T23:46:49.258 INFO:tasks.workunit.client.0.smithi110.stdout:1/171: readlink d1/d2/d14/l36 0 2024-04-21T23:46:49.287 INFO:tasks.workunit.client.0.smithi110.stdout:0/200: creat d0/f41 x:0 0 0 2024-04-21T23:46:49.421 INFO:tasks.workunit.client.0.smithi110.stdout:1/172: truncate d1/f39 712059 0 2024-04-21T23:46:49.431 INFO:tasks.workunit.client.0.smithi110.stdout:6/193: dread f15 [4194304,4194304] 0 2024-04-21T23:46:49.506 INFO:tasks.workunit.client.0.smithi110.stdout:3/183: mkdir d6/d12/d3c 0 2024-04-21T23:46:49.707 INFO:tasks.workunit.client.0.smithi110.stdout:8/217: creat d5/d24/d33/d3d/f43 x:0 0 0 2024-04-21T23:46:50.066 INFO:tasks.workunit.client.0.smithi110.stdout:9/203: dwrite d1/d19/f32 [0,4194304] 0 2024-04-21T23:46:50.248 INFO:tasks.workunit.client.0.smithi110.stdout:9/204: chown d1/d29/f2e 1854450 1 2024-04-21T23:46:50.335 INFO:tasks.workunit.client.0.smithi110.stdout:0/201: truncate d0/f9 1126999 0 2024-04-21T23:46:50.418 INFO:tasks.workunit.client.0.smithi110.stdout:1/173: fsync d1/d2/d14/d16/f31 0 2024-04-21T23:46:50.678 INFO:tasks.workunit.client.0.smithi110.stdout:1/174: chown d1/dd/d23/f24 111829 1 2024-04-21T23:46:50.695 INFO:tasks.workunit.client.0.smithi110.stdout:9/205: sync 2024-04-21T23:46:50.818 INFO:tasks.workunit.client.0.smithi110.stdout:5/198: dwrite d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:46:51.041 INFO:tasks.workunit.client.0.smithi110.stdout:7/195: write d10/d15/f25 [4278833,42530] 0 2024-04-21T23:46:51.141 INFO:tasks.workunit.client.0.smithi110.stdout:9/206: write d1/d19/f32 [278533,75817] 0 2024-04-21T23:46:51.211 INFO:tasks.workunit.client.0.smithi110.stdout:8/218: dread d5/da/fc [0,4194304] 0 2024-04-21T23:46:51.291 INFO:tasks.workunit.client.0.smithi110.stdout:0/202: mkdir d0/d16/d42 0 2024-04-21T23:46:51.309 INFO:tasks.workunit.client.0.smithi110.stdout:5/199: chown d7/c19 50650 1 2024-04-21T23:46:51.441 INFO:tasks.workunit.client.0.smithi110.stdout:4/185: dwrite d1/d11/d20/f34 [0,4194304] 0 2024-04-21T23:46:51.837 INFO:tasks.workunit.client.0.smithi110.stdout:9/207: dread d1/d29/d2a/dc/d30/f37 [0,4194304] 0 2024-04-21T23:46:52.094 INFO:tasks.workunit.client.0.smithi110.stdout:7/196: dread d10/d15/d22/f42 [0,4194304] 0 2024-04-21T23:46:52.262 INFO:tasks.workunit.client.0.smithi110.stdout:1/175: rename d1/d2/d1b/d10/l34 to d1/d2/d14/d16/d27/l3a 0 2024-04-21T23:46:52.374 INFO:tasks.workunit.client.0.smithi110.stdout:5/200: mkdir d7/d24/d37 0 2024-04-21T23:46:52.560 INFO:tasks.workunit.client.0.smithi110.stdout:6/194: link cb d16/d1e/c3a 0 2024-04-21T23:46:52.574 INFO:tasks.workunit.client.0.smithi110.stdout:8/219: symlink d5/d24/d33/d3d/l44 0 2024-04-21T23:46:52.805 INFO:tasks.workunit.client.0.smithi110.stdout:4/186: creat d1/d11/d12/d26/f3f x:0 0 0 2024-04-21T23:46:52.981 INFO:tasks.workunit.client.0.smithi110.stdout:2/184: getdents d9/d25 0 2024-04-21T23:46:53.231 INFO:tasks.workunit.client.0.smithi110.stdout:3/184: dwrite d6/f38 [0,4194304] 0 2024-04-21T23:46:53.359 INFO:tasks.workunit.client.0.smithi110.stdout:7/197: mknod d10/d2b/d39/c4a 0 2024-04-21T23:46:53.386 INFO:tasks.workunit.client.0.smithi110.stdout:7/198: readlink d10/d15/l3b 0 2024-04-21T23:46:53.428 INFO:tasks.workunit.client.0.smithi110.stdout:7/199: dread d10/d15/f3e [0,4194304] 0 2024-04-21T23:46:53.846 INFO:tasks.workunit.client.0.smithi110.stdout:8/220: read d5/d24/f2c [23895,7453] 0 2024-04-21T23:46:54.382 INFO:tasks.workunit.client.0.smithi110.stdout:9/208: write d1/d29/d2a/dc/d30/f37 [2150954,14223] 0 2024-04-21T23:46:54.931 INFO:tasks.workunit.client.0.smithi110.stdout:8/221: rmdir d5/d24/d33/d3d 39 2024-04-21T23:46:55.473 INFO:tasks.workunit.client.0.smithi110.stdout:5/201: write d7/f27 [867226,82969] 0 2024-04-21T23:46:55.650 INFO:tasks.workunit.client.0.smithi110.stdout:3/185: dwrite f0 [0,4194304] 0 2024-04-21T23:46:55.847 INFO:tasks.workunit.client.0.smithi110.stdout:6/195: write d16/d1d/f2f [1072249,19831] 0 2024-04-21T23:46:55.847 INFO:tasks.workunit.client.0.smithi110.stdout:1/176: link d1/dd/f20 d1/d2/d14/d16/d27/f3b 0 2024-04-21T23:46:55.866 INFO:tasks.workunit.client.0.smithi110.stdout:0/203: rename d0/f9 to d0/d16/f43 0 2024-04-21T23:46:55.940 INFO:tasks.workunit.client.0.smithi110.stdout:7/200: dwrite d10/d27/f2d [0,4194304] 0 2024-04-21T23:46:56.175 INFO:tasks.workunit.client.0.smithi110.stdout:4/187: getdents d1/d35 0 2024-04-21T23:46:56.222 INFO:tasks.workunit.client.0.smithi110.stdout:9/209: dread d1/f15 [0,4194304] 0 2024-04-21T23:46:56.247 INFO:tasks.workunit.client.0.smithi110.stdout:6/196: chown d16/d1d/f2f 20872236 1 2024-04-21T23:46:56.341 INFO:tasks.workunit.client.0.smithi110.stdout:9/210: chown d1/l18 61738798 1 2024-04-21T23:46:56.687 INFO:tasks.workunit.client.0.smithi110.stdout:2/185: rename d9/c38 to d9/d1a/d1d/c40 0 2024-04-21T23:46:56.701 INFO:tasks.workunit.client.0.smithi110.stdout:5/202: mkdir d7/d24/d37/d38 0 2024-04-21T23:46:57.055 INFO:tasks.workunit.client.0.smithi110.stdout:7/201: rename d10/d15/d22/f3f to d10/d15/d22/f4b 0 2024-04-21T23:46:57.207 INFO:tasks.workunit.client.0.smithi110.stdout:6/197: symlink d16/d1d/d28/l3b 0 2024-04-21T23:46:57.221 INFO:tasks.workunit.client.0.smithi110.stdout:1/177: truncate d1/d2/d1b/f13 2033425 0 2024-04-21T23:46:57.334 INFO:tasks.workunit.client.0.smithi110.stdout:9/211: symlink d1/d29/l3d 0 2024-04-21T23:46:57.345 INFO:tasks.workunit.client.0.smithi110.stdout:3/186: mknod d6/d12/d3c/c3d 0 2024-04-21T23:46:57.373 INFO:tasks.workunit.client.0.smithi110.stdout:9/212: chown d1/d19/f32 9986168 1 2024-04-21T23:46:57.461 INFO:tasks.workunit.client.0.smithi110.stdout:8/222: write d5/d24/d33/d3d/f43 [226315,26770] 0 2024-04-21T23:46:57.467 INFO:tasks.workunit.client.0.smithi110.stdout:6/198: sync 2024-04-21T23:46:57.553 INFO:tasks.workunit.client.0.smithi110.stdout:8/223: read d5/d24/d33/d3d/f43 [230925,6241] 0 2024-04-21T23:46:57.664 INFO:tasks.workunit.client.0.smithi110.stdout:5/203: fsync d7/d9/fd 0 2024-04-21T23:46:57.711 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:46:57.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:46:58.007 INFO:tasks.workunit.client.0.smithi110.stdout:5/204: dwrite d7/f27 [0,4194304] 0 2024-04-21T23:46:58.437 INFO:tasks.workunit.client.0.smithi110.stdout:7/202: dread d10/f19 [0,4194304] 0 2024-04-21T23:46:58.454 INFO:tasks.workunit.client.0.smithi110.stdout:7/203: chown d10/d43 3285 1 2024-04-21T23:46:58.500 INFO:tasks.workunit.client.0.smithi110.stdout:7/204: chown d10/d15/d22/d2c/l3d 228582 1 2024-04-21T23:46:59.280 INFO:tasks.workunit.client.0.smithi110.stdout:0/204: dwrite d0/f11 [0,4194304] 0 2024-04-21T23:46:59.416 INFO:tasks.workunit.client.0.smithi110.stdout:4/188: rmdir d1/d11/d20/d37 0 2024-04-21T23:46:59.433 INFO:tasks.workunit.client.0.smithi110.stdout:1/178: unlink d1/d2/d1b/l1a 0 2024-04-21T23:46:59.521 INFO:tasks.workunit.client.0.smithi110.stdout:5/205: rmdir d7/d9 39 2024-04-21T23:46:59.616 INFO:tasks.workunit.client.0.smithi110.stdout:5/206: chown d7/d22 781246689 1 2024-04-21T23:46:59.781 INFO:tasks.workunit.client.0.smithi110.stdout:8/224: truncate d5/f39 2925836 0 2024-04-21T23:46:59.870 INFO:tasks.workunit.client.0.smithi110.stdout:2/186: dwrite d9/d25/f2f [0,4194304] 0 2024-04-21T23:47:00.290 INFO:tasks.workunit.client.0.smithi110.stdout:0/205: symlink d0/d25/l44 0 2024-04-21T23:47:00.322 INFO:tasks.workunit.client.0.smithi110.stdout:0/206: chown d0/d16/c38 6296944 1 2024-04-21T23:47:00.358 INFO:tasks.workunit.client.0.smithi110.stdout:6/199: link d16/d1e/d24/d33/f39 d16/d1e/d24/f3c 0 2024-04-21T23:47:00.570 INFO:tasks.workunit.client.0.smithi110.stdout:8/225: rename d5/f3e to d5/d24/f45 0 2024-04-21T23:47:00.601 INFO:tasks.workunit.client.0.smithi110.stdout:9/213: getdents d1/d29/d2a/dc/d30 0 2024-04-21T23:47:00.665 INFO:tasks.workunit.client.0.smithi110.stdout:8/226: readlink d5/da/d17/l37 0 2024-04-21T23:47:00.969 INFO:tasks.workunit.client.0.smithi110.stdout:7/205: truncate d10/d27/f2d 2907775 0 2024-04-21T23:47:01.163 INFO:tasks.workunit.client.0.smithi110.stdout:4/189: write d1/d11/d12/f19 [346813,2568] 0 2024-04-21T23:47:01.360 INFO:tasks.workunit.client.0.smithi110.stdout:1/179: dwrite d1/d2/f25 [0,4194304] 0 2024-04-21T23:47:01.714 INFO:tasks.workunit.client.0.smithi110.stdout:6/200: unlink d16/d1e/d24/f26 0 2024-04-21T23:47:01.868 INFO:tasks.workunit.client.0.smithi110.stdout:2/187: creat d9/d37/d3a/f41 x:0 0 0 2024-04-21T23:47:01.969 INFO:tasks.workunit.client.0.smithi110.stdout:3/187: link d6/f34 d6/d12/f3e 0 2024-04-21T23:47:02.899 INFO:tasks.workunit.client.0.smithi110.stdout:4/190: mkdir d1/d11/d20/d23/d1c/d40 0 2024-04-21T23:47:03.217 INFO:tasks.workunit.client.0.smithi110.stdout:0/207: dwrite d0/fb [0,4194304] 0 2024-04-21T23:47:03.468 INFO:tasks.workunit.client.0.smithi110.stdout:6/201: truncate d16/d1e/f2a 1422673 0 2024-04-21T23:47:03.480 INFO:tasks.workunit.client.0.smithi110.stdout:2/188: mknod d9/d37/d3a/c42 0 2024-04-21T23:47:03.535 INFO:tasks.workunit.client.0.smithi110.stdout:9/214: write d1/d29/d2a/d6/f27 [3552605,12667] 0 2024-04-21T23:47:03.636 INFO:tasks.workunit.client.0.smithi110.stdout:3/188: read - d6/f2d zero size 2024-04-21T23:47:04.015 INFO:tasks.workunit.client.0.smithi110.stdout:8/227: dwrite d5/d24/d33/d3d/f43 [0,4194304] 0 2024-04-21T23:47:04.177 INFO:tasks.workunit.client.0.smithi110.stdout:4/191: truncate d1/d11/d20/d23/f1f 242764 0 2024-04-21T23:47:04.260 INFO:tasks.workunit.client.0.smithi110.stdout:7/206: dwrite d10/d15/f21 [0,4194304] 0 2024-04-21T23:47:04.908 INFO:tasks.workunit.client.0.smithi110.stdout:5/207: link d7/d9/d17/f18 d7/f39 0 2024-04-21T23:47:04.922 INFO:tasks.workunit.client.0.smithi110.stdout:8/228: unlink d5/d24/l42 0 2024-04-21T23:47:04.978 INFO:tasks.workunit.client.0.smithi110.stdout:7/207: mkdir d10/d15/d22/d2c/d4c 0 2024-04-21T23:47:05.046 INFO:tasks.workunit.client.0.smithi110.stdout:4/192: truncate d1/d11/d20/d23/f2f 29941 0 2024-04-21T23:47:05.216 INFO:tasks.workunit.client.0.smithi110.stdout:5/208: dread d7/d9/fd [0,4194304] 0 2024-04-21T23:47:05.343 INFO:tasks.workunit.client.0.smithi110.stdout:1/180: rename d1/d1d/l1e to d1/d2/d30/l3c 0 2024-04-21T23:47:05.725 INFO:tasks.workunit.client.0.smithi110.stdout:0/208: dwrite d0/d27/f36 [0,4194304] 0 2024-04-21T23:47:05.839 INFO:tasks.workunit.client.0.smithi110.stdout:2/189: write d9/d25/d1b/f3d [2218782,68481] 0 2024-04-21T23:47:05.875 INFO:tasks.workunit.client.0.smithi110.stdout:3/189: write d6/d12/f29 [2631482,20559] 0 2024-04-21T23:47:06.013 INFO:tasks.workunit.client.0.smithi110.stdout:5/209: mkdir d7/d24/d3a 0 2024-04-21T23:47:06.219 INFO:tasks.workunit.client.0.smithi110.stdout:0/209: dwrite d0/d27/f36 [0,4194304] 0 2024-04-21T23:47:06.696 INFO:tasks.workunit.client.0.smithi110.stdout:9/215: getdents d1/d29/d2a/d6/d1d 0 2024-04-21T23:47:07.157 INFO:tasks.workunit.client.0.smithi110.stdout:6/202: dread d16/d1e/f2a [0,4194304] 0 2024-04-21T23:47:07.208 INFO:tasks.workunit.client.0.smithi110.stdout:7/208: write d10/d15/f32 [458628,109011] 0 2024-04-21T23:47:07.336 INFO:tasks.workunit.client.0.smithi110.stdout:8/229: write d5/da/d17/f22 [2592971,114176] 0 2024-04-21T23:47:07.396 INFO:tasks.workunit.client.0.smithi110.stdout:3/190: mkdir d6/d12/d14/d3f 0 2024-04-21T23:47:07.944 INFO:tasks.workunit.client.0.smithi110.stdout:0/210: rmdir d0/d14/d23/d3b 39 2024-04-21T23:47:08.482 INFO:tasks.workunit.client.0.smithi110.stdout:1/181: write d1/d2/d14/d16/d29/f32 [616759,62851] 0 2024-04-21T23:47:09.033 INFO:tasks.workunit.client.0.smithi110.stdout:4/193: write d1/d11/d20/f2c [1105003,584] 0 2024-04-21T23:47:09.358 INFO:tasks.workunit.client.0.smithi110.stdout:7/209: mkdir d10/d45/d4d 0 2024-04-21T23:47:09.603 INFO:tasks.workunit.client.0.smithi110.stdout:8/230: rename d5/d24/f1f to d5/d24/d33/d3d/f46 0 2024-04-21T23:47:09.785 INFO:tasks.workunit.client.0.smithi110.stdout:5/210: write d7/d9/f2a [4612309,39472] 0 2024-04-21T23:47:09.940 INFO:tasks.workunit.client.0.smithi110.stdout:2/190: link d9/d37/d3a/c42 d9/d25/d1c/c43 0 2024-04-21T23:47:10.256 INFO:tasks.workunit.client.0.smithi110.stdout:2/191: dwrite d9/d25/d1b/f3d [8388608,4194304] 0 2024-04-21T23:47:10.422 INFO:tasks.workunit.client.0.smithi110.stdout:4/194: dread d1/d11/d20/d23/f1f [0,4194304] 0 2024-04-21T23:47:11.129 INFO:tasks.workunit.client.0.smithi110.stdout:9/216: getdents d1/d19 0 2024-04-21T23:47:11.315 INFO:tasks.workunit.client.0.smithi110.stdout:2/192: mknod d9/d1a/d1d/d2b/c44 0 2024-04-21T23:47:11.445 INFO:tasks.workunit.client.0.smithi110.stdout:6/203: getdents d16/d1d/d28 0 2024-04-21T23:47:11.667 INFO:tasks.workunit.client.0.smithi110.stdout:1/182: write d1/d2/d1b/d10/f38 [949733,13475] 0 2024-04-21T23:47:12.178 INFO:tasks.workunit.client.0.smithi110.stdout:2/193: dread d9/d1a/f2d [0,4194304] 0 2024-04-21T23:47:12.237 INFO:tasks.workunit.client.0.smithi110.stdout:6/204: rmdir d16/d1e/d24 39 2024-04-21T23:47:12.420 INFO:tasks.workunit.client.0.smithi110.stdout:0/211: write d0/d16/f43 [1257838,83998] 0 2024-04-21T23:47:12.464 INFO:tasks.workunit.client.0.smithi110.stdout:1/183: truncate d1/d2/d1b/d10/f12 4597249 0 2024-04-21T23:47:12.578 INFO:tasks.workunit.client.0.smithi110.stdout:3/191: dwrite d6/f19 [8388608,4194304] 0 2024-04-21T23:47:12.731 INFO:tasks.workunit.client.0.smithi110.stdout:0/212: chown d0/f13 114614 1 2024-04-21T23:47:12.767 INFO:tasks.workunit.client.0.smithi110.stdout:1/184: read d1/d2/d14/d16/d27/f3b [35487,75686] 0 2024-04-21T23:47:12.858 INFO:tasks.workunit.client.0.smithi110.stdout:7/210: getdents d10/d15/d22/d2c 0 2024-04-21T23:47:12.909 INFO:tasks.workunit.client.0.smithi110.stdout:7/211: chown d10/c48 20811 1 2024-04-21T23:47:12.937 INFO:tasks.workunit.client.0.smithi110.stdout:7/212: stat d10/d15/d22/d2c/f31 0 2024-04-21T23:47:13.324 INFO:tasks.workunit.client.0.smithi110.stdout:8/231: getdents d5/da 0 2024-04-21T23:47:13.661 INFO:tasks.workunit.client.0.smithi110.stdout:5/211: rename d7/f39 to d7/d9/f3b 0 2024-04-21T23:47:13.733 INFO:tasks.workunit.client.0.smithi110.stdout:4/195: write d1/f3 [3749223,122235] 0 2024-04-21T23:47:13.976 INFO:tasks.workunit.client.0.smithi110.stdout:5/212: sync 2024-04-21T23:47:13.977 INFO:tasks.workunit.client.0.smithi110.stdout:7/213: creat d10/d2b/d39/f4e x:0 0 0 2024-04-21T23:47:14.169 INFO:tasks.workunit.client.0.smithi110.stdout:8/232: creat d5/d24/d33/d3d/f47 x:0 0 0 2024-04-21T23:47:14.289 INFO:tasks.workunit.client.0.smithi110.stdout:7/214: dread d10/d15/f3e [0,4194304] 0 2024-04-21T23:47:14.477 INFO:tasks.workunit.client.0.smithi110.stdout:2/194: write d9/d25/f2f [3051419,10166] 0 2024-04-21T23:47:14.585 INFO:tasks.workunit.client.0.smithi110.stdout:9/217: dwrite d1/d29/d2a/d6/d1d/f24 [0,4194304] 0 2024-04-21T23:47:14.854 INFO:tasks.workunit.client.0.smithi110.stdout:0/213: creat d0/d14/d23/f45 x:0 0 0 2024-04-21T23:47:15.224 INFO:tasks.workunit.client.0.smithi110.stdout:8/233: unlink d5/d24/d33/c41 0 2024-04-21T23:47:15.233 INFO:tasks.workunit.client.0.smithi110.stdout:5/213: dwrite d7/d9/f2a [0,4194304] 0 2024-04-21T23:47:15.296 INFO:tasks.workunit.client.0.smithi110.stdout:4/196: creat d1/d11/f41 x:0 0 0 2024-04-21T23:47:15.439 INFO:tasks.workunit.client.0.smithi110.stdout:7/215: creat d10/d45/f4f x:0 0 0 2024-04-21T23:47:15.725 INFO:tasks.workunit.client.0.smithi110.stdout:9/218: chown d1/d29/d2a/d6/l3b 125957 1 2024-04-21T23:47:15.751 INFO:tasks.workunit.client.0.smithi110.stdout:3/192: dwrite d6/f38 [0,4194304] 0 2024-04-21T23:47:15.838 INFO:tasks.workunit.client.0.smithi110.stdout:6/205: dwrite d16/d1e/f36 [0,4194304] 0 2024-04-21T23:47:16.033 INFO:tasks.workunit.client.0.smithi110.stdout:0/214: rename d0/f12 to d0/d16/f46 0 2024-04-21T23:47:16.068 INFO:tasks.workunit.client.0.smithi110.stdout:2/195: dread d9/fe [0,4194304] 0 2024-04-21T23:47:16.125 INFO:tasks.workunit.client.0.smithi110.stdout:7/216: chown d10/d27/l2f 6 1 2024-04-21T23:47:16.135 INFO:tasks.workunit.client.0.smithi110.stdout:1/185: dwrite d1/d2/d1b/f9 [4194304,4194304] 0 2024-04-21T23:47:16.267 INFO:tasks.workunit.client.0.smithi110.stdout:0/215: stat d0/d25/l28 0 2024-04-21T23:47:16.306 INFO:tasks.workunit.client.0.smithi110.stdout:1/186: chown d1/f26 1031247288 1 2024-04-21T23:47:16.338 INFO:tasks.workunit.client.0.smithi110.stdout:5/214: mknod d7/d35/c3c 0 2024-04-21T23:47:16.350 INFO:tasks.workunit.client.0.smithi110.stdout:8/234: mknod d5/d24/d33/c48 0 2024-04-21T23:47:16.372 INFO:tasks.workunit.client.0.smithi110.stdout:4/197: symlink d1/d11/l42 0 2024-04-21T23:47:16.448 INFO:tasks.workunit.client.0.smithi110.stdout:1/187: chown d1/d2/d1b/c33 12973257 1 2024-04-21T23:47:16.459 INFO:tasks.workunit.client.0.smithi110.stdout:5/215: chown d7/d9/f2a 0 1 2024-04-21T23:47:16.643 INFO:tasks.workunit.client.0.smithi110.stdout:1/188: dread d1/ff [0,4194304] 0 2024-04-21T23:47:16.782 INFO:tasks.workunit.client.0.smithi110.stdout:6/206: truncate d16/d1d/f21 3882068 0 2024-04-21T23:47:17.131 INFO:tasks.workunit.client.0.smithi110.stdout:2/196: dread d9/d25/d1b/f3d [0,4194304] 0 2024-04-21T23:47:17.163 INFO:tasks.workunit.client.0.smithi110.stdout:2/197: read d9/fa [859500,6956] 0 2024-04-21T23:47:17.202 INFO:tasks.workunit.client.0.smithi110.stdout:1/189: creat d1/dd/d23/f3d x:0 0 0 2024-04-21T23:47:17.233 INFO:tasks.workunit.client.0.smithi110.stdout:2/198: stat d9/lb 0 2024-04-21T23:47:17.387 INFO:tasks.workunit.client.0.smithi110.stdout:2/199: dread d9/d25/f2f [0,4194304] 0 2024-04-21T23:47:17.416 INFO:tasks.workunit.client.0.smithi110.stdout:3/193: write f3 [11305638,17440] 0 2024-04-21T23:47:17.455 INFO:tasks.workunit.client.0.smithi110.stdout:7/217: fsync d10/d15/d22/f4b 0 2024-04-21T23:47:17.815 INFO:tasks.workunit.client.0.smithi110.stdout:0/216: symlink d0/d14/d23/d3b/l47 0 2024-04-21T23:47:17.851 INFO:tasks.workunit.client.0.smithi110.stdout:6/207: write d16/f1c [3554807,50002] 0 2024-04-21T23:47:17.948 INFO:tasks.workunit.client.0.smithi110.stdout:6/208: dread f15 [4194304,4194304] 0 2024-04-21T23:47:17.975 INFO:tasks.workunit.client.0.smithi110.stdout:0/217: sync 2024-04-21T23:47:18.074 INFO:tasks.workunit.client.0.smithi110.stdout:0/218: sync 2024-04-21T23:47:18.349 INFO:tasks.workunit.client.0.smithi110.stdout:2/200: chown l8 5388 1 2024-04-21T23:47:18.463 INFO:tasks.workunit.client.0.smithi110.stdout:9/219: link d1/d29/d2a/dc/d30/l3a d1/d29/d2a/d2b/l3e 0 2024-04-21T23:47:18.534 INFO:tasks.workunit.client.0.smithi110.stdout:4/198: write d1/d11/d20/d23/ff [308522,1849] 0 2024-04-21T23:47:18.616 INFO:tasks.workunit.client.0.smithi110.stdout:3/194: mknod d6/d12/d3c/c40 0 2024-04-21T23:47:18.767 INFO:tasks.workunit.client.0.smithi110.stdout:7/218: unlink d10/d15/d22/d2c/l3d 0 2024-04-21T23:47:19.357 INFO:tasks.workunit.client.0.smithi110.stdout:5/216: creat d7/d9/f3d x:0 0 0 2024-04-21T23:47:19.549 INFO:tasks.workunit.client.0.smithi110.stdout:0/219: unlink d0/d25/l44 0 2024-04-21T23:47:19.570 INFO:tasks.workunit.client.0.smithi110.stdout:0/220: chown d0/f1e 47 1 2024-04-21T23:47:19.948 INFO:tasks.workunit.client.0.smithi110.stdout:2/201: mkdir d9/d25/d1b/d45 0 2024-04-21T23:47:19.972 INFO:tasks.workunit.client.0.smithi110.stdout:2/202: readlink d9/l23 0 2024-04-21T23:47:20.441 INFO:tasks.workunit.client.0.smithi110.stdout:6/209: dread - d16/d1e/d24/f2c zero size 2024-04-21T23:47:20.478 INFO:tasks.workunit.client.0.smithi110.stdout:1/190: write d1/ff [2479194,40840] 0 2024-04-21T23:47:20.575 INFO:tasks.workunit.client.0.smithi110.stdout:1/191: sync 2024-04-21T23:47:20.582 INFO:tasks.workunit.client.0.smithi110.stdout:0/221: creat d0/d27/f48 x:0 0 0 2024-04-21T23:47:21.212 INFO:tasks.workunit.client.0.smithi110.stdout:3/195: symlink d6/l41 0 2024-04-21T23:47:21.719 INFO:tasks.workunit.client.0.smithi110.stdout:1/192: mkdir d1/d2/d14/d16/d27/d3e 0 2024-04-21T23:47:22.000 INFO:tasks.workunit.client.0.smithi110.stdout:1/193: dwrite d1/d2/d1b/f11 [4194304,4194304] 0 2024-04-21T23:47:22.260 INFO:tasks.workunit.client.0.smithi110.stdout:8/235: rename d5/d24/f23 to d5/d24/f49 0 2024-04-21T23:47:22.608 INFO:tasks.workunit.client.0.smithi110.stdout:9/220: write d1/d29/d2a/d6/fe [1598472,96875] 0 2024-04-21T23:47:22.810 INFO:tasks.workunit.client.0.smithi110.stdout:4/199: write d1/d11/d20/f34 [1708982,79734] 0 2024-04-21T23:47:22.885 INFO:tasks.workunit.client.0.smithi110.stdout:2/203: link d9/d1a/f21 d9/d25/f46 0 2024-04-21T23:47:22.916 INFO:tasks.workunit.client.0.smithi110.stdout:7/219: write d10/d15/f3e [1926209,64546] 0 2024-04-21T23:47:22.942 INFO:tasks.workunit.client.0.smithi110.stdout:4/200: sync 2024-04-21T23:47:23.051 INFO:tasks.workunit.client.0.smithi110.stdout:8/236: chown d5/da/d17/c30 2698060 1 2024-04-21T23:47:23.204 INFO:tasks.workunit.client.0.smithi110.stdout:1/194: dread d1/d2/f25 [0,4194304] 0 2024-04-21T23:47:23.372 INFO:tasks.workunit.client.0.smithi110.stdout:5/217: dwrite d7/d24/f36 [0,4194304] 0 2024-04-21T23:47:23.380 INFO:tasks.workunit.client.0.smithi110.stdout:9/221: truncate d1/d29/f2e 1302332 0 2024-04-21T23:47:23.535 INFO:tasks.workunit.client.0.smithi110.stdout:9/222: stat d1/l1b 0 2024-04-21T23:47:23.555 INFO:tasks.workunit.client.0.smithi110.stdout:6/210: write f15 [6229969,80969] 0 2024-04-21T23:47:23.608 INFO:tasks.workunit.client.0.smithi110.stdout:8/237: mknod d5/d24/c4a 0 2024-04-21T23:47:23.719 INFO:tasks.workunit.client.0.smithi110.stdout:0/222: getdents d0/d27 0 2024-04-21T23:47:23.818 INFO:tasks.workunit.client.0.smithi110.stdout:3/196: rename d6/fd to d6/d12/d14/d3f/f42 0 2024-04-21T23:47:24.016 INFO:tasks.workunit.client.0.smithi110.stdout:5/218: fdatasync d7/d24/f2e 0 2024-04-21T23:47:24.437 INFO:tasks.workunit.client.0.smithi110.stdout:6/211: rmdir d16/d1d/d28 39 2024-04-21T23:47:24.523 INFO:tasks.workunit.client.0.smithi110.stdout:8/238: mknod d5/d24/d33/d3d/c4b 0 2024-04-21T23:47:24.594 INFO:tasks.workunit.client.0.smithi110.stdout:0/223: fsync d0/fc 0 2024-04-21T23:47:25.267 INFO:tasks.workunit.client.0.smithi110.stdout:5/219: rename d7/d24/d31/l32 to d7/d24/d3a/l3e 0 2024-04-21T23:47:25.514 INFO:tasks.workunit.client.0.smithi110.stdout:9/223: symlink d1/l3f 0 2024-04-21T23:47:25.626 INFO:tasks.workunit.client.0.smithi110.stdout:8/239: mknod d5/d24/c4c 0 2024-04-21T23:47:25.678 INFO:tasks.workunit.client.0.smithi110.stdout:7/220: write d10/f34 [326547,105979] 0 2024-04-21T23:47:25.933 INFO:tasks.workunit.client.0.smithi110.stdout:3/197: symlink d6/d12/l43 0 2024-04-21T23:47:25.988 INFO:tasks.workunit.client.0.smithi110.stdout:4/201: dwrite d1/fe [0,4194304] 0 2024-04-21T23:47:26.268 INFO:tasks.workunit.client.0.smithi110.stdout:5/220: mknod d7/d9/d17/c3f 0 2024-04-21T23:47:26.365 INFO:tasks.workunit.client.0.smithi110.stdout:2/204: getdents d9/d37/d3a 0 2024-04-21T23:47:26.507 INFO:tasks.workunit.client.0.smithi110.stdout:5/221: chown d7/f27 5105 1 2024-04-21T23:47:26.517 INFO:tasks.workunit.client.0.smithi110.stdout:1/195: dwrite d1/d2/d1b/d10/f38 [0,4194304] 0 2024-04-21T23:47:26.851 INFO:tasks.workunit.client.0.smithi110.stdout:8/240: dread d5/f39 [0,4194304] 0 2024-04-21T23:47:26.885 INFO:tasks.workunit.client.0.smithi110.stdout:8/241: stat d5/ff 0 2024-04-21T23:47:27.554 INFO:tasks.workunit.client.0.smithi110.stdout:2/205: mknod d9/d1a/d1d/c47 0 2024-04-21T23:47:27.643 INFO:tasks.workunit.client.0.smithi110.stdout:5/222: mkdir d7/d24/d3a/d40 0 2024-04-21T23:47:27.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:47:27.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:47:27.836 INFO:tasks.workunit.client.0.smithi110.stdout:0/224: link d0/d25/l2d d0/d14/d23/d3b/l49 0 2024-04-21T23:47:28.492 INFO:tasks.workunit.client.0.smithi110.stdout:1/196: mknod d1/d2/d14/c3f 0 2024-04-21T23:47:28.549 INFO:tasks.workunit.client.0.smithi110.stdout:5/223: dread d7/d9/f33 [4194304,4194304] 0 2024-04-21T23:47:29.023 INFO:tasks.workunit.client.0.smithi110.stdout:6/212: rename d16/d1d/d28 to d16/d3d 0 2024-04-21T23:47:29.213 INFO:tasks.workunit.client.0.smithi110.stdout:7/221: getdents d10/d15 0 2024-04-21T23:47:29.260 INFO:tasks.workunit.client.0.smithi110.stdout:7/222: chown d10/f19 78336 1 2024-04-21T23:47:29.376 INFO:tasks.workunit.client.0.smithi110.stdout:1/197: chown d1/d2/d30/l3c 5730 1 2024-04-21T23:47:29.620 INFO:tasks.workunit.client.0.smithi110.stdout:5/224: dread d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:47:29.671 INFO:tasks.workunit.client.0.smithi110.stdout:5/225: dread d7/d9/f33 [4194304,4194304] 0 2024-04-21T23:47:29.832 INFO:tasks.workunit.client.0.smithi110.stdout:9/224: rename d1/d29/d2a/dc/d30/f37 to d1/d29/d2a/dc/f40 0 2024-04-21T23:47:30.048 INFO:tasks.workunit.client.0.smithi110.stdout:2/206: fdatasync d9/d25/f46 0 2024-04-21T23:47:30.248 INFO:tasks.workunit.client.0.smithi110.stdout:4/202: dwrite d1/d35/f33 [0,4194304] 0 2024-04-21T23:47:30.567 INFO:tasks.workunit.client.0.smithi110.stdout:5/226: creat d7/d24/d3a/d40/f41 x:0 0 0 2024-04-21T23:47:30.711 INFO:tasks.workunit.client.0.smithi110.stdout:3/198: dwrite d6/d12/d14/d32/f37 [0,4194304] 0 2024-04-21T23:47:30.898 INFO:tasks.workunit.client.0.smithi110.stdout:4/203: mkdir d1/d35/d43 0 2024-04-21T23:47:30.933 INFO:tasks.workunit.client.0.smithi110.stdout:4/204: fsync d1/d35/f33 0 2024-04-21T23:47:31.084 INFO:tasks.workunit.client.0.smithi110.stdout:1/198: creat d1/f40 x:0 0 0 2024-04-21T23:47:31.416 INFO:tasks.workunit.client.0.smithi110.stdout:8/242: rename d5/da/fc to d5/d24/d33/f4d 0 2024-04-21T23:47:31.423 INFO:tasks.workunit.client.0.smithi110.stdout:1/199: dwrite d1/d2/d1b/d10/f38 [4194304,4194304] 0 2024-04-21T23:47:31.838 INFO:tasks.workunit.client.0.smithi110.stdout:4/205: symlink d1/d11/d20/d23/d3c/l44 0 2024-04-21T23:47:32.360 INFO:tasks.workunit.client.0.smithi110.stdout:9/225: creat d1/d29/d2a/d6/f41 x:0 0 0 2024-04-21T23:47:32.607 INFO:tasks.workunit.client.0.smithi110.stdout:8/243: creat d5/da/f4e x:0 0 0 2024-04-21T23:47:33.216 INFO:tasks.workunit.client.0.smithi110.stdout:2/207: write d9/d1a/f1e [839846,54891] 0 2024-04-21T23:47:33.218 INFO:tasks.workunit.client.0.smithi110.stdout:5/227: write d7/d9/d17/f1c [3035444,107717] 0 2024-04-21T23:47:33.281 INFO:tasks.workunit.client.0.smithi110.stdout:9/226: dread d1/d29/d2a/d6/d1d/f24 [0,4194304] 0 2024-04-21T23:47:33.303 INFO:tasks.workunit.client.0.smithi110.stdout:4/206: dread d1/d11/d12/d26/f30 [0,4194304] 0 2024-04-21T23:47:33.394 INFO:tasks.workunit.client.0.smithi110.stdout:5/228: fdatasync d7/d24/d3a/d40/f41 0 2024-04-21T23:47:33.751 INFO:tasks.workunit.client.0.smithi110.stdout:0/225: rename d0/f34 to d0/d27/f4a 0 2024-04-21T23:47:33.819 INFO:tasks.workunit.client.0.smithi110.stdout:1/200: write d1/dd/d23/f3d [931889,38575] 0 2024-04-21T23:47:33.830 INFO:tasks.workunit.client.0.smithi110.stdout:9/227: rmdir d1/d19 39 2024-04-21T23:47:33.949 INFO:tasks.workunit.client.0.smithi110.stdout:5/229: symlink d7/d22/l42 0 2024-04-21T23:47:34.390 INFO:tasks.workunit.client.0.smithi110.stdout:3/199: mknod d6/c44 0 2024-04-21T23:47:34.399 INFO:tasks.workunit.client.0.smithi110.stdout:0/226: unlink d0/d14/d23/d3b/l47 0 2024-04-21T23:47:34.473 INFO:tasks.workunit.client.0.smithi110.stdout:0/227: dread d0/f13 [0,4194304] 0 2024-04-21T23:47:34.508 INFO:tasks.workunit.client.0.smithi110.stdout:0/228: read d0/fa [1769039,50811] 0 2024-04-21T23:47:34.834 INFO:tasks.workunit.client.0.smithi110.stdout:9/228: fsync d1/d19/f16 0 2024-04-21T23:47:35.032 INFO:tasks.workunit.client.0.smithi110.stdout:2/208: creat d9/d25/d1b/d45/f48 x:0 0 0 2024-04-21T23:47:35.192 INFO:tasks.workunit.client.0.smithi110.stdout:0/229: unlink d0/f13 0 2024-04-21T23:47:35.211 INFO:tasks.workunit.client.0.smithi110.stdout:4/207: dwrite d1/d11/f3d [0,4194304] 0 2024-04-21T23:47:35.426 INFO:tasks.workunit.client.0.smithi110.stdout:9/229: mkdir d1/d19/d42 0 2024-04-21T23:47:35.823 INFO:tasks.workunit.client.0.smithi110.stdout:6/213: rename d16/d1d/f21 to d16/d1e/f3e 0 2024-04-21T23:47:35.838 INFO:tasks.workunit.client.0.smithi110.stdout:0/230: mkdir d0/d27/d4b 0 2024-04-21T23:47:35.880 INFO:tasks.workunit.client.0.smithi110.stdout:9/230: rmdir d1/d29/d2a 39 2024-04-21T23:47:35.897 INFO:tasks.workunit.client.0.smithi110.stdout:8/244: mkdir d5/d4f 0 2024-04-21T23:47:35.982 INFO:tasks.workunit.client.0.smithi110.stdout:0/231: readlink d0/d14/l35 0 2024-04-21T23:47:36.142 INFO:tasks.workunit.client.0.smithi110.stdout:7/223: rename d10/d15/l37 to d10/d2b/d39/l50 0 2024-04-21T23:47:36.264 INFO:tasks.workunit.client.0.smithi110.stdout:2/209: creat d9/f49 x:0 0 0 2024-04-21T23:47:36.355 INFO:tasks.workunit.client.0.smithi110.stdout:2/210: chown d9/d1a 9029351 1 2024-04-21T23:47:36.544 INFO:tasks.workunit.client.0.smithi110.stdout:5/230: rename d7 to d7/d43 22 2024-04-21T23:47:36.609 INFO:tasks.workunit.client.0.smithi110.stdout:4/208: getdents d1 0 2024-04-21T23:47:36.610 INFO:tasks.workunit.client.0.smithi110.stdout:7/224: fdatasync d10/f33 0 2024-04-21T23:47:36.627 INFO:tasks.workunit.client.0.smithi110.stdout:6/214: mknod d16/d1e/c3f 0 2024-04-21T23:47:36.652 INFO:tasks.workunit.client.0.smithi110.stdout:9/231: symlink d1/d29/d2a/dc/l43 0 2024-04-21T23:47:36.784 INFO:tasks.workunit.client.0.smithi110.stdout:8/245: truncate d5/d24/d33/d3d/f46 3087370 0 2024-04-21T23:47:37.050 INFO:tasks.workunit.client.0.smithi110.stdout:1/201: rename d1/d2/d14/d16/f1f to d1/d2/d14/d16/d29/f41 0 2024-04-21T23:47:37.666 INFO:tasks.workunit.client.0.smithi110.stdout:6/215: mkdir d16/d3d/d40 0 2024-04-21T23:47:37.672 INFO:tasks.workunit.client.0.smithi110.stdout:4/209: symlink d1/d11/d12/d26/l45 0 2024-04-21T23:47:37.711 INFO:tasks.workunit.client.0.smithi110.stdout:8/246: symlink d5/d24/d33/d3d/l50 0 2024-04-21T23:47:37.890 INFO:tasks.workunit.client.0.smithi110.stdout:0/232: getdents d0 0 2024-04-21T23:47:38.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/247: sync 2024-04-21T23:47:38.540 INFO:tasks.workunit.client.0.smithi110.stdout:2/211: dwrite d9/fe [0,4194304] 0 2024-04-21T23:47:38.700 INFO:tasks.workunit.client.0.smithi110.stdout:2/212: dread - d9/d37/d3a/f41 zero size 2024-04-21T23:47:38.988 INFO:tasks.workunit.client.0.smithi110.stdout:8/248: dread d5/d24/d33/d3d/f43 [0,4194304] 0 2024-04-21T23:47:39.032 INFO:tasks.workunit.client.0.smithi110.stdout:1/202: truncate d1/d2/d1b/fc 1569813 0 2024-04-21T23:47:39.362 INFO:tasks.workunit.client.0.smithi110.stdout:9/232: symlink d1/d19/l44 0 2024-04-21T23:47:39.791 INFO:tasks.workunit.client.0.smithi110.stdout:4/210: mknod d1/d35/d43/c46 0 2024-04-21T23:47:39.891 INFO:tasks.workunit.client.0.smithi110.stdout:4/211: sync 2024-04-21T23:47:39.943 INFO:tasks.workunit.client.0.smithi110.stdout:3/200: rename d6/d12/d16/f1f to d6/f45 0 2024-04-21T23:47:40.071 INFO:tasks.workunit.client.0.smithi110.stdout:3/201: stat d6/c44 0 2024-04-21T23:47:40.093 INFO:tasks.workunit.client.0.smithi110.stdout:4/212: stat d1/d11/d20/d23/f1f 0 2024-04-21T23:47:40.123 INFO:tasks.workunit.client.0.smithi110.stdout:6/216: dwrite d16/f1c [0,4194304] 0 2024-04-21T23:47:40.123 INFO:tasks.workunit.client.0.smithi110.stdout:8/249: creat d5/d24/f51 x:0 0 0 2024-04-21T23:47:40.567 INFO:tasks.workunit.client.0.smithi110.stdout:0/233: dwrite d0/d14/f32 [0,4194304] 0 2024-04-21T23:47:40.983 INFO:tasks.workunit.client.0.smithi110.stdout:5/231: getdents d7/d9 0 2024-04-21T23:47:41.029 INFO:tasks.workunit.client.0.smithi110.stdout:7/225: rename d10/d15/d22/d2c/d4c to d10/d45/d51 0 2024-04-21T23:47:41.097 INFO:tasks.workunit.client.0.smithi110.stdout:7/226: read - d10/d15/d22/f4b zero size 2024-04-21T23:47:41.558 INFO:tasks.workunit.client.0.smithi110.stdout:4/213: fsync d1/fd 0 2024-04-21T23:47:41.591 INFO:tasks.workunit.client.0.smithi110.stdout:4/214: chown d1/f3 53998 1 2024-04-21T23:47:41.792 INFO:tasks.workunit.client.0.smithi110.stdout:1/203: write d1/d2/d1b/f9 [5110998,113516] 0 2024-04-21T23:47:42.372 INFO:tasks.workunit.client.0.smithi110.stdout:5/232: truncate d7/d9/d17/f1c 3763867 0 2024-04-21T23:47:42.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/213: write d9/d25/f2f [1995718,96192] 0 2024-04-21T23:47:42.951 INFO:tasks.workunit.client.0.smithi110.stdout:8/250: creat d5/d4f/f52 x:0 0 0 2024-04-21T23:47:43.560 INFO:tasks.workunit.client.0.smithi110.stdout:0/234: rename d0/d16/f46 to d0/d16/d42/f4c 0 2024-04-21T23:47:43.564 INFO:tasks.workunit.client.0.smithi110.stdout:6/217: rmdir d16/d1e 39 2024-04-21T23:47:43.608 INFO:tasks.workunit.client.0.smithi110.stdout:0/235: chown d0/d27/f48 1011159 1 2024-04-21T23:47:43.622 INFO:tasks.workunit.client.0.smithi110.stdout:0/236: stat d0/f1e 0 2024-04-21T23:47:43.905 INFO:tasks.workunit.client.0.smithi110.stdout:2/214: mkdir d9/d1a/d1d/d4a 0 2024-04-21T23:47:44.235 INFO:tasks.workunit.client.0.smithi110.stdout:1/204: link d1/d2/d1b/f9 d1/d2/d14/d16/d29/f42 0 2024-04-21T23:47:44.627 INFO:tasks.workunit.client.0.smithi110.stdout:0/237: symlink d0/d25/l4d 0 2024-04-21T23:47:44.633 INFO:tasks.workunit.client.0.smithi110.stdout:4/215: write f0 [2747389,4766] 0 2024-04-21T23:47:44.802 INFO:tasks.workunit.client.0.smithi110.stdout:3/202: link d6/f34 d6/d12/d16/d30/f46 0 2024-04-21T23:47:44.934 INFO:tasks.workunit.client.0.smithi110.stdout:2/215: chown d9/d25/d1c/f3c 3270 1 2024-04-21T23:47:45.021 INFO:tasks.workunit.client.0.smithi110.stdout:8/251: fsync d5/d24/d33/f4d 0 2024-04-21T23:47:45.059 INFO:tasks.workunit.client.0.smithi110.stdout:9/233: write d1/d19/f16 [1752568,33258] 0 2024-04-21T23:47:45.141 INFO:tasks.workunit.client.0.smithi110.stdout:1/205: mkdir d1/dd/d43 0 2024-04-21T23:47:45.690 INFO:tasks.workunit.client.0.smithi110.stdout:7/227: rename d10/d15/f32 to d10/d45/f52 0 2024-04-21T23:47:45.810 INFO:tasks.workunit.client.0.smithi110.stdout:6/218: write f4 [82703,119440] 0 2024-04-21T23:47:46.036 INFO:tasks.workunit.client.0.smithi110.stdout:8/252: rename d5/d24/d33/d3d/l50 to d5/d24/d33/d3d/l53 0 2024-04-21T23:47:46.086 INFO:tasks.workunit.client.0.smithi110.stdout:0/238: creat d0/d2a/f4e x:0 0 0 2024-04-21T23:47:46.119 INFO:tasks.workunit.client.0.smithi110.stdout:1/206: read - d1/d2/f2d zero size 2024-04-21T23:47:46.201 INFO:tasks.workunit.client.0.smithi110.stdout:2/216: dread d9/fe [0,4194304] 0 2024-04-21T23:47:46.225 INFO:tasks.workunit.client.0.smithi110.stdout:0/239: sync 2024-04-21T23:47:46.250 INFO:tasks.workunit.client.0.smithi110.stdout:5/233: dwrite d7/d24/d3a/d40/f41 [0,4194304] 0 2024-04-21T23:47:46.313 INFO:tasks.workunit.client.0.smithi110.stdout:3/203: dread d6/d12/d14/d32/f37 [0,4194304] 0 2024-04-21T23:47:46.444 INFO:tasks.workunit.client.0.smithi110.stdout:4/216: rename d1/d35/d43 to d1/d11/d20/d23/d1c/d47 0 2024-04-21T23:47:46.521 INFO:tasks.workunit.client.0.smithi110.stdout:9/234: mknod d1/c45 0 2024-04-21T23:47:46.622 INFO:tasks.workunit.client.0.smithi110.stdout:6/219: chown cb 38 1 2024-04-21T23:47:46.702 INFO:tasks.workunit.client.0.smithi110.stdout:8/253: readlink d5/d24/d33/d3d/l53 0 2024-04-21T23:47:46.774 INFO:tasks.workunit.client.0.smithi110.stdout:6/220: chown d16/f17 15166222 1 2024-04-21T23:47:46.775 INFO:tasks.workunit.client.0.smithi110.stdout:7/228: dread d10/d27/f29 [0,4194304] 0 2024-04-21T23:47:46.805 INFO:tasks.workunit.client.0.smithi110.stdout:7/229: chown f5 49023 1 2024-04-21T23:47:47.610 INFO:tasks.workunit.client.0.smithi110.stdout:2/217: dread d9/d1a/f1e [0,4194304] 0 2024-04-21T23:47:47.737 INFO:tasks.workunit.client.0.smithi110.stdout:3/204: dread d6/f38 [0,4194304] 0 2024-04-21T23:47:47.942 INFO:tasks.workunit.client.0.smithi110.stdout:4/217: mknod d1/d11/d20/d23/d1c/d47/c48 0 2024-04-21T23:47:48.155 INFO:tasks.workunit.client.0.smithi110.stdout:6/221: dread - d16/d1e/d24/d33/f34 zero size 2024-04-21T23:47:48.241 INFO:tasks.workunit.client.0.smithi110.stdout:6/222: sync 2024-04-21T23:47:48.308 INFO:tasks.workunit.client.0.smithi110.stdout:9/235: symlink d1/d29/l46 0 2024-04-21T23:47:48.751 INFO:tasks.workunit.client.0.smithi110.stdout:4/218: symlink d1/d35/l49 0 2024-04-21T23:47:48.805 INFO:tasks.workunit.client.0.smithi110.stdout:4/219: stat d1 0 2024-04-21T23:47:48.891 INFO:tasks.workunit.client.0.smithi110.stdout:7/230: mkdir d10/d45/d4d/d53 0 2024-04-21T23:47:49.326 INFO:tasks.workunit.client.0.smithi110.stdout:5/234: dwrite d7/d24/f2e [0,4194304] 0 2024-04-21T23:47:49.341 INFO:tasks.workunit.client.0.smithi110.stdout:9/236: unlink d1/d19/l44 0 2024-04-21T23:47:49.382 INFO:tasks.workunit.client.0.smithi110.stdout:0/240: link d0/f3f d0/d27/d4b/f4f 0 2024-04-21T23:47:49.500 INFO:tasks.workunit.client.0.smithi110.stdout:1/207: dwrite d1/d2/d14/d16/d27/f3b [0,4194304] 0 2024-04-21T23:47:49.688 INFO:tasks.workunit.client.0.smithi110.stdout:8/254: creat d5/f54 x:0 0 0 2024-04-21T23:47:49.788 INFO:tasks.workunit.client.0.smithi110.stdout:7/231: fsync f9 0 2024-04-21T23:47:50.365 INFO:tasks.workunit.client.0.smithi110.stdout:3/205: dwrite d6/d12/d14/d32/f37 [4194304,4194304] 0 2024-04-21T23:47:50.382 INFO:tasks.workunit.client.0.smithi110.stdout:4/220: truncate d1/d11/d12/f19 2471918 0 2024-04-21T23:47:50.508 INFO:tasks.workunit.client.0.smithi110.stdout:2/218: link d9/d1a/d1d/d2b/c44 d9/d1a/d1d/d2b/c4b 0 2024-04-21T23:47:50.520 INFO:tasks.workunit.client.0.smithi110.stdout:0/241: fsync d0/d14/f32 0 2024-04-21T23:47:50.601 INFO:tasks.workunit.client.0.smithi110.stdout:5/235: dread d7/d9/f21 [0,4194304] 0 2024-04-21T23:47:50.629 INFO:tasks.workunit.client.0.smithi110.stdout:9/237: symlink d1/d29/d2a/d6/l47 0 2024-04-21T23:47:50.773 INFO:tasks.workunit.client.0.smithi110.stdout:1/208: mknod d1/d2/d14/d16/d29/c44 0 2024-04-21T23:47:50.911 INFO:tasks.workunit.client.0.smithi110.stdout:6/223: creat d16/d1d/f41 x:0 0 0 2024-04-21T23:47:51.026 INFO:tasks.workunit.client.0.smithi110.stdout:7/232: rename d10/d27/f2d to d10/d2b/f54 0 2024-04-21T23:47:51.042 INFO:tasks.workunit.client.0.smithi110.stdout:5/236: rename d7/d35 to d7/d35/d44 22 2024-04-21T23:47:51.068 INFO:tasks.workunit.client.0.smithi110.stdout:7/233: dread - d10/f33 zero size 2024-04-21T23:47:51.163 INFO:tasks.workunit.client.0.smithi110.stdout:8/255: truncate d5/d24/f51 415238 0 2024-04-21T23:47:51.179 INFO:tasks.workunit.client.0.smithi110.stdout:8/256: readlink d5/da/l3a 0 2024-04-21T23:47:51.208 INFO:tasks.workunit.client.0.smithi110.stdout:8/257: readlink d5/d24/d33/d3d/l44 0 2024-04-21T23:47:52.166 INFO:tasks.workunit.client.0.smithi110.stdout:0/242: mkdir d0/d16/d42/d50 0 2024-04-21T23:47:52.359 INFO:tasks.workunit.client.0.smithi110.stdout:2/219: mknod d9/d1a/d1d/d2b/c4c 0 2024-04-21T23:47:52.463 INFO:tasks.workunit.client.0.smithi110.stdout:1/209: symlink d1/d2/d14/d16/d29/l45 0 2024-04-21T23:47:52.582 INFO:tasks.workunit.client.0.smithi110.stdout:6/224: rename d16/d1e/l32 to d16/d1e/d24/d33/l42 0 2024-04-21T23:47:52.779 INFO:tasks.workunit.client.0.smithi110.stdout:5/237: dread d7/d24/f36 [0,4194304] 0 2024-04-21T23:47:52.810 INFO:tasks.workunit.client.0.smithi110.stdout:7/234: symlink d10/d27/l55 0 2024-04-21T23:47:52.897 INFO:tasks.workunit.client.0.smithi110.stdout:8/258: truncate d5/d24/d33/f4d 1845990 0 2024-04-21T23:47:53.180 INFO:tasks.workunit.client.0.smithi110.stdout:8/259: dwrite d5/f54 [0,4194304] 0 2024-04-21T23:47:53.568 INFO:tasks.workunit.client.0.smithi110.stdout:4/221: symlink d1/d11/l4a 0 2024-04-21T23:47:54.192 INFO:tasks.workunit.client.0.smithi110.stdout:2/220: dread d9/d25/f2f [0,4194304] 0 2024-04-21T23:47:54.235 INFO:tasks.workunit.client.0.smithi110.stdout:1/210: fsync d1/d2/f2d 0 2024-04-21T23:47:54.432 INFO:tasks.workunit.client.0.smithi110.stdout:6/225: creat d16/d3d/f43 x:0 0 0 2024-04-21T23:47:54.737 INFO:tasks.workunit.client.0.smithi110.stdout:7/235: truncate fd 4857753 0 2024-04-21T23:47:54.803 INFO:tasks.workunit.client.0.smithi110.stdout:8/260: rmdir d5/d24 39 2024-04-21T23:47:54.884 INFO:tasks.workunit.client.0.smithi110.stdout:7/236: sync 2024-04-21T23:47:55.047 INFO:tasks.workunit.client.0.smithi110.stdout:9/238: creat d1/d19/f48 x:0 0 0 2024-04-21T23:47:55.126 INFO:tasks.workunit.client.0.smithi110.stdout:0/243: creat d0/d16/d42/d50/f51 x:0 0 0 2024-04-21T23:47:55.508 INFO:tasks.workunit.client.0.smithi110.stdout:1/211: unlink d1/d2/d1b/d10/f38 0 2024-04-21T23:47:56.259 INFO:tasks.workunit.client.0.smithi110.stdout:3/206: getdents d6/d12 0 2024-04-21T23:47:56.564 INFO:tasks.workunit.client.0.smithi110.stdout:9/239: dread d1/d29/d2a/d6/f27 [0,4194304] 0 2024-04-21T23:47:56.722 INFO:tasks.workunit.client.0.smithi110.stdout:6/226: rename d16/d1e/f3e to d16/d1e/d24/d33/f44 0 2024-04-21T23:47:57.109 INFO:tasks.workunit.client.0.smithi110.stdout:4/222: creat d1/d11/f4b x:0 0 0 2024-04-21T23:47:57.535 INFO:tasks.workunit.client.0.smithi110.stdout:3/207: mknod d6/d12/d16/c47 0 2024-04-21T23:47:57.538 INFO:tasks.workunit.client.0.smithi110.stdout:2/221: write d9/d1a/f1e [4322695,26496] 0 2024-04-21T23:47:57.758 INFO:tasks.workunit.client.0.smithi110.stdout:1/212: mknod d1/dd/d43/c46 0 2024-04-21T23:47:57.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:47:57.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:47:58.111 INFO:tasks.workunit.client.0.smithi110.stdout:5/238: write d7/d9/d17/f18 [5787252,99525] 0 2024-04-21T23:47:58.118 INFO:tasks.workunit.client.0.smithi110.stdout:8/261: write d5/f6 [13133,128405] 0 2024-04-21T23:47:58.267 INFO:tasks.workunit.client.0.smithi110.stdout:0/244: link d0/f21 d0/d16/d42/f52 0 2024-04-21T23:47:58.301 INFO:tasks.workunit.client.0.smithi110.stdout:8/262: sync 2024-04-21T23:47:58.374 INFO:tasks.workunit.client.0.smithi110.stdout:2/222: unlink f5 0 2024-04-21T23:47:58.710 INFO:tasks.workunit.client.0.smithi110.stdout:1/213: fsync d1/dd/d23/f3d 0 2024-04-21T23:47:59.094 INFO:tasks.workunit.client.0.smithi110.stdout:9/240: symlink d1/d29/l49 0 2024-04-21T23:47:59.331 INFO:tasks.workunit.client.0.smithi110.stdout:6/227: creat d16/d1d/d38/f45 x:0 0 0 2024-04-21T23:47:59.505 INFO:tasks.workunit.client.0.smithi110.stdout:5/239: creat d7/d24/d31/f45 x:0 0 0 2024-04-21T23:47:59.638 INFO:tasks.workunit.client.0.smithi110.stdout:0/245: rename d0/d25/f33 to d0/d16/f53 0 2024-04-21T23:47:59.724 INFO:tasks.workunit.client.0.smithi110.stdout:7/237: dwrite d10/d15/d22/f4b [0,4194304] 0 2024-04-21T23:47:59.900 INFO:tasks.workunit.client.0.smithi110.stdout:3/208: write d6/d12/f2c [354456,90813] 0 2024-04-21T23:47:59.905 INFO:tasks.workunit.client.0.smithi110.stdout:2/223: mkdir d9/d25/d1b/d45/d4d 0 2024-04-21T23:47:59.969 INFO:tasks.workunit.client.0.smithi110.stdout:0/246: chown d0/d27/d4b 1 1 2024-04-21T23:48:00.155 INFO:tasks.workunit.client.0.smithi110.stdout:0/247: chown d0/d14/f32 7 1 2024-04-21T23:48:00.323 INFO:tasks.workunit.client.0.smithi110.stdout:8/263: dread d5/da/d17/f22 [0,4194304] 0 2024-04-21T23:48:00.388 INFO:tasks.workunit.client.0.smithi110.stdout:4/223: link d1/d11/l14 d1/d35/l4c 0 2024-04-21T23:48:00.391 INFO:tasks.workunit.client.0.smithi110.stdout:6/228: unlink c7 0 2024-04-21T23:48:00.587 INFO:tasks.workunit.client.0.smithi110.stdout:6/229: dread d16/d1e/f2a [0,4194304] 0 2024-04-21T23:48:00.694 INFO:tasks.workunit.client.0.smithi110.stdout:1/214: truncate d1/d2/d1b/f9 6925726 0 2024-04-21T23:48:00.793 INFO:tasks.workunit.client.0.smithi110.stdout:4/224: dread d1/f5 [0,4194304] 0 2024-04-21T23:48:00.843 INFO:tasks.workunit.client.0.smithi110.stdout:4/225: chown d1/d11/d20/d23/c1d 5619 1 2024-04-21T23:48:00.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/226: dread - d1/f39 zero size 2024-04-21T23:48:01.176 INFO:tasks.workunit.client.0.smithi110.stdout:9/241: mknod d1/d19/c4a 0 2024-04-21T23:48:01.179 INFO:tasks.workunit.client.0.smithi110.stdout:7/238: write d10/f1d [670325,55867] 0 2024-04-21T23:48:01.208 INFO:tasks.workunit.client.0.smithi110.stdout:2/224: unlink d9/ff 0 2024-04-21T23:48:01.293 INFO:tasks.workunit.client.0.smithi110.stdout:4/227: dwrite d1/d11/f4b [0,4194304] 0 2024-04-21T23:48:01.447 INFO:tasks.workunit.client.0.smithi110.stdout:0/248: creat d0/d27/d4b/f54 x:0 0 0 2024-04-21T23:48:01.448 INFO:tasks.workunit.client.0.smithi110.stdout:1/215: read - d1/f40 zero size 2024-04-21T23:48:01.469 INFO:tasks.workunit.client.0.smithi110.stdout:3/209: link d6/d12/l43 d6/d12/d14/d3f/l48 0 2024-04-21T23:48:01.497 INFO:tasks.workunit.client.0.smithi110.stdout:5/240: link d7/d9/f2a d7/d24/f46 0 2024-04-21T23:48:01.575 INFO:tasks.workunit.client.0.smithi110.stdout:5/241: readlink d7/d9/l1a 0 2024-04-21T23:48:01.721 INFO:tasks.workunit.client.0.smithi110.stdout:6/230: mkdir d16/d3d/d40/d46 0 2024-04-21T23:48:01.733 INFO:tasks.workunit.client.0.smithi110.stdout:1/216: dread d1/d2/f25 [0,4194304] 0 2024-04-21T23:48:01.759 INFO:tasks.workunit.client.0.smithi110.stdout:2/225: rmdir d9/d1a 39 2024-04-21T23:48:01.990 INFO:tasks.workunit.client.0.smithi110.stdout:4/228: symlink d1/l4d 0 2024-04-21T23:48:02.036 INFO:tasks.workunit.client.0.smithi110.stdout:0/249: dread - d0/d2a/f4e zero size 2024-04-21T23:48:02.157 INFO:tasks.workunit.client.0.smithi110.stdout:0/250: dread - d0/f2c zero size 2024-04-21T23:48:02.189 INFO:tasks.workunit.client.0.smithi110.stdout:7/239: dread d10/f34 [0,4194304] 0 2024-04-21T23:48:02.385 INFO:tasks.workunit.client.0.smithi110.stdout:5/242: creat d7/d35/f47 x:0 0 0 2024-04-21T23:48:02.504 INFO:tasks.workunit.client.0.smithi110.stdout:8/264: creat d5/f55 x:0 0 0 2024-04-21T23:48:02.533 INFO:tasks.workunit.client.0.smithi110.stdout:8/265: readlink d5/da/d17/l37 0 2024-04-21T23:48:02.807 INFO:tasks.workunit.client.0.smithi110.stdout:3/210: truncate d6/d12/d14/d32/f37 728142 0 2024-04-21T23:48:03.032 INFO:tasks.workunit.client.0.smithi110.stdout:1/217: unlink d1/dd/f20 0 2024-04-21T23:48:03.319 INFO:tasks.workunit.client.0.smithi110.stdout:5/243: mkdir d7/d9/d17/d48 0 2024-04-21T23:48:03.359 INFO:tasks.workunit.client.0.smithi110.stdout:9/242: creat d1/d19/f4b x:0 0 0 2024-04-21T23:48:03.604 INFO:tasks.workunit.client.0.smithi110.stdout:5/244: dread d7/d24/f36 [0,4194304] 0 2024-04-21T23:48:04.090 INFO:tasks.workunit.client.0.smithi110.stdout:2/226: dread d9/d1a/f1e [0,4194304] 0 2024-04-21T23:48:04.122 INFO:tasks.workunit.client.0.smithi110.stdout:7/240: fsync d10/d15/f1b 0 2024-04-21T23:48:04.352 INFO:tasks.workunit.client.0.smithi110.stdout:1/218: dread d1/f26 [0,4194304] 0 2024-04-21T23:48:04.535 INFO:tasks.workunit.client.0.smithi110.stdout:9/243: unlink d1/d29/d2a/dc/d30/l38 0 2024-04-21T23:48:04.917 INFO:tasks.workunit.client.0.smithi110.stdout:5/245: fdatasync d7/d9/fd 0 2024-04-21T23:48:05.277 INFO:tasks.workunit.client.0.smithi110.stdout:0/251: dwrite d0/d14/d23/f3a [0,4194304] 0 2024-04-21T23:48:05.678 INFO:tasks.workunit.client.0.smithi110.stdout:1/219: read d1/d2/d14/d16/d29/f41 [4046562,124507] 0 2024-04-21T23:48:05.745 INFO:tasks.workunit.client.0.smithi110.stdout:1/220: dread d1/d2/d1b/d10/f21 [0,4194304] 0 2024-04-21T23:48:05.851 INFO:tasks.workunit.client.0.smithi110.stdout:6/231: getdents d16 0 2024-04-21T23:48:05.883 INFO:tasks.workunit.client.0.smithi110.stdout:6/232: chown f9 255022 1 2024-04-21T23:48:05.892 INFO:tasks.workunit.client.0.smithi110.stdout:6/233: readlink d16/l31 0 2024-04-21T23:48:06.733 INFO:tasks.workunit.client.0.smithi110.stdout:8/266: link d5/f54 d5/d24/f56 0 2024-04-21T23:48:06.753 INFO:tasks.workunit.client.0.smithi110.stdout:8/267: chown d5/f1d 37 1 2024-04-21T23:48:07.079 INFO:tasks.workunit.client.0.smithi110.stdout:6/234: chown d16/d1e/d24/f3c 0 1 2024-04-21T23:48:07.322 INFO:tasks.workunit.client.0.smithi110.stdout:8/268: mknod d5/d24/d33/d3d/c57 0 2024-04-21T23:48:07.667 INFO:tasks.workunit.client.0.smithi110.stdout:3/211: write d6/d12/d14/f25 [2389045,13598] 0 2024-04-21T23:48:07.904 INFO:tasks.workunit.client.0.smithi110.stdout:0/252: rmdir d0/d27 39 2024-04-21T23:48:07.992 INFO:tasks.workunit.client.0.smithi110.stdout:3/212: creat d6/d12/d14/d3f/f49 x:0 0 0 2024-04-21T23:48:08.074 INFO:tasks.workunit.client.0.smithi110.stdout:8/269: mknod d5/da/d17/d3b/c58 0 2024-04-21T23:48:08.341 INFO:tasks.workunit.client.0.smithi110.stdout:5/246: write d7/d24/d3a/d40/f41 [2691770,37701] 0 2024-04-21T23:48:08.550 INFO:tasks.workunit.client.0.smithi110.stdout:2/227: write d9/d25/d1c/f28 [9887,61342] 0 2024-04-21T23:48:08.629 INFO:tasks.workunit.client.0.smithi110.stdout:4/229: dwrite d1/d11/d12/f18 [0,4194304] 0 2024-04-21T23:48:09.010 INFO:tasks.workunit.client.0.smithi110.stdout:7/241: dwrite d10/d45/f52 [0,4194304] 0 2024-04-21T23:48:09.198 INFO:tasks.workunit.client.0.smithi110.stdout:5/247: readlink d7/d24/d3a/l3e 0 2024-04-21T23:48:09.214 INFO:tasks.workunit.client.0.smithi110.stdout:5/248: readlink d7/d9/d17/l2b 0 2024-04-21T23:48:09.228 INFO:tasks.workunit.client.0.smithi110.stdout:5/249: stat d7/d35/c3c 0 2024-04-21T23:48:09.457 INFO:tasks.workunit.client.0.smithi110.stdout:9/244: rename d1/l1b to d1/d19/l4c 0 2024-04-21T23:48:10.245 INFO:tasks.workunit.client.0.smithi110.stdout:2/228: fdatasync f1 0 2024-04-21T23:48:10.310 INFO:tasks.workunit.client.0.smithi110.stdout:0/253: dread - d0/d27/f48 zero size 2024-04-21T23:48:10.512 INFO:tasks.workunit.client.0.smithi110.stdout:6/235: rename d16/d1e/l20 to d16/d1e/d24/l47 0 2024-04-21T23:48:10.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/213: write d6/d12/f2f [507945,44299] 0 2024-04-21T23:48:10.700 INFO:tasks.workunit.client.0.smithi110.stdout:8/270: creat d5/f59 x:0 0 0 2024-04-21T23:48:11.051 INFO:tasks.workunit.client.0.smithi110.stdout:8/271: dread d5/d24/f3c [4194304,4194304] 0 2024-04-21T23:48:11.292 INFO:tasks.workunit.client.0.smithi110.stdout:9/245: mkdir d1/d29/d4d 0 2024-04-21T23:48:11.333 INFO:tasks.workunit.client.0.smithi110.stdout:8/272: sync 2024-04-21T23:48:11.350 INFO:tasks.workunit.client.0.smithi110.stdout:8/273: readlink d5/da/l1e 0 2024-04-21T23:48:11.368 INFO:tasks.workunit.client.0.smithi110.stdout:8/274: stat d5/da/l3a 0 2024-04-21T23:48:11.462 INFO:tasks.workunit.client.0.smithi110.stdout:6/236: mkdir d16/d1d/d38/d48 0 2024-04-21T23:48:11.604 INFO:tasks.workunit.client.0.smithi110.stdout:7/242: write d10/f33 [133418,123296] 0 2024-04-21T23:48:11.807 INFO:tasks.workunit.client.0.smithi110.stdout:0/254: truncate d0/f2c 283437 0 2024-04-21T23:48:11.924 INFO:tasks.workunit.client.0.smithi110.stdout:4/230: symlink d1/l4e 0 2024-04-21T23:48:11.998 INFO:tasks.workunit.client.0.smithi110.stdout:5/250: dwrite d7/d9/d17/f2c [0,4194304] 0 2024-04-21T23:48:12.125 INFO:tasks.workunit.client.0.smithi110.stdout:1/221: rename d1/d2/d14/d16/d27/f3b to d1/d2/d30/f47 0 2024-04-21T23:48:12.271 INFO:tasks.workunit.client.0.smithi110.stdout:9/246: symlink d1/d29/d2a/d6/l4e 0 2024-04-21T23:48:12.451 INFO:tasks.workunit.client.0.smithi110.stdout:8/275: read d5/fe [2078237,79560] 0 2024-04-21T23:48:12.827 INFO:tasks.workunit.client.0.smithi110.stdout:2/229: write d9/d1a/f26 [1593452,86422] 0 2024-04-21T23:48:12.935 INFO:tasks.workunit.client.0.smithi110.stdout:3/214: symlink d6/l4a 0 2024-04-21T23:48:13.068 INFO:tasks.workunit.client.0.smithi110.stdout:6/237: rename d16/d3d/l3b to d16/d3d/d40/l49 0 2024-04-21T23:48:13.136 INFO:tasks.workunit.client.0.smithi110.stdout:1/222: mkdir d1/dd/d23/d48 0 2024-04-21T23:48:13.251 INFO:tasks.workunit.client.0.smithi110.stdout:3/215: dread d6/d12/f29 [0,4194304] 0 2024-04-21T23:48:13.314 INFO:tasks.workunit.client.0.smithi110.stdout:3/216: chown d6/d12/f29 212465 1 2024-04-21T23:48:13.364 INFO:tasks.workunit.client.0.smithi110.stdout:8/276: rmdir d5/da/d17/d3b 39 2024-04-21T23:48:13.378 INFO:tasks.workunit.client.0.smithi110.stdout:7/243: symlink d10/d45/d4d/d53/l56 0 2024-04-21T23:48:13.503 INFO:tasks.workunit.client.0.smithi110.stdout:0/255: creat d0/d25/f55 x:0 0 0 2024-04-21T23:48:13.599 INFO:tasks.workunit.client.0.smithi110.stdout:4/231: mkdir d1/d11/d20/d23/d1c/d47/d4f 0 2024-04-21T23:48:13.722 INFO:tasks.workunit.client.0.smithi110.stdout:2/230: mkdir d9/d1a/d1d/d4e 0 2024-04-21T23:48:14.510 INFO:tasks.workunit.client.0.smithi110.stdout:3/217: fdatasync d6/d12/d16/d30/f35 0 2024-04-21T23:48:14.728 INFO:tasks.workunit.client.0.smithi110.stdout:5/251: mkdir d7/d24/d49 0 2024-04-21T23:48:14.744 INFO:tasks.workunit.client.0.smithi110.stdout:7/244: mknod d10/d2b/c57 0 2024-04-21T23:48:15.625 INFO:tasks.workunit.client.0.smithi110.stdout:9/247: dwrite d1/f7 [0,4194304] 0 2024-04-21T23:48:16.152 INFO:tasks.workunit.client.0.smithi110.stdout:3/218: mkdir d6/d12/d14/d4b 0 2024-04-21T23:48:16.172 INFO:tasks.workunit.client.0.smithi110.stdout:8/277: mknod d5/c5a 0 2024-04-21T23:48:16.228 INFO:tasks.workunit.client.0.smithi110.stdout:5/252: creat d7/d24/d31/f4a x:0 0 0 2024-04-21T23:48:16.355 INFO:tasks.workunit.client.0.smithi110.stdout:7/245: mkdir d10/d45/d51/d58 0 2024-04-21T23:48:16.425 INFO:tasks.workunit.client.0.smithi110.stdout:7/246: chown d10/d43 931 1 2024-04-21T23:48:16.450 INFO:tasks.workunit.client.0.smithi110.stdout:5/253: dread d7/f27 [0,4194304] 0 2024-04-21T23:48:16.523 INFO:tasks.workunit.client.0.smithi110.stdout:0/256: fsync d0/d16/d42/d50/f51 0 2024-04-21T23:48:16.548 INFO:tasks.workunit.client.0.smithi110.stdout:2/231: getdents d9/d37/d3a 0 2024-04-21T23:48:16.576 INFO:tasks.workunit.client.0.smithi110.stdout:2/232: readlink d9/lb 0 2024-04-21T23:48:16.586 INFO:tasks.workunit.client.0.smithi110.stdout:0/257: chown d0/d16/c38 17 1 2024-04-21T23:48:16.723 INFO:tasks.workunit.client.0.smithi110.stdout:4/232: mkdir d1/d11/d20/d50 0 2024-04-21T23:48:16.962 INFO:tasks.workunit.client.0.smithi110.stdout:9/248: symlink d1/d29/d2a/d3c/l4f 0 2024-04-21T23:48:16.975 INFO:tasks.workunit.client.0.smithi110.stdout:1/223: rename d1/d1d/l28 to d1/d2/d14/d16/l49 0 2024-04-21T23:48:17.149 INFO:tasks.workunit.client.0.smithi110.stdout:1/224: dread d1/d2/f25 [0,4194304] 0 2024-04-21T23:48:17.392 INFO:tasks.workunit.client.0.smithi110.stdout:3/219: stat d6/d12/d14/d3f/l48 0 2024-04-21T23:48:17.868 INFO:tasks.workunit.client.0.smithi110.stdout:5/254: dread f5 [0,4194304] 0 2024-04-21T23:48:17.959 INFO:tasks.workunit.client.0.smithi110.stdout:2/233: fsync d9/d25/d1b/d45/f48 0 2024-04-21T23:48:18.154 INFO:tasks.workunit.client.0.smithi110.stdout:6/238: link d16/d1d/d38/f45 d16/d1d/f4a 0 2024-04-21T23:48:18.857 INFO:tasks.workunit.client.0.smithi110.stdout:3/220: fdatasync d6/d12/d14/f25 0 2024-04-21T23:48:18.907 INFO:tasks.workunit.client.0.smithi110.stdout:3/221: stat d6/d12/d16/d30/f35 0 2024-04-21T23:48:19.279 INFO:tasks.workunit.client.0.smithi110.stdout:9/249: mknod d1/d29/d4d/c50 0 2024-04-21T23:48:19.470 INFO:tasks.workunit.client.0.smithi110.stdout:6/239: creat d16/d3d/d40/f4b x:0 0 0 2024-04-21T23:48:19.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/240: sync 2024-04-21T23:48:19.743 INFO:tasks.workunit.client.0.smithi110.stdout:8/278: write d5/ff [4002526,13080] 0 2024-04-21T23:48:19.920 INFO:tasks.workunit.client.0.smithi110.stdout:3/222: truncate d6/d12/d16/f39 362463 0 2024-04-21T23:48:20.061 INFO:tasks.workunit.client.0.smithi110.stdout:2/234: creat d9/d1a/d1d/d4a/f4f x:0 0 0 2024-04-21T23:48:20.131 INFO:tasks.workunit.client.0.smithi110.stdout:4/233: getdents d1/d11/d12 0 2024-04-21T23:48:20.236 INFO:tasks.workunit.client.0.smithi110.stdout:8/279: dread d5/f2a [0,4194304] 0 2024-04-21T23:48:20.428 INFO:tasks.workunit.client.0.smithi110.stdout:7/247: dwrite f9 [4194304,4194304] 0 2024-04-21T23:48:20.531 INFO:tasks.workunit.client.0.smithi110.stdout:6/241: chown d16/d3d/d40/l49 1 1 2024-04-21T23:48:20.567 INFO:tasks.workunit.client.0.smithi110.stdout:3/223: rmdir d6/d12/d16/d30 39 2024-04-21T23:48:20.794 INFO:tasks.workunit.client.0.smithi110.stdout:2/235: mkdir d9/d25/d1b/d45/d50 0 2024-04-21T23:48:20.911 INFO:tasks.workunit.client.0.smithi110.stdout:3/224: dread d6/f38 [0,4194304] 0 2024-04-21T23:48:20.959 INFO:tasks.workunit.client.0.smithi110.stdout:1/225: dwrite d1/d2/d14/d16/d29/f41 [0,4194304] 0 2024-04-21T23:48:21.101 INFO:tasks.workunit.client.0.smithi110.stdout:5/255: write d7/d9/d17/f18 [5888809,13329] 0 2024-04-21T23:48:21.155 INFO:tasks.workunit.client.0.smithi110.stdout:8/280: chown d5/d24/f45 1273 1 2024-04-21T23:48:21.233 INFO:tasks.workunit.client.0.smithi110.stdout:9/250: link d1/d29/d2a/c21 d1/d29/d2a/d3c/c51 0 2024-04-21T23:48:21.315 INFO:tasks.workunit.client.0.smithi110.stdout:8/281: sync 2024-04-21T23:48:21.551 INFO:tasks.workunit.client.0.smithi110.stdout:3/225: rmdir d6/d12/d14 39 2024-04-21T23:48:21.577 INFO:tasks.workunit.client.0.smithi110.stdout:2/236: rename d9/d1a/d1d/d2b/l32 to d9/d25/d1b/d45/d4d/l51 0 2024-04-21T23:48:21.817 INFO:tasks.workunit.client.0.smithi110.stdout:0/258: mkdir d0/d56 0 2024-04-21T23:48:21.820 INFO:tasks.workunit.client.0.smithi110.stdout:7/248: symlink d10/d43/d47/l59 0 2024-04-21T23:48:21.975 INFO:tasks.workunit.client.0.smithi110.stdout:6/242: fdatasync f12 0 2024-04-21T23:48:22.508 INFO:tasks.workunit.client.0.smithi110.stdout:5/256: mknod d7/d24/d37/d38/c4b 0 2024-04-21T23:48:22.527 INFO:tasks.workunit.client.0.smithi110.stdout:4/234: dwrite d1/f5 [0,4194304] 0 2024-04-21T23:48:22.663 INFO:tasks.workunit.client.0.smithi110.stdout:3/226: fdatasync f3 0 2024-04-21T23:48:23.079 INFO:tasks.workunit.client.0.smithi110.stdout:2/237: chown d9/d1a/d1d/d2b/c44 6870 1 2024-04-21T23:48:23.381 INFO:tasks.workunit.client.0.smithi110.stdout:0/259: fsync d0/d27/f48 0 2024-04-21T23:48:23.497 INFO:tasks.workunit.client.0.smithi110.stdout:7/249: dread d10/d27/f29 [0,4194304] 0 2024-04-21T23:48:23.557 INFO:tasks.workunit.client.0.smithi110.stdout:6/243: unlink d16/d1e/c2e 0 2024-04-21T23:48:23.856 INFO:tasks.workunit.client.0.smithi110.stdout:2/238: rmdir d9/d1a/d1d 39 2024-04-21T23:48:23.895 INFO:tasks.workunit.client.0.smithi110.stdout:8/282: dwrite d5/d24/f2f [0,4194304] 0 2024-04-21T23:48:24.167 INFO:tasks.workunit.client.0.smithi110.stdout:7/250: creat d10/d15/d22/f5a x:0 0 0 2024-04-21T23:48:24.350 INFO:tasks.workunit.client.0.smithi110.stdout:1/226: getdents d1/d2/d14 0 2024-04-21T23:48:24.628 INFO:tasks.workunit.client.0.smithi110.stdout:9/251: truncate d1/f7 5991328 0 2024-04-21T23:48:24.812 INFO:tasks.workunit.client.0.smithi110.stdout:8/283: fsync d5/da/f4e 0 2024-04-21T23:48:24.928 INFO:tasks.workunit.client.0.smithi110.stdout:5/257: dwrite d7/f27 [4194304,4194304] 0 2024-04-21T23:48:25.003 INFO:tasks.workunit.client.0.smithi110.stdout:2/239: truncate d9/d1a/f1e 3404802 0 2024-04-21T23:48:25.075 INFO:tasks.workunit.client.0.smithi110.stdout:0/260: creat d0/d2a/f57 x:0 0 0 2024-04-21T23:48:25.094 INFO:tasks.workunit.client.0.smithi110.stdout:5/258: read d7/d9/f33 [2643938,20512] 0 2024-04-21T23:48:25.127 INFO:tasks.workunit.client.0.smithi110.stdout:7/251: creat d10/d2b/d39/f5b x:0 0 0 2024-04-21T23:48:25.778 INFO:tasks.workunit.client.0.smithi110.stdout:8/284: truncate d5/d24/f14 518861 0 2024-04-21T23:48:26.157 INFO:tasks.workunit.client.0.smithi110.stdout:7/252: dread d10/f1d [0,4194304] 0 2024-04-21T23:48:26.407 INFO:tasks.workunit.client.0.smithi110.stdout:4/235: link d1/d11/d20/c29 d1/d11/c51 0 2024-04-21T23:48:26.761 INFO:tasks.workunit.client.0.smithi110.stdout:6/244: creat d16/d1d/f4c x:0 0 0 2024-04-21T23:48:26.767 INFO:tasks.workunit.client.0.smithi110.stdout:3/227: dwrite d6/d12/d14/d3f/f49 [0,4194304] 0 2024-04-21T23:48:26.904 INFO:tasks.workunit.client.0.smithi110.stdout:9/252: mkdir d1/d52 0 2024-04-21T23:48:26.942 INFO:tasks.workunit.client.0.smithi110.stdout:6/245: sync 2024-04-21T23:48:27.382 INFO:tasks.workunit.client.0.smithi110.stdout:1/227: rename d1/dd/d43 to d1/d1d/d4a 0 2024-04-21T23:48:27.417 INFO:tasks.workunit.client.0.smithi110.stdout:8/285: dread d5/ff [0,4194304] 0 2024-04-21T23:48:27.574 INFO:tasks.workunit.client.0.smithi110.stdout:4/236: mkdir d1/d11/d12/d26/d52 0 2024-04-21T23:48:27.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:48:27.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:48:28.244 INFO:tasks.workunit.client.0.smithi110.stdout:9/253: unlink d1/d29/d2a/d3c/l4f 0 2024-04-21T23:48:28.258 INFO:tasks.workunit.client.0.smithi110.stdout:9/254: chown d1 1876379 1 2024-04-21T23:48:28.272 INFO:tasks.workunit.client.0.smithi110.stdout:9/255: readlink d1/d29/l46 0 2024-04-21T23:48:28.387 INFO:tasks.workunit.client.0.smithi110.stdout:6/246: creat d16/f4d x:0 0 0 2024-04-21T23:48:28.747 INFO:tasks.workunit.client.0.smithi110.stdout:2/240: write d9/d25/f33 [4465449,107362] 0 2024-04-21T23:48:28.884 INFO:tasks.workunit.client.0.smithi110.stdout:0/261: write d0/f3f [770710,83642] 0 2024-04-21T23:48:29.034 INFO:tasks.workunit.client.0.smithi110.stdout:8/286: mknod d5/d4f/c5b 0 2024-04-21T23:48:30.378 INFO:tasks.workunit.client.0.smithi110.stdout:8/287: dread d5/f6 [0,4194304] 0 2024-04-21T23:48:31.217 INFO:tasks.workunit.client.0.smithi110.stdout:4/237: dread d1/d35/f33 [0,4194304] 0 2024-04-21T23:48:31.217 INFO:tasks.workunit.client.0.smithi110.stdout:8/288: mkdir d5/d24/d33/d3d/d5c 0 2024-04-21T23:48:31.296 INFO:tasks.workunit.client.0.smithi110.stdout:7/253: dwrite d10/d15/f3e [0,4194304] 0 2024-04-21T23:48:31.565 INFO:tasks.workunit.client.0.smithi110.stdout:5/259: rename d7/d9/f2a to d7/d35/f4c 0 2024-04-21T23:48:31.576 INFO:tasks.workunit.client.0.smithi110.stdout:3/228: write d6/f2d [82928,13939] 0 2024-04-21T23:48:31.684 INFO:tasks.workunit.client.0.smithi110.stdout:4/238: dread d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:48:31.722 INFO:tasks.workunit.client.0.smithi110.stdout:1/228: getdents d1/d2 0 2024-04-21T23:48:31.736 INFO:tasks.workunit.client.0.smithi110.stdout:2/241: link d9/d25/d1b/f3d d9/d25/d1b/d45/d4d/f52 0 2024-04-21T23:48:31.786 INFO:tasks.workunit.client.0.smithi110.stdout:6/247: truncate d16/f17 1525874 0 2024-04-21T23:48:32.052 INFO:tasks.workunit.client.0.smithi110.stdout:7/254: dread d10/d15/f1b [4194304,4194304] 0 2024-04-21T23:48:32.083 INFO:tasks.workunit.client.0.smithi110.stdout:7/255: chown d10/d2b/d39/l3a 1107 1 2024-04-21T23:48:32.146 INFO:tasks.workunit.client.0.smithi110.stdout:0/262: rename d0/d16/d42/d50/f51 to d0/d16/f58 0 2024-04-21T23:48:32.178 INFO:tasks.workunit.client.0.smithi110.stdout:5/260: creat d7/d24/d37/d38/f4d x:0 0 0 2024-04-21T23:48:32.729 INFO:tasks.workunit.client.0.smithi110.stdout:7/256: rename d10/d27/l40 to d10/d15/d22/l5c 0 2024-04-21T23:48:32.927 INFO:tasks.workunit.client.0.smithi110.stdout:9/256: dwrite d1/d19/f13 [0,4194304] 0 2024-04-21T23:48:33.318 INFO:tasks.workunit.client.0.smithi110.stdout:9/257: dread d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-21T23:48:33.343 INFO:tasks.workunit.client.0.smithi110.stdout:5/261: truncate d7/d24/f36 3183052 0 2024-04-21T23:48:33.839 INFO:tasks.workunit.client.0.smithi110.stdout:1/229: mknod d1/dd/d23/d48/c4b 0 2024-04-21T23:48:33.933 INFO:tasks.workunit.client.0.smithi110.stdout:8/289: creat d5/da/d17/f5d x:0 0 0 2024-04-21T23:48:33.971 INFO:tasks.workunit.client.0.smithi110.stdout:3/229: write d6/d12/d14/d32/f33 [327086,90563] 0 2024-04-21T23:48:34.093 INFO:tasks.workunit.client.0.smithi110.stdout:2/242: write d9/d25/d1b/f3b [189964,94639] 0 2024-04-21T23:48:34.153 INFO:tasks.workunit.client.0.smithi110.stdout:7/257: read d10/d15/f2e [7510809,54506] 0 2024-04-21T23:48:34.575 INFO:tasks.workunit.client.0.smithi110.stdout:4/239: creat d1/d11/d20/f53 x:0 0 0 2024-04-21T23:48:34.949 INFO:tasks.workunit.client.0.smithi110.stdout:9/258: unlink d1/d29/f2c 0 2024-04-21T23:48:35.314 INFO:tasks.workunit.client.0.smithi110.stdout:3/230: dread - d6/f3a zero size 2024-04-21T23:48:35.384 INFO:tasks.workunit.client.0.smithi110.stdout:2/243: chown d9 128 1 2024-04-21T23:48:35.622 INFO:tasks.workunit.client.0.smithi110.stdout:7/258: creat d10/d15/d22/d2c/f5d x:0 0 0 2024-04-21T23:48:35.640 INFO:tasks.workunit.client.0.smithi110.stdout:7/259: chown d10/d43 215 1 2024-04-21T23:48:35.963 INFO:tasks.workunit.client.0.smithi110.stdout:5/262: fdatasync d7/d35/f4c 0 2024-04-21T23:48:36.094 INFO:tasks.workunit.client.0.smithi110.stdout:9/259: readlink d1/d19/l1c 0 2024-04-21T23:48:36.584 INFO:tasks.workunit.client.0.smithi110.stdout:3/231: mknod d6/d12/d14/c4c 0 2024-04-21T23:48:36.598 INFO:tasks.workunit.client.0.smithi110.stdout:8/290: symlink d5/l5e 0 2024-04-21T23:48:36.781 INFO:tasks.workunit.client.0.smithi110.stdout:6/248: getdents d16/d3d/d40 0 2024-04-21T23:48:36.840 INFO:tasks.workunit.client.0.smithi110.stdout:0/263: getdents d0/d2a 0 2024-04-21T23:48:36.933 INFO:tasks.workunit.client.0.smithi110.stdout:7/260: mkdir d10/d43/d47/d5e 0 2024-04-21T23:48:37.109 INFO:tasks.workunit.client.0.smithi110.stdout:4/240: rename d1/l4d to d1/d11/d12/l54 0 2024-04-21T23:48:37.579 INFO:tasks.workunit.client.0.smithi110.stdout:8/291: creat d5/d4f/f5f x:0 0 0 2024-04-21T23:48:37.694 INFO:tasks.workunit.client.0.smithi110.stdout:2/244: mknod d9/c53 0 2024-04-21T23:48:37.794 INFO:tasks.workunit.client.0.smithi110.stdout:3/232: chown d6/d12/d16/c47 2 1 2024-04-21T23:48:37.811 INFO:tasks.workunit.client.0.smithi110.stdout:9/260: dread d1/d19/f16 [4194304,4194304] 0 2024-04-21T23:48:38.118 INFO:tasks.workunit.client.0.smithi110.stdout:0/264: unlink d0/f3f 0 2024-04-21T23:48:38.195 INFO:tasks.workunit.client.0.smithi110.stdout:1/230: dwrite d1/d2/d14/d16/f31 [0,4194304] 0 2024-04-21T23:48:38.671 INFO:tasks.workunit.client.0.smithi110.stdout:6/249: creat d16/d1e/d24/f4e x:0 0 0 2024-04-21T23:48:38.961 INFO:tasks.workunit.client.0.smithi110.stdout:9/261: creat d1/d29/d2a/d3c/f53 x:0 0 0 2024-04-21T23:48:39.528 INFO:tasks.workunit.client.0.smithi110.stdout:2/245: mkdir d9/d1a/d1d/d2b/d54 0 2024-04-21T23:48:39.633 INFO:tasks.workunit.client.0.smithi110.stdout:6/250: fdatasync f4 0 2024-04-21T23:48:39.990 INFO:tasks.workunit.client.0.smithi110.stdout:5/263: dwrite d7/d35/f47 [0,4194304] 0 2024-04-21T23:48:40.340 INFO:tasks.workunit.client.0.smithi110.stdout:9/262: dread d1/f7 [0,4194304] 0 2024-04-21T23:48:40.379 INFO:tasks.workunit.client.0.smithi110.stdout:7/261: creat d10/f5f x:0 0 0 2024-04-21T23:48:40.438 INFO:tasks.workunit.client.0.smithi110.stdout:7/262: dread d10/f1d [0,4194304] 0 2024-04-21T23:48:40.823 INFO:tasks.workunit.client.0.smithi110.stdout:2/246: fdatasync d9/f49 0 2024-04-21T23:48:40.848 INFO:tasks.workunit.client.0.smithi110.stdout:8/292: write d5/da/f35 [119157,43667] 0 2024-04-21T23:48:40.897 INFO:tasks.workunit.client.0.smithi110.stdout:8/293: readlink d5/l34 0 2024-04-21T23:48:41.000 INFO:tasks.workunit.client.0.smithi110.stdout:6/251: chown d16/l29 3 1 2024-04-21T23:48:41.574 INFO:tasks.workunit.client.0.smithi110.stdout:4/241: write d1/fc [4089944,1074] 0 2024-04-21T23:48:41.864 INFO:tasks.workunit.client.0.smithi110.stdout:3/233: write d6/d12/d14/d3f/f42 [1916691,52859] 0 2024-04-21T23:48:42.070 INFO:tasks.workunit.client.0.smithi110.stdout:7/263: rename d10/d43/d47 to d10/d45/d60 0 2024-04-21T23:48:42.800 INFO:tasks.workunit.client.0.smithi110.stdout:6/252: fdatasync d16/d1e/d24/f2c 0 2024-04-21T23:48:42.863 INFO:tasks.workunit.client.0.smithi110.stdout:1/231: write d1/d2/d30/f47 [1629412,128611] 0 2024-04-21T23:48:42.914 INFO:tasks.workunit.client.0.smithi110.stdout:4/242: read - d1/f39 zero size 2024-04-21T23:48:42.953 INFO:tasks.workunit.client.0.smithi110.stdout:5/264: truncate d7/d24/f36 3038540 0 2024-04-21T23:48:42.959 INFO:tasks.workunit.client.0.smithi110.stdout:1/232: stat d1/dd/d23/d48/c4b 0 2024-04-21T23:48:42.980 INFO:tasks.workunit.client.0.smithi110.stdout:0/265: link d0/d16/c1f d0/c59 0 2024-04-21T23:48:43.012 INFO:tasks.workunit.client.0.smithi110.stdout:5/265: rename d7/d22 to d7/d22/d4e 22 2024-04-21T23:48:43.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/263: mknod d1/d19/c54 0 2024-04-21T23:48:43.309 INFO:tasks.workunit.client.0.smithi110.stdout:0/266: sync 2024-04-21T23:48:43.438 INFO:tasks.workunit.client.0.smithi110.stdout:9/264: dwrite d1/d29/d2a/d3c/f53 [0,4194304] 0 2024-04-21T23:48:43.675 INFO:tasks.workunit.client.0.smithi110.stdout:9/265: dread d1/d29/d2a/d6/fe [0,4194304] 0 2024-04-21T23:48:44.012 INFO:tasks.workunit.client.0.smithi110.stdout:4/243: fdatasync d1/d11/d20/d23/f1f 0 2024-04-21T23:48:44.018 INFO:tasks.workunit.client.0.smithi110.stdout:1/233: symlink d1/d2/d14/l4c 0 2024-04-21T23:48:44.053 INFO:tasks.workunit.client.0.smithi110.stdout:6/253: dread d16/d1e/f36 [0,4194304] 0 2024-04-21T23:48:44.155 INFO:tasks.workunit.client.0.smithi110.stdout:5/266: write d7/f27 [5471765,119788] 0 2024-04-21T23:48:44.185 INFO:tasks.workunit.client.0.smithi110.stdout:5/267: stat d7/d35/c3c 0 2024-04-21T23:48:44.469 INFO:tasks.workunit.client.0.smithi110.stdout:0/267: mkdir d0/d25/d5a 0 2024-04-21T23:48:44.804 INFO:tasks.workunit.client.0.smithi110.stdout:2/247: dwrite d9/fe [4194304,4194304] 0 2024-04-21T23:48:45.582 INFO:tasks.workunit.client.0.smithi110.stdout:3/234: fdatasync d6/d12/d16/d30/f46 0 2024-04-21T23:48:45.764 INFO:tasks.workunit.client.0.smithi110.stdout:8/294: getdents d5/da 0 2024-04-21T23:48:46.281 INFO:tasks.workunit.client.0.smithi110.stdout:6/254: truncate d16/d1d/f2f 357329 0 2024-04-21T23:48:46.327 INFO:tasks.workunit.client.0.smithi110.stdout:7/264: write fd [1182194,6102] 0 2024-04-21T23:48:46.614 INFO:tasks.workunit.client.0.smithi110.stdout:3/235: dread d6/d12/f29 [0,4194304] 0 2024-04-21T23:48:46.954 INFO:tasks.workunit.client.0.smithi110.stdout:9/266: creat d1/d19/d42/f55 x:0 0 0 2024-04-21T23:48:47.174 INFO:tasks.workunit.client.0.smithi110.stdout:6/255: chown d16/l27 817911244 1 2024-04-21T23:48:47.236 INFO:tasks.workunit.client.0.smithi110.stdout:7/265: fdatasync d10/d15/d22/f5a 0 2024-04-21T23:48:47.312 INFO:tasks.workunit.client.0.smithi110.stdout:7/266: fdatasync fd 0 2024-04-21T23:48:47.402 INFO:tasks.workunit.client.0.smithi110.stdout:1/234: dwrite d1/ff [0,4194304] 0 2024-04-21T23:48:47.556 INFO:tasks.workunit.client.0.smithi110.stdout:8/295: mkdir d5/da/d17/d60 0 2024-04-21T23:48:47.671 INFO:tasks.workunit.client.0.smithi110.stdout:0/268: mknod d0/d27/d4b/c5b 0 2024-04-21T23:48:47.879 INFO:tasks.workunit.client.0.smithi110.stdout:9/267: rmdir d1/d29 39 2024-04-21T23:48:47.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/244: dwrite d1/d11/d20/d23/ff [0,4194304] 0 2024-04-21T23:48:48.125 INFO:tasks.workunit.client.0.smithi110.stdout:2/248: write d9/d25/d1b/f3b [983849,79088] 0 2024-04-21T23:48:48.260 INFO:tasks.workunit.client.0.smithi110.stdout:5/268: dwrite d7/d9/d17/f18 [4194304,4194304] 0 2024-04-21T23:48:48.262 INFO:tasks.workunit.client.0.smithi110.stdout:7/267: symlink d10/d2b/d39/l61 0 2024-04-21T23:48:48.387 INFO:tasks.workunit.client.0.smithi110.stdout:7/268: stat f5 0 2024-04-21T23:48:48.464 INFO:tasks.workunit.client.0.smithi110.stdout:5/269: dread - d7/d9/f3d zero size 2024-04-21T23:48:48.498 INFO:tasks.workunit.client.0.smithi110.stdout:5/270: stat d7/d9/d17/f18 0 2024-04-21T23:48:48.600 INFO:tasks.workunit.client.0.smithi110.stdout:0/269: mknod d0/d16/c5c 0 2024-04-21T23:48:48.909 INFO:tasks.workunit.client.0.smithi110.stdout:4/245: fdatasync f0 0 2024-04-21T23:48:49.399 INFO:tasks.workunit.client.0.smithi110.stdout:0/270: mkdir d0/d16/d5d 0 2024-04-21T23:48:49.631 INFO:tasks.workunit.client.0.smithi110.stdout:2/249: mkdir d9/d25/d1b/d45/d50/d55 0 2024-04-21T23:48:49.827 INFO:tasks.workunit.client.0.smithi110.stdout:4/246: truncate d1/d11/d20/f2c 3624770 0 2024-04-21T23:48:50.148 INFO:tasks.workunit.client.0.smithi110.stdout:3/236: link d6/d12/l43 d6/d12/d16/d30/l4d 0 2024-04-21T23:48:50.402 INFO:tasks.workunit.client.0.smithi110.stdout:6/256: dwrite d16/d1e/d24/d33/f34 [0,4194304] 0 2024-04-21T23:48:50.557 INFO:tasks.workunit.client.0.smithi110.stdout:2/250: creat d9/d1a/d1d/d2b/f56 x:0 0 0 2024-04-21T23:48:50.609 INFO:tasks.workunit.client.0.smithi110.stdout:4/247: rename d1/d11/d20/d23/c25 to d1/d11/d20/d23/d3c/c55 0 2024-04-21T23:48:51.159 INFO:tasks.workunit.client.0.smithi110.stdout:3/237: rename f3 to d6/d12/d14/d32/f4e 0 2024-04-21T23:48:51.369 INFO:tasks.workunit.client.0.smithi110.stdout:8/296: dwrite d5/f2a [0,4194304] 0 2024-04-21T23:48:51.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/271: link d7/d9/c34 d7/c4f 0 2024-04-21T23:48:51.452 INFO:tasks.workunit.client.0.smithi110.stdout:2/251: dread - d9/d1a/d1d/f36 zero size 2024-04-21T23:48:51.537 INFO:tasks.workunit.client.0.smithi110.stdout:0/271: dread d0/d16/d42/f4c [0,4194304] 0 2024-04-21T23:48:52.150 INFO:tasks.workunit.client.0.smithi110.stdout:1/235: dwrite d1/f40 [0,4194304] 0 2024-04-21T23:48:52.191 INFO:tasks.workunit.client.0.smithi110.stdout:2/252: read - d9/d25/d1b/d45/f48 zero size 2024-04-21T23:48:52.374 INFO:tasks.workunit.client.0.smithi110.stdout:7/269: dwrite d10/d15/f1b [8388608,4194304] 0 2024-04-21T23:48:52.387 INFO:tasks.workunit.client.0.smithi110.stdout:9/268: dwrite d1/d19/f4b [0,4194304] 0 2024-04-21T23:48:52.643 INFO:tasks.workunit.client.0.smithi110.stdout:6/257: write ff [4117994,46120] 0 2024-04-21T23:48:52.693 INFO:tasks.workunit.client.0.smithi110.stdout:3/238: read - d6/d12/f1a zero size 2024-04-21T23:48:52.774 INFO:tasks.workunit.client.0.smithi110.stdout:0/272: stat d0/d14/d23/f24 0 2024-04-21T23:48:52.775 INFO:tasks.workunit.client.0.smithi110.stdout:5/272: symlink d7/d9/d25/l50 0 2024-04-21T23:48:52.880 INFO:tasks.workunit.client.0.smithi110.stdout:8/297: mknod d5/da/d17/d3b/c61 0 2024-04-21T23:48:52.910 INFO:tasks.workunit.client.0.smithi110.stdout:0/273: chown d0 1427164746 1 2024-04-21T23:48:53.439 INFO:tasks.workunit.client.0.smithi110.stdout:1/236: dread d1/dd/d23/f24 [0,4194304] 0 2024-04-21T23:48:53.447 INFO:tasks.workunit.client.0.smithi110.stdout:4/248: dwrite d1/d11/d12/d26/f3b [0,4194304] 0 2024-04-21T23:48:53.460 INFO:tasks.workunit.client.0.smithi110.stdout:9/269: dread d1/f7 [0,4194304] 0 2024-04-21T23:48:53.789 INFO:tasks.workunit.client.0.smithi110.stdout:2/253: dwrite d9/d1a/f26 [0,4194304] 0 2024-04-21T23:48:54.139 INFO:tasks.workunit.client.0.smithi110.stdout:3/239: truncate d6/d12/d14/f31 327802 0 2024-04-21T23:48:54.185 INFO:tasks.workunit.client.0.smithi110.stdout:5/273: getdents d7/d24/d49 0 2024-04-21T23:48:54.451 INFO:tasks.workunit.client.0.smithi110.stdout:1/237: rename d1/d2/d1b/d10/f21 to d1/d2/d1b/d10/f4d 0 2024-04-21T23:48:54.860 INFO:tasks.workunit.client.0.smithi110.stdout:8/298: write d5/f55 [925972,63169] 0 2024-04-21T23:48:54.871 INFO:tasks.workunit.client.0.smithi110.stdout:6/258: write d16/f1c [1276500,5849] 0 2024-04-21T23:48:54.991 INFO:tasks.workunit.client.0.smithi110.stdout:2/254: write d9/f10 [2710576,24068] 0 2024-04-21T23:48:55.019 INFO:tasks.workunit.client.0.smithi110.stdout:4/249: mkdir d1/d11/d20/d23/d1c/d47/d4f/d56 0 2024-04-21T23:48:55.196 INFO:tasks.workunit.client.0.smithi110.stdout:9/270: creat d1/d29/d2a/d6/f56 x:0 0 0 2024-04-21T23:48:55.220 INFO:tasks.workunit.client.0.smithi110.stdout:3/240: dread - d6/f3a zero size 2024-04-21T23:48:55.411 INFO:tasks.workunit.client.0.smithi110.stdout:5/274: write d7/d24/f2e [2542579,5643] 0 2024-04-21T23:48:55.447 INFO:tasks.workunit.client.0.smithi110.stdout:0/274: dwrite d0/d27/f4a [0,4194304] 0 2024-04-21T23:48:55.557 INFO:tasks.workunit.client.0.smithi110.stdout:9/271: dread - d1/d29/d2a/d6/f56 zero size 2024-04-21T23:48:55.645 INFO:tasks.workunit.client.0.smithi110.stdout:7/270: link d10/d15/d22/c28 d10/d45/d51/c62 0 2024-04-21T23:48:55.751 INFO:tasks.workunit.client.0.smithi110.stdout:2/255: stat d9/d1a/f1e 0 2024-04-21T23:48:55.792 INFO:tasks.workunit.client.0.smithi110.stdout:2/256: dread - d9/d25/d1b/d45/f48 zero size 2024-04-21T23:48:55.923 INFO:tasks.workunit.client.0.smithi110.stdout:9/272: sync 2024-04-21T23:48:56.027 INFO:tasks.workunit.client.0.smithi110.stdout:3/241: symlink d6/l4f 0 2024-04-21T23:48:56.101 INFO:tasks.workunit.client.0.smithi110.stdout:5/275: fsync d7/d24/f36 0 2024-04-21T23:48:56.117 INFO:tasks.workunit.client.0.smithi110.stdout:2/257: mkdir d9/d1a/d1d/d57 0 2024-04-21T23:48:56.158 INFO:tasks.workunit.client.0.smithi110.stdout:8/299: rename d5/d4f/c5b to d5/c62 0 2024-04-21T23:48:56.222 INFO:tasks.workunit.client.0.smithi110.stdout:7/271: chown d10/d15/l20 117775 1 2024-04-21T23:48:56.247 INFO:tasks.workunit.client.0.smithi110.stdout:1/238: getdents d1/dd/d23/d48 0 2024-04-21T23:48:56.314 INFO:tasks.workunit.client.0.smithi110.stdout:1/239: sync 2024-04-21T23:48:56.332 INFO:tasks.workunit.client.0.smithi110.stdout:0/275: dread - d0/d27/d4b/f54 zero size 2024-04-21T23:48:56.556 INFO:tasks.workunit.client.0.smithi110.stdout:9/273: mkdir d1/d29/d2a/d2b/d57 0 2024-04-21T23:48:56.574 INFO:tasks.workunit.client.0.smithi110.stdout:3/242: read f1 [2893123,11002] 0 2024-04-21T23:48:56.607 INFO:tasks.workunit.client.0.smithi110.stdout:2/258: chown d9/d1a/f26 54621097 1 2024-04-21T23:48:56.691 INFO:tasks.workunit.client.0.smithi110.stdout:6/259: dwrite d16/d3d/f2d [0,4194304] 0 2024-04-21T23:48:56.869 INFO:tasks.workunit.client.0.smithi110.stdout:4/250: dwrite d1/fd [0,4194304] 0 2024-04-21T23:48:56.991 INFO:tasks.workunit.client.0.smithi110.stdout:7/272: unlink d10/f33 0 2024-04-21T23:48:57.144 INFO:tasks.workunit.client.0.smithi110.stdout:1/240: mkdir d1/dd/d23/d48/d4e 0 2024-04-21T23:48:57.286 INFO:tasks.workunit.client.0.smithi110.stdout:8/300: fsync d5/d24/f14 0 2024-04-21T23:48:57.419 INFO:tasks.workunit.client.0.smithi110.stdout:7/273: truncate d10/f19 3501086 0 2024-04-21T23:48:57.638 INFO:tasks.workunit.client.0.smithi110.stdout:3/243: mkdir d6/d12/d50 0 2024-04-21T23:48:57.683 INFO:tasks.workunit.client.0.smithi110.stdout:1/241: mknod d1/d1d/d4a/c4f 0 2024-04-21T23:48:57.802 INFO:tasks.workunit.client.0.smithi110.stdout:6/260: rename d16/f4d to d16/d1d/d38/f4f 0 2024-04-21T23:48:57.834 INFO:tasks.workunit.client.0.smithi110.stdout:9/274: getdents d1/d29/d2a/d6/d1d 0 2024-04-21T23:48:57.877 INFO:tasks.workunit.client.0.smithi110.stdout:8/301: creat d5/da/f63 x:0 0 0 2024-04-21T23:48:57.988 INFO:tasks.workunit.client.0.smithi110.stdout:7/274: fdatasync d10/d27/f29 0 2024-04-21T23:48:58.024 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:48:58.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:48:58.099 INFO:tasks.workunit.client.0.smithi110.stdout:4/251: dread d1/f8 [0,4194304] 0 2024-04-21T23:48:58.338 INFO:tasks.workunit.client.0.smithi110.stdout:3/244: stat d6/d12/d14/c2b 0 2024-04-21T23:48:58.415 INFO:tasks.workunit.client.0.smithi110.stdout:0/276: dwrite d0/d25/f55 [0,4194304] 0 2024-04-21T23:48:58.584 INFO:tasks.workunit.client.0.smithi110.stdout:2/259: dwrite d9/d25/d1b/f3b [0,4194304] 0 2024-04-21T23:48:58.599 INFO:tasks.workunit.client.0.smithi110.stdout:5/276: dwrite d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:48:58.871 INFO:tasks.workunit.client.0.smithi110.stdout:4/252: rmdir d1/d11 39 2024-04-21T23:48:58.892 INFO:tasks.workunit.client.0.smithi110.stdout:9/275: mkdir d1/d29/d2a/d2b/d58 0 2024-04-21T23:48:58.994 INFO:tasks.workunit.client.0.smithi110.stdout:7/275: symlink d10/d27/l63 0 2024-04-21T23:48:59.019 INFO:tasks.workunit.client.0.smithi110.stdout:2/260: chown d9/d25/d1c 22913925 1 2024-04-21T23:48:59.109 INFO:tasks.workunit.client.0.smithi110.stdout:1/242: dread d1/d2/d1b/d10/f4d [0,4194304] 0 2024-04-21T23:48:59.153 INFO:tasks.workunit.client.0.smithi110.stdout:5/277: dread - d7/d9/f3d zero size 2024-04-21T23:48:59.545 INFO:tasks.workunit.client.0.smithi110.stdout:6/261: dread fe [0,4194304] 0 2024-04-21T23:48:59.788 INFO:tasks.workunit.client.0.smithi110.stdout:3/245: fsync d6/d12/d14/d32/f37 0 2024-04-21T23:48:59.819 INFO:tasks.workunit.client.0.smithi110.stdout:8/302: dread d5/d24/f3c [0,4194304] 0 2024-04-21T23:49:00.107 INFO:tasks.workunit.client.0.smithi110.stdout:5/278: dread d7/d35/f4c [0,4194304] 0 2024-04-21T23:49:00.706 INFO:tasks.workunit.client.0.smithi110.stdout:1/243: creat d1/d2/d14/d16/f50 x:0 0 0 2024-04-21T23:49:00.741 INFO:tasks.workunit.client.0.smithi110.stdout:0/277: rename d0/f11 to d0/d16/d5d/f5e 0 2024-04-21T23:49:00.772 INFO:tasks.workunit.client.0.smithi110.stdout:4/253: rename d1/d11/d20 to d1/d11/d20/d23/d1c/d47/d4f/d57 22 2024-04-21T23:49:00.840 INFO:tasks.workunit.client.0.smithi110.stdout:4/254: chown d1/d11/d12/l17 31530977 1 2024-04-21T23:49:01.045 INFO:tasks.workunit.client.0.smithi110.stdout:3/246: unlink d6/d12/d14/c2b 0 2024-04-21T23:49:01.070 INFO:tasks.workunit.client.0.smithi110.stdout:9/276: dwrite d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-21T23:49:01.711 INFO:tasks.workunit.client.0.smithi110.stdout:2/261: dwrite d9/d25/d1c/f28 [0,4194304] 0 2024-04-21T23:49:01.920 INFO:tasks.workunit.client.0.smithi110.stdout:0/278: readlink d0/ld 0 2024-04-21T23:49:01.997 INFO:tasks.workunit.client.0.smithi110.stdout:5/279: rename d7/d24/d31/f4a to d7/d9/d17/f51 0 2024-04-21T23:49:02.144 INFO:tasks.workunit.client.0.smithi110.stdout:6/262: symlink d16/d1e/d24/l50 0 2024-04-21T23:49:02.237 INFO:tasks.workunit.client.0.smithi110.stdout:2/262: dread d9/d1a/f21 [0,4194304] 0 2024-04-21T23:49:02.359 INFO:tasks.workunit.client.0.smithi110.stdout:3/247: creat d6/d12/d16/d30/f51 x:0 0 0 2024-04-21T23:49:02.453 INFO:tasks.workunit.client.0.smithi110.stdout:9/277: dread - d1/d29/d2a/d6/f41 zero size 2024-04-21T23:49:02.526 INFO:tasks.workunit.client.0.smithi110.stdout:8/303: dwrite d5/f31 [0,4194304] 0 2024-04-21T23:49:02.825 INFO:tasks.workunit.client.0.smithi110.stdout:0/279: creat d0/d14/f5f x:0 0 0 2024-04-21T23:49:02.856 INFO:tasks.workunit.client.0.smithi110.stdout:0/280: chown d0/d27/f48 12 1 2024-04-21T23:49:03.201 INFO:tasks.workunit.client.0.smithi110.stdout:0/281: dwrite d0/d25/f55 [4194304,4194304] 0 2024-04-21T23:49:03.356 INFO:tasks.workunit.client.0.smithi110.stdout:4/255: write d1/d11/d20/f53 [90839,104278] 0 2024-04-21T23:49:03.429 INFO:tasks.workunit.client.0.smithi110.stdout:7/276: write d10/f19 [2474277,17512] 0 2024-04-21T23:49:03.840 INFO:tasks.workunit.client.0.smithi110.stdout:1/244: dwrite d1/f39 [0,4194304] 0 2024-04-21T23:49:03.994 INFO:tasks.workunit.client.0.smithi110.stdout:2/263: dread d9/fe [4194304,4194304] 0 2024-04-21T23:49:04.182 INFO:tasks.workunit.client.0.smithi110.stdout:8/304: dread - d5/da/d17/f5d zero size 2024-04-21T23:49:04.235 INFO:tasks.workunit.client.0.smithi110.stdout:1/245: write d1/d2/d14/d16/f50 [1013195,43487] 0 2024-04-21T23:49:04.291 INFO:tasks.workunit.client.0.smithi110.stdout:2/264: sync 2024-04-21T23:49:04.334 INFO:tasks.workunit.client.0.smithi110.stdout:5/280: dwrite d7/d24/d37/d38/f4d [0,4194304] 0 2024-04-21T23:49:04.502 INFO:tasks.workunit.client.0.smithi110.stdout:6/263: symlink d16/d1d/d38/l51 0 2024-04-21T23:49:04.593 INFO:tasks.workunit.client.0.smithi110.stdout:2/265: dread - d9/d1a/d1d/f36 zero size 2024-04-21T23:49:04.603 INFO:tasks.workunit.client.0.smithi110.stdout:5/281: read d7/d35/f4c [3866680,10010] 0 2024-04-21T23:49:04.836 INFO:tasks.workunit.client.0.smithi110.stdout:8/305: dread d5/d24/f3c [4194304,4194304] 0 2024-04-21T23:49:04.915 INFO:tasks.workunit.client.0.smithi110.stdout:6/264: dread fe [0,4194304] 0 2024-04-21T23:49:04.955 INFO:tasks.workunit.client.0.smithi110.stdout:7/277: dread d10/d15/f3e [0,4194304] 0 2024-04-21T23:49:04.987 INFO:tasks.workunit.client.0.smithi110.stdout:9/278: mkdir d1/d29/d59 0 2024-04-21T23:49:05.015 INFO:tasks.workunit.client.0.smithi110.stdout:6/265: sync 2024-04-21T23:49:05.120 INFO:tasks.workunit.client.0.smithi110.stdout:9/279: dread d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-21T23:49:05.169 INFO:tasks.workunit.client.0.smithi110.stdout:9/280: write d1/d29/d2a/d6/fe [4627334,30941] 0 2024-04-21T23:49:05.296 INFO:tasks.workunit.client.0.smithi110.stdout:0/282: mknod d0/d56/c60 0 2024-04-21T23:49:05.709 INFO:tasks.workunit.client.0.smithi110.stdout:5/282: symlink d7/d24/d37/l52 0 2024-04-21T23:49:06.428 INFO:tasks.workunit.client.0.smithi110.stdout:0/283: creat d0/d16/d42/f61 x:0 0 0 2024-04-21T23:49:06.500 INFO:tasks.workunit.client.0.smithi110.stdout:4/256: dwrite d1/fc [0,4194304] 0 2024-04-21T23:49:06.714 INFO:tasks.workunit.client.0.smithi110.stdout:6/266: symlink d16/d1d/l52 0 2024-04-21T23:49:06.776 INFO:tasks.workunit.client.0.smithi110.stdout:3/248: link d6/d12/d16/l22 d6/d12/d16/l52 0 2024-04-21T23:49:06.811 INFO:tasks.workunit.client.0.smithi110.stdout:9/281: getdents d1/d29/d2a/d2b/d57 0 2024-04-21T23:49:06.858 INFO:tasks.workunit.client.0.smithi110.stdout:5/283: dread f5 [0,4194304] 0 2024-04-21T23:49:06.981 INFO:tasks.workunit.client.0.smithi110.stdout:7/278: dread d10/d15/d22/f4b [0,4194304] 0 2024-04-21T23:49:07.043 INFO:tasks.workunit.client.0.smithi110.stdout:1/246: creat d1/d1d/f51 x:0 0 0 2024-04-21T23:49:07.260 INFO:tasks.workunit.client.0.smithi110.stdout:0/284: mknod d0/d16/d5d/c62 0 2024-04-21T23:49:07.354 INFO:tasks.workunit.client.0.smithi110.stdout:9/282: fdatasync d1/d29/d2a/d6/f56 0 2024-04-21T23:49:07.438 INFO:tasks.workunit.client.0.smithi110.stdout:5/284: chown d7/d24/d37/d38/f4d 54447 1 2024-04-21T23:49:07.440 INFO:tasks.workunit.client.0.smithi110.stdout:6/267: chown d16/d1e/d24/d33/l42 19663 1 2024-04-21T23:49:07.522 INFO:tasks.workunit.client.0.smithi110.stdout:2/266: dwrite f1 [0,4194304] 0 2024-04-21T23:49:07.748 INFO:tasks.workunit.client.0.smithi110.stdout:0/285: chown d0/d2a/f4e 1 1 2024-04-21T23:49:07.822 INFO:tasks.workunit.client.0.smithi110.stdout:8/306: dwrite d5/f38 [0,4194304] 0 2024-04-21T23:49:07.846 INFO:tasks.workunit.client.0.smithi110.stdout:4/257: mkdir d1/d11/d20/d58 0 2024-04-21T23:49:07.863 INFO:tasks.workunit.client.0.smithi110.stdout:1/247: mkdir d1/d52 0 2024-04-21T23:49:07.975 INFO:tasks.workunit.client.0.smithi110.stdout:7/279: mknod d10/d45/d4d/d53/c64 0 2024-04-21T23:49:07.985 INFO:tasks.workunit.client.0.smithi110.stdout:6/268: dread - d16/d1e/d24/f3c zero size 2024-04-21T23:49:08.206 INFO:tasks.workunit.client.0.smithi110.stdout:5/285: creat d7/d24/f53 x:0 0 0 2024-04-21T23:49:08.261 INFO:tasks.workunit.client.0.smithi110.stdout:1/248: dread - d1/d2/d1b/d10/f2c zero size 2024-04-21T23:49:08.422 INFO:tasks.workunit.client.0.smithi110.stdout:3/249: dwrite d6/f19 [4194304,4194304] 0 2024-04-21T23:49:08.769 INFO:tasks.workunit.client.0.smithi110.stdout:6/269: unlink f6 0 2024-04-21T23:49:08.776 INFO:tasks.workunit.client.0.smithi110.stdout:2/267: rmdir d9/d1a/d1d/d4a 39 2024-04-21T23:49:08.903 INFO:tasks.workunit.client.0.smithi110.stdout:8/307: chown d5/d24/d33/d3d/f46 0 1 2024-04-21T23:49:08.942 INFO:tasks.workunit.client.0.smithi110.stdout:5/286: mkdir d7/d24/d3a/d54 0 2024-04-21T23:49:08.945 INFO:tasks.workunit.client.0.smithi110.stdout:1/249: rmdir d1/d2/d1b 39 2024-04-21T23:49:08.995 INFO:tasks.workunit.client.0.smithi110.stdout:8/308: chown d5/d24/d33/d3d 228503314 1 2024-04-21T23:49:09.300 INFO:tasks.workunit.client.0.smithi110.stdout:0/286: mkdir d0/d25/d5a/d63 0 2024-04-21T23:49:09.372 INFO:tasks.workunit.client.0.smithi110.stdout:9/283: dwrite d1/d29/d2a/d6/fe [0,4194304] 0 2024-04-21T23:49:09.651 INFO:tasks.workunit.client.0.smithi110.stdout:7/280: write d10/d15/f1b [8303173,64409] 0 2024-04-21T23:49:10.125 INFO:tasks.workunit.client.0.smithi110.stdout:8/309: creat d5/d24/d33/d3d/f64 x:0 0 0 2024-04-21T23:49:10.151 INFO:tasks.workunit.client.0.smithi110.stdout:3/250: fsync d6/d12/d14/d32/f4e 0 2024-04-21T23:49:10.307 INFO:tasks.workunit.client.0.smithi110.stdout:2/268: dread d9/d25/f33 [0,4194304] 0 2024-04-21T23:49:10.450 INFO:tasks.workunit.client.0.smithi110.stdout:4/258: dwrite d1/d11/d20/d23/f1f [0,4194304] 0 2024-04-21T23:49:10.589 INFO:tasks.workunit.client.0.smithi110.stdout:9/284: dread d1/d29/d2a/dc/f1f [0,4194304] 0 2024-04-21T23:49:11.319 INFO:tasks.workunit.client.0.smithi110.stdout:3/251: creat d6/d12/d14/f53 x:0 0 0 2024-04-21T23:49:11.481 INFO:tasks.workunit.client.0.smithi110.stdout:3/252: stat d6/d12/d14/c15 0 2024-04-21T23:49:11.487 INFO:tasks.workunit.client.0.smithi110.stdout:5/287: dwrite d7/d9/f21 [0,4194304] 0 2024-04-21T23:49:11.683 INFO:tasks.workunit.client.0.smithi110.stdout:5/288: readlink d7/d9/d17/l2b 0 2024-04-21T23:49:11.720 INFO:tasks.workunit.client.0.smithi110.stdout:7/281: mkdir d10/d45/d60/d5e/d65 0 2024-04-21T23:49:11.870 INFO:tasks.workunit.client.0.smithi110.stdout:1/250: rename d1/d2/d1b/c37 to d1/dd/d23/d48/d4e/c53 0 2024-04-21T23:49:12.075 INFO:tasks.workunit.client.0.smithi110.stdout:3/253: dread d6/d12/d16/f23 [0,4194304] 0 2024-04-21T23:49:12.278 INFO:tasks.workunit.client.0.smithi110.stdout:8/310: symlink d5/l65 0 2024-04-21T23:49:12.310 INFO:tasks.workunit.client.0.smithi110.stdout:0/287: creat d0/d27/d4b/f64 x:0 0 0 2024-04-21T23:49:12.350 INFO:tasks.workunit.client.0.smithi110.stdout:9/285: fsync d1/f15 0 2024-04-21T23:49:12.380 INFO:tasks.workunit.client.0.smithi110.stdout:2/269: truncate d9/d1a/d1d/d4a/f4f 323034 0 2024-04-21T23:49:12.553 INFO:tasks.workunit.client.0.smithi110.stdout:5/289: mknod d7/d24/d3a/c55 0 2024-04-21T23:49:12.588 INFO:tasks.workunit.client.0.smithi110.stdout:6/270: dwrite d16/d3d/d40/f4b [0,4194304] 0 2024-04-21T23:49:12.701 INFO:tasks.workunit.client.0.smithi110.stdout:7/282: mknod d10/d2b/c66 0 2024-04-21T23:49:13.015 INFO:tasks.workunit.client.0.smithi110.stdout:6/271: chown d16/d1e/d24/d33/l42 0 1 2024-04-21T23:49:13.073 INFO:tasks.workunit.client.0.smithi110.stdout:1/251: creat d1/dd/d23/f54 x:0 0 0 2024-04-21T23:49:13.100 INFO:tasks.workunit.client.0.smithi110.stdout:9/286: dread d1/d29/d2a/d6/f27 [0,4194304] 0 2024-04-21T23:49:13.388 INFO:tasks.workunit.client.0.smithi110.stdout:4/259: dwrite d1/d11/d20/f2c [0,4194304] 0 2024-04-21T23:49:13.560 INFO:tasks.workunit.client.0.smithi110.stdout:8/311: unlink d5/d24/c4a 0 2024-04-21T23:49:14.290 INFO:tasks.workunit.client.0.smithi110.stdout:5/290: dread d7/d24/f2e [0,4194304] 0 2024-04-21T23:49:14.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/254: write f0 [3283312,55209] 0 2024-04-21T23:49:14.679 INFO:tasks.workunit.client.0.smithi110.stdout:9/287: symlink d1/d29/d4d/l5a 0 2024-04-21T23:49:14.712 INFO:tasks.workunit.client.0.smithi110.stdout:9/288: chown d1/d29/d2a/d2b/d58 1 1 2024-04-21T23:49:14.723 INFO:tasks.workunit.client.0.smithi110.stdout:9/289: readlink d1/l17 0 2024-04-21T23:49:14.951 INFO:tasks.workunit.client.0.smithi110.stdout:2/270: write d9/f49 [34279,125488] 0 2024-04-21T23:49:15.194 INFO:tasks.workunit.client.0.smithi110.stdout:8/312: creat d5/d24/d33/d3d/f66 x:0 0 0 2024-04-21T23:49:15.360 INFO:tasks.workunit.client.0.smithi110.stdout:2/271: dwrite d9/f49 [0,4194304] 0 2024-04-21T23:49:15.559 INFO:tasks.workunit.client.0.smithi110.stdout:7/283: mknod d10/d45/d60/d5e/d65/c67 0 2024-04-21T23:49:15.677 INFO:tasks.workunit.client.0.smithi110.stdout:5/291: creat d7/d24/f56 x:0 0 0 2024-04-21T23:49:15.841 INFO:tasks.workunit.client.0.smithi110.stdout:1/252: symlink d1/d2/d30/l55 0 2024-04-21T23:49:15.910 INFO:tasks.workunit.client.0.smithi110.stdout:6/272: truncate d16/d1d/f4a 525085 0 2024-04-21T23:49:16.158 INFO:tasks.workunit.client.0.smithi110.stdout:4/260: fsync d1/fe 0 2024-04-21T23:49:16.657 INFO:tasks.workunit.client.0.smithi110.stdout:4/261: sync 2024-04-21T23:49:16.689 INFO:tasks.workunit.client.0.smithi110.stdout:2/272: symlink d9/d37/d3a/l58 0 2024-04-21T23:49:16.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/284: symlink d10/d45/d4d/l68 0 2024-04-21T23:49:17.030 INFO:tasks.workunit.client.0.smithi110.stdout:1/253: mknod d1/dd/c56 0 2024-04-21T23:49:17.648 INFO:tasks.workunit.client.0.smithi110.stdout:8/313: write d5/d24/f3c [8023064,42718] 0 2024-04-21T23:49:17.905 INFO:tasks.workunit.client.0.smithi110.stdout:0/288: getdents d0/d14/d23/d3b 0 2024-04-21T23:49:18.148 INFO:tasks.workunit.client.0.smithi110.stdout:0/289: sync 2024-04-21T23:49:18.258 INFO:tasks.workunit.client.0.smithi110.stdout:9/290: write d1/d29/d2a/dc/fd [5028473,111383] 0 2024-04-21T23:49:18.432 INFO:tasks.workunit.client.0.smithi110.stdout:6/273: symlink d16/d1e/l53 0 2024-04-21T23:49:18.458 INFO:tasks.workunit.client.0.smithi110.stdout:5/292: dwrite d7/d24/d37/d38/f4d [4194304,4194304] 0 2024-04-21T23:49:18.649 INFO:tasks.workunit.client.0.smithi110.stdout:5/293: read f5 [3398539,126955] 0 2024-04-21T23:49:18.719 INFO:tasks.workunit.client.0.smithi110.stdout:3/255: dwrite d6/d12/f2f [0,4194304] 0 2024-04-21T23:49:19.216 INFO:tasks.workunit.client.0.smithi110.stdout:0/290: fsync d0/d14/f5f 0 2024-04-21T23:49:19.518 INFO:tasks.workunit.client.0.smithi110.stdout:8/314: symlink d5/da/d17/d60/l67 0 2024-04-21T23:49:19.723 INFO:tasks.workunit.client.0.smithi110.stdout:1/254: unlink d1/d2/d14/d16/f31 0 2024-04-21T23:49:19.919 INFO:tasks.workunit.client.0.smithi110.stdout:6/274: read d16/f1b [2132734,104772] 0 2024-04-21T23:49:20.053 INFO:tasks.workunit.client.0.smithi110.stdout:9/291: dread d1/d29/d2a/f26 [0,4194304] 0 2024-04-21T23:49:20.191 INFO:tasks.workunit.client.0.smithi110.stdout:3/256: truncate d6/d12/d14/d3f/f49 611255 0 2024-04-21T23:49:20.208 INFO:tasks.workunit.client.0.smithi110.stdout:2/273: rename d9/d1a/d1d/d2b/c4c to d9/d25/c59 0 2024-04-21T23:49:20.489 INFO:tasks.workunit.client.0.smithi110.stdout:0/291: read d0/d25/f55 [6038521,5397] 0 2024-04-21T23:49:20.724 INFO:tasks.workunit.client.0.smithi110.stdout:8/315: symlink d5/da/l68 0 2024-04-21T23:49:20.935 INFO:tasks.workunit.client.0.smithi110.stdout:9/292: unlink d1/d29/d2a/f26 0 2024-04-21T23:49:21.290 INFO:tasks.workunit.client.0.smithi110.stdout:2/274: chown d9/d25/d1b/d45/d4d/l51 59980007 1 2024-04-21T23:49:21.356 INFO:tasks.workunit.client.0.smithi110.stdout:7/285: getdents d10/d45/d4d/d53 0 2024-04-21T23:49:21.575 INFO:tasks.workunit.client.0.smithi110.stdout:5/294: write d7/d35/f47 [2827877,39505] 0 2024-04-21T23:49:21.610 INFO:tasks.workunit.client.0.smithi110.stdout:5/295: stat d7/d9/d17/d48 0 2024-04-21T23:49:21.752 INFO:tasks.workunit.client.0.smithi110.stdout:9/293: symlink d1/d29/d2a/d3c/l5b 0 2024-04-21T23:49:22.270 INFO:tasks.workunit.client.0.smithi110.stdout:3/257: symlink d6/d12/d14/d4b/l54 0 2024-04-21T23:49:22.562 INFO:tasks.workunit.client.0.smithi110.stdout:4/262: mknod d1/d11/d20/c59 0 2024-04-21T23:49:22.864 INFO:tasks.workunit.client.0.smithi110.stdout:6/275: write d16/d1e/f2a [1052103,81641] 0 2024-04-21T23:49:22.972 INFO:tasks.workunit.client.0.smithi110.stdout:1/255: rename d1/d52 to d1/d1d/d57 0 2024-04-21T23:49:23.064 INFO:tasks.workunit.client.0.smithi110.stdout:3/258: mknod d6/d12/d14/d32/c55 0 2024-04-21T23:49:23.264 INFO:tasks.workunit.client.0.smithi110.stdout:7/286: mkdir d10/d2b/d46/d69 0 2024-04-21T23:49:23.443 INFO:tasks.workunit.client.0.smithi110.stdout:8/316: link d5/d24/f45 d5/da/d17/d3b/f69 0 2024-04-21T23:49:23.448 INFO:tasks.workunit.client.0.smithi110.stdout:4/263: dread - d1/d11/d12/d26/f3f zero size 2024-04-21T23:49:23.739 INFO:tasks.workunit.client.0.smithi110.stdout:0/292: dwrite d0/d14/f1c [0,4194304] 0 2024-04-21T23:49:23.862 INFO:tasks.workunit.client.0.smithi110.stdout:9/294: creat d1/d29/d2a/d2b/d57/f5c x:0 0 0 2024-04-21T23:49:24.035 INFO:tasks.workunit.client.0.smithi110.stdout:1/256: dread - d1/d2/d1b/f35 zero size 2024-04-21T23:49:24.632 INFO:tasks.workunit.client.0.smithi110.stdout:4/264: dread d1/d11/d20/f34 [0,4194304] 0 2024-04-21T23:49:25.139 INFO:tasks.workunit.client.0.smithi110.stdout:2/275: dwrite d9/d25/d1b/d45/d4d/f52 [8388608,4194304] 0 2024-04-21T23:49:25.591 INFO:tasks.workunit.client.0.smithi110.stdout:8/317: mkdir d5/d24/d33/d3d/d5c/d6a 0 2024-04-21T23:49:25.637 INFO:tasks.workunit.client.0.smithi110.stdout:5/296: getdents d7/d9 0 2024-04-21T23:49:25.669 INFO:tasks.workunit.client.0.smithi110.stdout:5/297: chown l3 14730046 1 2024-04-21T23:49:25.726 INFO:tasks.workunit.client.0.smithi110.stdout:5/298: write d7/d35/f47 [2135836,50407] 0 2024-04-21T23:49:25.949 INFO:tasks.workunit.client.0.smithi110.stdout:6/276: rename d16/d1e/f36 to d16/f54 0 2024-04-21T23:49:26.060 INFO:tasks.workunit.client.0.smithi110.stdout:0/293: truncate d0/d16/d42/f52 416604 0 2024-04-21T23:49:26.218 INFO:tasks.workunit.client.0.smithi110.stdout:2/276: truncate d9/d1a/f1e 2084186 0 2024-04-21T23:49:26.511 INFO:tasks.workunit.client.0.smithi110.stdout:4/265: creat d1/d11/d20/d23/d1c/d40/f5a x:0 0 0 2024-04-21T23:49:26.711 INFO:tasks.workunit.client.0.smithi110.stdout:9/295: creat d1/f5d x:0 0 0 2024-04-21T23:49:26.755 INFO:tasks.workunit.client.0.smithi110.stdout:3/259: write d6/d12/d14/f31 [22513,104001] 0 2024-04-21T23:49:26.847 INFO:tasks.workunit.client.0.smithi110.stdout:5/299: unlink d7/d9/d17/l30 0 2024-04-21T23:49:26.864 INFO:tasks.workunit.client.0.smithi110.stdout:5/300: chown d7/c26 62 1 2024-04-21T23:49:26.972 INFO:tasks.workunit.client.0.smithi110.stdout:9/296: sync 2024-04-21T23:49:26.978 INFO:tasks.workunit.client.0.smithi110.stdout:7/287: rename d10/d27/l55 to d10/d15/d22/l6a 0 2024-04-21T23:49:26.988 INFO:tasks.workunit.client.0.smithi110.stdout:1/257: write d1/f40 [4851482,38001] 0 2024-04-21T23:49:27.094 INFO:tasks.workunit.client.0.smithi110.stdout:6/277: dread - d16/d1d/d38/f4f zero size 2024-04-21T23:49:27.207 INFO:tasks.workunit.client.0.smithi110.stdout:0/294: unlink d0/d16/f43 0 2024-04-21T23:49:27.516 INFO:tasks.workunit.client.0.smithi110.stdout:4/266: fdatasync d1/d11/d12/d26/f2d 0 2024-04-21T23:49:27.520 INFO:tasks.workunit.client.0.smithi110.stdout:2/277: fdatasync d9/fe 0 2024-04-21T23:49:27.686 INFO:tasks.workunit.client.0.smithi110.stdout:5/301: creat d7/d24/d3a/d40/f57 x:0 0 0 2024-04-21T23:49:27.815 INFO:tasks.workunit.client.0.smithi110.stdout:7/288: rmdir d10/d15/d22/d2c 39 2024-04-21T23:49:27.833 INFO:tasks.workunit.client.0.smithi110.stdout:7/289: chown d10/c1e 1574 1 2024-04-21T23:49:27.915 INFO:tasks.workunit.client.0.smithi110.stdout:9/297: creat d1/d29/d2a/d6/d1d/f5e x:0 0 0 2024-04-21T23:49:28.145 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:49:28.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:49:28.164 INFO:tasks.workunit.client.0.smithi110.stdout:1/258: truncate d1/d1d/f51 1033761 0 2024-04-21T23:49:28.336 INFO:tasks.workunit.client.0.smithi110.stdout:6/278: dread d16/d3d/f2d [0,4194304] 0 2024-04-21T23:49:28.524 INFO:tasks.workunit.client.0.smithi110.stdout:8/318: write d5/f6 [1080305,124507] 0 2024-04-21T23:49:28.576 INFO:tasks.workunit.client.0.smithi110.stdout:8/319: chown d5/d24/c11 75456 1 2024-04-21T23:49:28.656 INFO:tasks.workunit.client.0.smithi110.stdout:5/302: rmdir d7/d35 39 2024-04-21T23:49:28.993 INFO:tasks.workunit.client.0.smithi110.stdout:9/298: mkdir d1/d19/d42/d5f 0 2024-04-21T23:49:29.327 INFO:tasks.workunit.client.0.smithi110.stdout:9/299: dwrite d1/d29/d2a/d2b/d57/f5c [0,4194304] 0 2024-04-21T23:49:29.662 INFO:tasks.workunit.client.0.smithi110.stdout:6/279: dread d16/f17 [0,4194304] 0 2024-04-21T23:49:29.760 INFO:tasks.workunit.client.0.smithi110.stdout:8/320: symlink d5/d24/d33/d3d/d5c/l6b 0 2024-04-21T23:49:29.761 INFO:tasks.workunit.client.0.smithi110.stdout:4/267: getdents d1/d11/d12/d26/d52 0 2024-04-21T23:49:29.796 INFO:tasks.workunit.client.0.smithi110.stdout:8/321: chown d5/d24/d33 914842528 1 2024-04-21T23:49:29.858 INFO:tasks.workunit.client.0.smithi110.stdout:6/280: sync 2024-04-21T23:49:30.001 INFO:tasks.workunit.client.0.smithi110.stdout:3/260: write d6/d12/d16/d30/f51 [394789,24306] 0 2024-04-21T23:49:30.686 INFO:tasks.workunit.client.0.smithi110.stdout:0/295: write d0/d25/f55 [6815626,77539] 0 2024-04-21T23:49:30.818 INFO:tasks.workunit.client.0.smithi110.stdout:7/290: creat d10/d15/d22/f6b x:0 0 0 2024-04-21T23:49:30.973 INFO:tasks.workunit.client.0.smithi110.stdout:0/296: stat d0/d16/d42/f4c 0 2024-04-21T23:49:31.067 INFO:tasks.workunit.client.0.smithi110.stdout:9/300: dread d1/d29/d2a/d3c/f53 [0,4194304] 0 2024-04-21T23:49:31.300 INFO:tasks.workunit.client.0.smithi110.stdout:2/278: link d9/d25/d1c/l2a d9/d25/d1b/d45/d50/l5a 0 2024-04-21T23:49:31.356 INFO:tasks.workunit.client.0.smithi110.stdout:2/279: stat d9/l12 0 2024-04-21T23:49:31.489 INFO:tasks.workunit.client.0.smithi110.stdout:1/259: write d1/f26 [1165823,105456] 0 2024-04-21T23:49:31.562 INFO:tasks.workunit.client.0.smithi110.stdout:6/281: dread f15 [0,4194304] 0 2024-04-21T23:49:31.571 INFO:tasks.workunit.client.0.smithi110.stdout:5/303: creat d7/f58 x:0 0 0 2024-04-21T23:49:31.672 INFO:tasks.workunit.client.0.smithi110.stdout:2/280: read d9/fa [1941856,54842] 0 2024-04-21T23:49:31.748 INFO:tasks.workunit.client.0.smithi110.stdout:2/281: chown d9/d25/d1b/c2c 66636489 1 2024-04-21T23:49:32.042 INFO:tasks.workunit.client.0.smithi110.stdout:3/261: symlink d6/d12/d3c/l56 0 2024-04-21T23:49:32.073 INFO:tasks.workunit.client.0.smithi110.stdout:4/268: rename d1/l4e to d1/l5b 0 2024-04-21T23:49:32.486 INFO:tasks.workunit.client.0.smithi110.stdout:6/282: creat d16/d1e/d24/d33/f55 x:0 0 0 2024-04-21T23:49:32.571 INFO:tasks.workunit.client.0.smithi110.stdout:7/291: dread d10/d45/f52 [0,4194304] 0 2024-04-21T23:49:32.580 INFO:tasks.workunit.client.0.smithi110.stdout:2/282: rmdir d9/d25/d1c 39 2024-04-21T23:49:32.631 INFO:tasks.workunit.client.0.smithi110.stdout:3/262: dread f1 [0,4194304] 0 2024-04-21T23:49:32.654 INFO:tasks.workunit.client.0.smithi110.stdout:2/283: stat d9/c14 0 2024-04-21T23:49:32.812 INFO:tasks.workunit.client.0.smithi110.stdout:8/322: getdents d5/d24/d33/d3d/d5c 0 2024-04-21T23:49:33.391 INFO:tasks.workunit.client.0.smithi110.stdout:7/292: unlink d10/d15/f3e 0 2024-04-21T23:49:33.423 INFO:tasks.workunit.client.0.smithi110.stdout:9/301: write d1/d29/d2a/d6/f56 [14773,3019] 0 2024-04-21T23:49:33.768 INFO:tasks.workunit.client.0.smithi110.stdout:2/284: fdatasync d9/d25/d1b/d45/f48 0 2024-04-21T23:49:34.141 INFO:tasks.workunit.client.0.smithi110.stdout:6/283: creat d16/d3d/d40/d46/f56 x:0 0 0 2024-04-21T23:49:34.560 INFO:tasks.workunit.client.0.smithi110.stdout:5/304: write d7/d9/fd [3521931,88464] 0 2024-04-21T23:49:34.568 INFO:tasks.workunit.client.0.smithi110.stdout:0/297: rmdir d0/d27 39 2024-04-21T23:49:34.649 INFO:tasks.workunit.client.0.smithi110.stdout:5/305: stat d7/f58 0 2024-04-21T23:49:34.705 INFO:tasks.workunit.client.0.smithi110.stdout:9/302: symlink d1/d29/d4d/l60 0 2024-04-21T23:49:34.853 INFO:tasks.workunit.client.0.smithi110.stdout:1/260: dwrite d1/d2/d14/d16/d29/f41 [0,4194304] 0 2024-04-21T23:49:34.972 INFO:tasks.workunit.client.0.smithi110.stdout:2/285: fdatasync d9/d25/d1b/d45/d4d/f52 0 2024-04-21T23:49:35.033 INFO:tasks.workunit.client.0.smithi110.stdout:2/286: read d9/d1a/f21 [3261878,77176] 0 2024-04-21T23:49:35.123 INFO:tasks.workunit.client.0.smithi110.stdout:8/323: mkdir d5/da/d17/d6c 0 2024-04-21T23:49:35.171 INFO:tasks.workunit.client.0.smithi110.stdout:6/284: chown d16/l1a 1390181156 1 2024-04-21T23:49:36.041 INFO:tasks.workunit.client.0.smithi110.stdout:4/269: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:49:36.229 INFO:tasks.workunit.client.0.smithi110.stdout:9/303: dread d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-21T23:49:36.283 INFO:tasks.workunit.client.0.smithi110.stdout:2/287: rename d9/d25/d1b/d45/d50/d55 to d9/d1a/d1d/d2b/d5b 0 2024-04-21T23:49:36.367 INFO:tasks.workunit.client.0.smithi110.stdout:8/324: fsync d5/f55 0 2024-04-21T23:49:36.381 INFO:tasks.workunit.client.0.smithi110.stdout:6/285: truncate d16/d1e/d24/d33/f34 3851109 0 2024-04-21T23:49:36.761 INFO:tasks.workunit.client.0.smithi110.stdout:1/261: dread d1/d2/d1b/f9 [0,4194304] 0 2024-04-21T23:49:36.763 INFO:tasks.workunit.client.0.smithi110.stdout:0/298: truncate d0/f2c 795941 0 2024-04-21T23:49:36.786 INFO:tasks.workunit.client.0.smithi110.stdout:7/293: write d10/d15/f2e [5291268,25315] 0 2024-04-21T23:49:37.149 INFO:tasks.workunit.client.0.smithi110.stdout:9/304: creat d1/d29/d2a/dc/d30/f61 x:0 0 0 2024-04-21T23:49:37.575 INFO:tasks.workunit.client.0.smithi110.stdout:8/325: fdatasync d5/da/f63 0 2024-04-21T23:49:37.701 INFO:tasks.workunit.client.0.smithi110.stdout:0/299: readlink d0/l6 0 2024-04-21T23:49:37.931 INFO:tasks.workunit.client.0.smithi110.stdout:1/262: symlink d1/d2/d14/d16/l58 0 2024-04-21T23:49:38.179 INFO:tasks.workunit.client.0.smithi110.stdout:4/270: mknod d1/d11/d20/d23/d1c/d47/d4f/d56/c5c 0 2024-04-21T23:49:38.333 INFO:tasks.workunit.client.0.smithi110.stdout:9/305: symlink d1/d29/d2a/d2b/l62 0 2024-04-21T23:49:38.442 INFO:tasks.workunit.client.0.smithi110.stdout:5/306: write f5 [1275668,126611] 0 2024-04-21T23:49:38.967 INFO:tasks.workunit.client.0.smithi110.stdout:8/326: fsync d5/d24/f2f 0 2024-04-21T23:49:39.152 INFO:tasks.workunit.client.0.smithi110.stdout:0/300: rename d0/d14/d23/c2f to d0/d2a/c65 0 2024-04-21T23:49:39.188 INFO:tasks.workunit.client.0.smithi110.stdout:0/301: chown d0/d14/d23/f45 1550 1 2024-04-21T23:49:39.205 INFO:tasks.workunit.client.0.smithi110.stdout:0/302: readlink d0/l6 0 2024-04-21T23:49:39.414 INFO:tasks.workunit.client.0.smithi110.stdout:2/288: rmdir d9/d1a/d1d/d57 0 2024-04-21T23:49:39.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/271: dread d1/d11/d12/f18 [0,4194304] 0 2024-04-21T23:49:40.080 INFO:tasks.workunit.client.0.smithi110.stdout:0/303: truncate d0/d14/f5f 487062 0 2024-04-21T23:49:40.229 INFO:tasks.workunit.client.0.smithi110.stdout:2/289: mkdir d9/d37/d3a/d5c 0 2024-04-21T23:49:40.293 INFO:tasks.workunit.client.0.smithi110.stdout:2/290: readlink d9/lb 0 2024-04-21T23:49:40.383 INFO:tasks.workunit.client.0.smithi110.stdout:9/306: creat d1/d29/d2a/d2b/d58/f63 x:0 0 0 2024-04-21T23:49:40.482 INFO:tasks.workunit.client.0.smithi110.stdout:3/263: creat d6/d12/f57 x:0 0 0 2024-04-21T23:49:40.559 INFO:tasks.workunit.client.0.smithi110.stdout:7/294: write f6 [4673862,23918] 0 2024-04-21T23:49:40.563 INFO:tasks.workunit.client.0.smithi110.stdout:2/291: read d9/d1a/f2d [2806425,48670] 0 2024-04-21T23:49:40.567 INFO:tasks.workunit.client.0.smithi110.stdout:6/286: dwrite d16/d1e/f2a [0,4194304] 0 2024-04-21T23:49:40.749 INFO:tasks.workunit.client.0.smithi110.stdout:5/307: getdents d7/d24/d3a/d54 0 2024-04-21T23:49:40.806 INFO:tasks.workunit.client.0.smithi110.stdout:7/295: sync 2024-04-21T23:49:40.850 INFO:tasks.workunit.client.0.smithi110.stdout:1/263: rename d1/d1d/f51 to d1/d1d/d4a/f59 0 2024-04-21T23:49:41.369 INFO:tasks.workunit.client.0.smithi110.stdout:9/307: symlink d1/d29/d2a/l64 0 2024-04-21T23:49:41.492 INFO:tasks.workunit.client.0.smithi110.stdout:4/272: fsync d1/d11/d20/d23/f2f 0 2024-04-21T23:49:41.837 INFO:tasks.workunit.client.0.smithi110.stdout:4/273: dwrite d1/fd [4194304,4194304] 0 2024-04-21T23:49:41.931 INFO:tasks.workunit.client.0.smithi110.stdout:4/274: sync 2024-04-21T23:49:42.100 INFO:tasks.workunit.client.0.smithi110.stdout:7/296: symlink d10/d2b/d46/l6c 0 2024-04-21T23:49:42.306 INFO:tasks.workunit.client.0.smithi110.stdout:9/308: rename d1/d29/d2a/d2b/l62 to d1/d29/d2a/d2b/d58/l65 0 2024-04-21T23:49:42.797 INFO:tasks.workunit.client.0.smithi110.stdout:8/327: dwrite d5/f3f [0,4194304] 0 2024-04-21T23:49:43.085 INFO:tasks.workunit.client.0.smithi110.stdout:7/297: unlink d10/d45/d60/l59 0 2024-04-21T23:49:43.492 INFO:tasks.workunit.client.0.smithi110.stdout:9/309: truncate d1/d29/d2a/dc/f40 3665010 0 2024-04-21T23:49:43.511 INFO:tasks.workunit.client.0.smithi110.stdout:6/287: creat d16/d1e/f57 x:0 0 0 2024-04-21T23:49:43.672 INFO:tasks.workunit.client.0.smithi110.stdout:6/288: sync 2024-04-21T23:49:43.683 INFO:tasks.workunit.client.0.smithi110.stdout:1/264: dread d1/d1d/d4a/f59 [0,4194304] 0 2024-04-21T23:49:43.701 INFO:tasks.workunit.client.0.smithi110.stdout:2/292: link d9/c53 d9/d37/d3a/c5d 0 2024-04-21T23:49:44.401 INFO:tasks.workunit.client.0.smithi110.stdout:8/328: rename d5/da/l3a to d5/d24/d33/d3d/d5c/d6a/l6d 0 2024-04-21T23:49:44.511 INFO:tasks.workunit.client.0.smithi110.stdout:7/298: rmdir d10/d45/d60/d5e 39 2024-04-21T23:49:44.873 INFO:tasks.workunit.client.0.smithi110.stdout:3/264: getdents d6/d12/d3c 0 2024-04-21T23:49:45.026 INFO:tasks.workunit.client.0.smithi110.stdout:5/308: dwrite d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:49:45.143 INFO:tasks.workunit.client.0.smithi110.stdout:0/304: write d0/d16/f53 [136457,67037] 0 2024-04-21T23:49:45.221 INFO:tasks.workunit.client.0.smithi110.stdout:0/305: chown d0/d14/d23/f3a 1215 1 2024-04-21T23:49:45.318 INFO:tasks.workunit.client.0.smithi110.stdout:6/289: symlink d16/d1e/d24/d33/l58 0 2024-04-21T23:49:45.507 INFO:tasks.workunit.client.0.smithi110.stdout:8/329: creat d5/da/d17/d60/f6e x:0 0 0 2024-04-21T23:49:45.537 INFO:tasks.workunit.client.0.smithi110.stdout:7/299: dread - d10/d2b/d39/f5b zero size 2024-04-21T23:49:45.586 INFO:tasks.workunit.client.0.smithi110.stdout:8/330: chown d5/da/d17/f22 219125026 1 2024-04-21T23:49:45.654 INFO:tasks.workunit.client.0.smithi110.stdout:8/331: dread - d5/da/f63 zero size 2024-04-21T23:49:45.876 INFO:tasks.workunit.client.0.smithi110.stdout:5/309: unlink d7/d24/f2e 0 2024-04-21T23:49:45.987 INFO:tasks.workunit.client.0.smithi110.stdout:3/265: chown d6/c9 680 1 2024-04-21T23:49:46.068 INFO:tasks.workunit.client.0.smithi110.stdout:7/300: dread f6 [4194304,4194304] 0 2024-04-21T23:49:46.202 INFO:tasks.workunit.client.0.smithi110.stdout:6/290: mknod d16/d1d/d38/c59 0 2024-04-21T23:49:46.706 INFO:tasks.workunit.client.0.smithi110.stdout:4/275: truncate d1/fe 3186505 0 2024-04-21T23:49:46.707 INFO:tasks.workunit.client.0.smithi110.stdout:2/293: creat d9/d25/f5e x:0 0 0 2024-04-21T23:49:46.779 INFO:tasks.workunit.client.0.smithi110.stdout:4/276: chown d1/d11/d20/d23/d1c/d47 3922790 1 2024-04-21T23:49:47.088 INFO:tasks.workunit.client.0.smithi110.stdout:5/310: symlink d7/d9/d17/l59 0 2024-04-21T23:49:47.219 INFO:tasks.workunit.client.0.smithi110.stdout:7/301: fsync d10/d27/f29 0 2024-04-21T23:49:47.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/266: read - d6/d12/d16/f2a zero size 2024-04-21T23:49:47.421 INFO:tasks.workunit.client.0.smithi110.stdout:6/291: fsync d16/f17 0 2024-04-21T23:49:48.023 INFO:tasks.workunit.client.0.smithi110.stdout:5/311: truncate d7/d24/f56 756602 0 2024-04-21T23:49:48.177 INFO:tasks.workunit.client.0.smithi110.stdout:1/265: write d1/d1d/d4a/f59 [1060017,32416] 0 2024-04-21T23:49:48.297 INFO:tasks.workunit.client.0.smithi110.stdout:3/267: symlink d6/d12/d14/d3f/l58 0 2024-04-21T23:49:48.316 INFO:tasks.workunit.client.0.smithi110.stdout:3/268: stat d6/d12/d3c 0 2024-04-21T23:49:48.829 INFO:tasks.workunit.client.0.smithi110.stdout:4/277: unlink d1/ca 0 2024-04-21T23:49:48.846 INFO:tasks.workunit.client.0.smithi110.stdout:5/312: symlink d7/d24/d3a/l5a 0 2024-04-21T23:49:48.919 INFO:tasks.workunit.client.0.smithi110.stdout:4/278: stat d1/d11/d12/l36 0 2024-04-21T23:49:49.246 INFO:tasks.workunit.client.0.smithi110.stdout:1/266: symlink d1/dd/d23/d48/l5a 0 2024-04-21T23:49:49.272 INFO:tasks.workunit.client.0.smithi110.stdout:6/292: unlink d16/d1d/c1f 0 2024-04-21T23:49:49.755 INFO:tasks.workunit.client.0.smithi110.stdout:5/313: stat d7/d35/f47 0 2024-04-21T23:49:49.887 INFO:tasks.workunit.client.0.smithi110.stdout:4/279: symlink d1/d11/d20/d23/l5d 0 2024-04-21T23:49:50.142 INFO:tasks.workunit.client.0.smithi110.stdout:1/267: truncate d1/d2/d1b/f35 802963 0 2024-04-21T23:49:50.218 INFO:tasks.workunit.client.0.smithi110.stdout:0/306: write d0/f19 [1107189,23257] 0 2024-04-21T23:49:50.402 INFO:tasks.workunit.client.0.smithi110.stdout:8/332: dwrite d5/d24/d33/d3d/f47 [0,4194304] 0 2024-04-21T23:49:50.539 INFO:tasks.workunit.client.0.smithi110.stdout:1/268: creat d1/d2/d14/f5b x:0 0 0 2024-04-21T23:49:50.569 INFO:tasks.workunit.client.0.smithi110.stdout:1/269: read - d1/d2/d14/f5b zero size 2024-04-21T23:49:50.617 INFO:tasks.workunit.client.0.smithi110.stdout:6/293: creat d16/d1d/f5a x:0 0 0 2024-04-21T23:49:50.654 INFO:tasks.workunit.client.0.smithi110.stdout:6/294: chown d16/d1e/d24/d33 19 1 2024-04-21T23:49:50.706 INFO:tasks.workunit.client.0.smithi110.stdout:0/307: chown d0/d14/l30 2 1 2024-04-21T23:49:50.865 INFO:tasks.workunit.client.0.smithi110.stdout:1/270: mkdir d1/d2/d1b/d10/d5c 0 2024-04-21T23:49:51.101 INFO:tasks.workunit.client.0.smithi110.stdout:6/295: creat d16/d3d/d40/f5b x:0 0 0 2024-04-21T23:49:51.182 INFO:tasks.workunit.client.0.smithi110.stdout:2/294: dwrite f1 [0,4194304] 0 2024-04-21T23:49:51.315 INFO:tasks.workunit.client.0.smithi110.stdout:8/333: mkdir d5/d6f 0 2024-04-21T23:49:51.380 INFO:tasks.workunit.client.0.smithi110.stdout:6/296: sync 2024-04-21T23:49:51.659 INFO:tasks.workunit.client.0.smithi110.stdout:0/308: dread d0/d16/d5d/f5e [0,4194304] 0 2024-04-21T23:49:51.680 INFO:tasks.workunit.client.0.smithi110.stdout:7/302: write d10/f5f [524252,25803] 0 2024-04-21T23:49:51.960 INFO:tasks.workunit.client.0.smithi110.stdout:8/334: truncate d5/ff 350600 0 2024-04-21T23:49:52.173 INFO:tasks.workunit.client.0.smithi110.stdout:2/295: creat d9/d1a/d1d/d4e/f5f x:0 0 0 2024-04-21T23:49:52.221 INFO:tasks.workunit.client.0.smithi110.stdout:2/296: dread - d9/d1a/d1d/d4e/f5f zero size 2024-04-21T23:49:52.350 INFO:tasks.workunit.client.0.smithi110.stdout:7/303: creat d10/d2b/f6d x:0 0 0 2024-04-21T23:49:52.388 INFO:tasks.workunit.client.0.smithi110.stdout:0/309: readlink d0/d27/l3c 0 2024-04-21T23:49:52.656 INFO:tasks.workunit.client.0.smithi110.stdout:3/269: dwrite d6/d12/d14/f25 [0,4194304] 0 2024-04-21T23:49:52.777 INFO:tasks.workunit.client.0.smithi110.stdout:6/297: mkdir d16/d1d/d5c 0 2024-04-21T23:49:52.786 INFO:tasks.workunit.client.0.smithi110.stdout:2/297: fsync d9/d25/f33 0 2024-04-21T23:49:52.855 INFO:tasks.workunit.client.0.smithi110.stdout:8/335: creat d5/d6f/f70 x:0 0 0 2024-04-21T23:49:52.903 INFO:tasks.workunit.client.0.smithi110.stdout:2/298: chown d9/d1a/d1d/c30 555 1 2024-04-21T23:49:53.172 INFO:tasks.workunit.client.0.smithi110.stdout:9/310: mknod d1/d29/d2a/c66 0 2024-04-21T23:49:53.279 INFO:tasks.workunit.client.0.smithi110.stdout:3/270: rmdir d6/d12/d3c 39 2024-04-21T23:49:53.405 INFO:tasks.workunit.client.0.smithi110.stdout:8/336: mkdir d5/d6f/d71 0 2024-04-21T23:49:53.429 INFO:tasks.workunit.client.0.smithi110.stdout:8/337: chown d5/f1d 3 1 2024-04-21T23:49:53.554 INFO:tasks.workunit.client.0.smithi110.stdout:2/299: mkdir d9/d25/d1b/d60 0 2024-04-21T23:49:53.755 INFO:tasks.workunit.client.0.smithi110.stdout:0/310: rename d0/c1a to d0/d16/c66 0 2024-04-21T23:49:53.775 INFO:tasks.workunit.client.0.smithi110.stdout:5/314: write d7/d24/d31/f45 [900777,125789] 0 2024-04-21T23:49:53.945 INFO:tasks.workunit.client.0.smithi110.stdout:7/304: creat d10/d15/d22/f6e x:0 0 0 2024-04-21T23:49:54.068 INFO:tasks.workunit.client.0.smithi110.stdout:7/305: chown d10/d45/d4d 9647 1 2024-04-21T23:49:54.278 INFO:tasks.workunit.client.0.smithi110.stdout:4/280: dwrite d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:49:54.753 INFO:tasks.workunit.client.0.smithi110.stdout:0/311: truncate d0/d27/f36 2193686 0 2024-04-21T23:49:54.885 INFO:tasks.workunit.client.0.smithi110.stdout:5/315: truncate d7/d9/fd 3079801 0 2024-04-21T23:49:55.139 INFO:tasks.workunit.client.0.smithi110.stdout:1/271: write d1/d2/d1b/d10/f4d [947309,66197] 0 2024-04-21T23:49:55.201 INFO:tasks.workunit.client.0.smithi110.stdout:3/271: symlink d6/d12/d50/l59 0 2024-04-21T23:49:55.221 INFO:tasks.workunit.client.0.smithi110.stdout:3/272: readlink d6/d12/d14/l21 0 2024-04-21T23:49:55.315 INFO:tasks.workunit.client.0.smithi110.stdout:3/273: dread d6/d12/d14/d32/f37 [0,4194304] 0 2024-04-21T23:49:55.403 INFO:tasks.workunit.client.0.smithi110.stdout:8/338: mkdir d5/da/d17/d6c/d72 0 2024-04-21T23:49:55.417 INFO:tasks.workunit.client.0.smithi110.stdout:6/298: link d16/d3d/f43 d16/d1e/d24/f5d 0 2024-04-21T23:49:55.470 INFO:tasks.workunit.client.0.smithi110.stdout:8/339: readlink d5/da/d17/d60/l67 0 2024-04-21T23:49:55.919 INFO:tasks.workunit.client.0.smithi110.stdout:4/281: unlink d1/d11/d20/d23/f1f 0 2024-04-21T23:49:55.941 INFO:tasks.workunit.client.0.smithi110.stdout:0/312: creat d0/d14/d23/d3b/f67 x:0 0 0 2024-04-21T23:49:55.985 INFO:tasks.workunit.client.0.smithi110.stdout:1/272: rmdir d1/d2/d30 39 2024-04-21T23:49:56.110 INFO:tasks.workunit.client.0.smithi110.stdout:3/274: chown d6/d12/d16/l52 1 1 2024-04-21T23:49:56.214 INFO:tasks.workunit.client.0.smithi110.stdout:0/313: sync 2024-04-21T23:49:56.227 INFO:tasks.workunit.client.0.smithi110.stdout:6/299: unlink d16/d1d/f4c 0 2024-04-21T23:49:56.326 INFO:tasks.workunit.client.0.smithi110.stdout:3/275: sync 2024-04-21T23:49:56.332 INFO:tasks.workunit.client.0.smithi110.stdout:3/276: readlink l5 0 2024-04-21T23:49:56.391 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:57:36.651 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.400 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:57:36.661 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.414 INFO:tasks.workunit.client.0.smithi110.stdout:0/314: sync 2024-04-21T23:49:56.440 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:57:36.637 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.441 INFO:tasks.workunit.client.0.smithi110.stdout:7/306: rename d10/d15/d22/l6a to d10/d45/d4d/l6f 0 2024-04-21T23:49:56.452 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:57:36.649 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.465 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:57:36.662 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.477 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:57:36.673 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.650 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:57:36.911 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.654 INFO:tasks.workunit.client.0.smithi110.stdout:1/273: symlink d1/d1d/d4a/l5d 0 2024-04-21T23:49:56.663 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:57:36.860 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:56.770 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:57:36.967 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:49:57.325 INFO:tasks.workunit.client.0.smithi110.stdout:8/340: mkdir d5/da/d17/d6c/d72/d73 0 2024-04-21T23:49:57.579 INFO:tasks.workunit.client.0.smithi110.stdout:5/316: rename d7/d9/d25 to d7/d22/d5b 0 2024-04-21T23:49:57.686 INFO:tasks.workunit.client.0.smithi110.stdout:5/317: stat d7/d35/f4c 0 2024-04-21T23:49:57.899 INFO:tasks.workunit.client.0.smithi110.stdout:9/311: dwrite d1/d29/d2a/d6/f56 [0,4194304] 0 2024-04-21T23:49:58.024 INFO:tasks.workunit.client.0.smithi110.stdout:9/312: readlink d1/d19/l1c 0 2024-04-21T23:49:58.108 INFO:tasks.workunit.client.0.smithi110.stdout:6/300: mkdir d16/d1d/d38/d48/d5e 0 2024-04-21T23:49:58.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:49:58.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:49:58.377 INFO:tasks.workunit.client.0.smithi110.stdout:2/300: dwrite d9/f10 [0,4194304] 0 2024-04-21T23:49:58.556 INFO:tasks.workunit.client.0.smithi110.stdout:7/307: mknod d10/d45/d60/d5e/d65/c70 0 2024-04-21T23:49:58.573 INFO:tasks.workunit.client.0.smithi110.stdout:7/308: stat d10/d15/f2e 0 2024-04-21T23:49:59.746 INFO:tasks.workunit.client.0.smithi110.stdout:2/301: fsync d9/fe 0 2024-04-21T23:49:59.869 INFO:tasks.workunit.client.0.smithi110.stdout:7/309: fsync d10/d45/f52 0 2024-04-21T23:49:59.951 INFO:tasks.workunit.client.0.smithi110.stdout:4/282: getdents d1/d11/d20/d23 0 2024-04-21T23:49:59.992 INFO:tasks.workunit.client.0.smithi110.stdout:4/283: chown d1/d11/d20/d23/d3c 211 1 2024-04-21T23:50:00.589 INFO:tasks.workunit.client.0.smithi110.stdout:2/302: creat d9/d37/d3a/f61 x:0 0 0 2024-04-21T23:50:00.663 INFO:tasks.workunit.client.0.smithi110.stdout:7/310: fdatasync d10/d2b/d39/f5b 0 2024-04-21T23:50:00.864 INFO:tasks.workunit.client.0.smithi110.stdout:4/284: unlink d1/d35/l49 0 2024-04-21T23:50:01.186 INFO:tasks.workunit.client.0.smithi110.stdout:2/303: creat d9/d25/d1b/f62 x:0 0 0 2024-04-21T23:50:01.346 INFO:tasks.workunit.client.0.smithi110.stdout:3/277: dwrite d6/f3a [0,4194304] 0 2024-04-21T23:50:01.640 INFO:tasks.workunit.client.0.smithi110.stdout:1/274: write d1/d2/d14/d16/d29/f41 [19100,46625] 0 2024-04-21T23:50:02.371 INFO:tasks.workunit.client.0.smithi110.stdout:3/278: creat d6/d12/d3c/f5a x:0 0 0 2024-04-21T23:50:02.409 INFO:tasks.workunit.client.0.smithi110.stdout:3/279: chown d6/d12/d16/l1c 1237923 1 2024-04-21T23:50:02.416 INFO:tasks.workunit.client.0.smithi110.stdout:3/280: readlink l5 0 2024-04-21T23:50:02.490 INFO:tasks.workunit.client.0.smithi110.stdout:1/275: rmdir d1/d2/d14/d16/d27 39 2024-04-21T23:50:02.895 INFO:tasks.workunit.client.0.smithi110.stdout:0/315: dwrite d0/f2c [0,4194304] 0 2024-04-21T23:50:03.085 INFO:tasks.workunit.client.0.smithi110.stdout:1/276: dread d1/dd/d23/f3d [0,4194304] 0 2024-04-21T23:50:03.228 INFO:tasks.workunit.client.0.smithi110.stdout:6/301: write d16/d1e/d24/f3c [797001,81935] 0 2024-04-21T23:50:03.242 INFO:tasks.workunit.client.0.smithi110.stdout:5/318: write d7/d9/d17/f51 [896771,127950] 0 2024-04-21T23:50:03.661 INFO:tasks.workunit.client.0.smithi110.stdout:2/304: write d9/d1a/f1e [131224,115322] 0 2024-04-21T23:50:03.669 INFO:tasks.workunit.client.0.smithi110.stdout:9/313: dwrite d1/d29/d2a/d6/f41 [0,4194304] 0 2024-04-21T23:50:04.028 INFO:tasks.workunit.client.0.smithi110.stdout:2/305: stat d9/f49 0 2024-04-21T23:50:04.108 INFO:tasks.workunit.client.0.smithi110.stdout:0/316: read d0/d16/f26 [2543511,61874] 0 2024-04-21T23:50:04.163 INFO:tasks.workunit.client.0.smithi110.stdout:1/277: read d1/d2/d14/d16/f50 [963940,55566] 0 2024-04-21T23:50:04.569 INFO:tasks.workunit.client.0.smithi110.stdout:7/311: dwrite d10/d2b/f54 [0,4194304] 0 2024-04-21T23:50:04.671 INFO:tasks.workunit.client.0.smithi110.stdout:6/302: mkdir d16/d3d/d40/d46/d5f 0 2024-04-21T23:50:04.691 INFO:tasks.workunit.client.0.smithi110.stdout:5/319: rename d7/d24/f46 to d7/d24/d37/f5c 0 2024-04-21T23:50:04.752 INFO:tasks.workunit.client.0.smithi110.stdout:3/281: dwrite d6/f3a [4194304,4194304] 0 2024-04-21T23:50:04.780 INFO:tasks.workunit.client.0.smithi110.stdout:9/314: creat d1/d29/d2a/dc/f67 x:0 0 0 2024-04-21T23:50:04.900 INFO:tasks.workunit.client.0.smithi110.stdout:4/285: dwrite d1/d11/d20/d23/f2f [0,4194304] 0 2024-04-21T23:50:05.020 INFO:tasks.workunit.client.0.smithi110.stdout:1/278: chown d1/d2/d14/d16/d29/l2a 50542 1 2024-04-21T23:50:05.042 INFO:tasks.workunit.client.0.smithi110.stdout:9/315: write d1/d29/d2a/d6/f41 [3628983,73229] 0 2024-04-21T23:50:05.043 INFO:tasks.workunit.client.0.smithi110.stdout:1/279: chown d1/d1d/d4a 6373 1 2024-04-21T23:50:05.140 INFO:tasks.workunit.client.0.smithi110.stdout:0/317: mkdir d0/d27/d68 0 2024-04-21T23:50:05.182 INFO:tasks.workunit.client.0.smithi110.stdout:9/316: dread d1/d29/d2a/d3c/f53 [0,4194304] 0 2024-04-21T23:50:05.214 INFO:tasks.workunit.client.0.smithi110.stdout:8/341: mkdir d5/d74 0 2024-04-21T23:50:05.280 INFO:tasks.workunit.client.0.smithi110.stdout:3/282: sync 2024-04-21T23:50:05.406 INFO:tasks.workunit.client.0.smithi110.stdout:3/283: sync 2024-04-21T23:50:05.593 INFO:tasks.workunit.client.0.smithi110.stdout:5/320: mkdir d7/d22/d5d 0 2024-04-21T23:50:05.606 INFO:tasks.workunit.client.0.smithi110.stdout:7/312: mknod d10/d2b/d39/c71 0 2024-04-21T23:50:05.689 INFO:tasks.workunit.client.0.smithi110.stdout:6/303: read d16/f1c [1530663,83099] 0 2024-04-21T23:50:05.694 INFO:tasks.workunit.client.0.smithi110.stdout:2/306: dread - d9/d25/d1c/f3c zero size 2024-04-21T23:50:06.042 INFO:tasks.workunit.client.0.smithi110.stdout:8/342: symlink d5/da/d17/d3b/l75 0 2024-04-21T23:50:06.048 INFO:tasks.workunit.client.0.smithi110.stdout:9/317: creat d1/d29/d4d/f68 x:0 0 0 2024-04-21T23:50:06.087 INFO:tasks.workunit.client.0.smithi110.stdout:3/284: stat d6/c11 0 2024-04-21T23:50:06.181 INFO:tasks.workunit.client.0.smithi110.stdout:3/285: write d6/f3a [2219476,28138] 0 2024-04-21T23:50:06.239 INFO:tasks.workunit.client.0.smithi110.stdout:4/286: fdatasync d1/fd 0 2024-04-21T23:50:06.318 INFO:tasks.workunit.client.0.smithi110.stdout:3/286: chown d6/d12/d14/d32/f37 1774273 1 2024-04-21T23:50:06.617 INFO:tasks.workunit.client.0.smithi110.stdout:7/313: readlink d10/d2b/d39/l50 0 2024-04-21T23:50:06.749 INFO:tasks.workunit.client.0.smithi110.stdout:6/304: fdatasync d16/d1d/f5a 0 2024-04-21T23:50:07.158 INFO:tasks.workunit.client.0.smithi110.stdout:9/318: mknod d1/d29/d2a/dc/d30/c69 0 2024-04-21T23:50:07.308 INFO:tasks.workunit.client.0.smithi110.stdout:9/319: sync 2024-04-21T23:50:07.341 INFO:tasks.workunit.client.0.smithi110.stdout:9/320: chown d1/d29/d2a/d6/d1d/f24 904257113 1 2024-04-21T23:50:07.602 INFO:tasks.workunit.client.0.smithi110.stdout:3/287: creat d6/d12/d14/d4b/f5b x:0 0 0 2024-04-21T23:50:07.613 INFO:tasks.workunit.client.0.smithi110.stdout:0/318: write d0/d27/d4b/f54 [796247,51336] 0 2024-04-21T23:50:08.075 INFO:tasks.workunit.client.0.smithi110.stdout:6/305: mknod d16/d1e/d24/c60 0 2024-04-21T23:50:08.079 INFO:tasks.workunit.client.0.smithi110.stdout:5/321: write d7/d9/f3b [5271379,22084] 0 2024-04-21T23:50:08.200 INFO:tasks.workunit.client.0.smithi110.stdout:1/280: dwrite d1/d2/d1b/fc [0,4194304] 0 2024-04-21T23:50:08.405 INFO:tasks.workunit.client.0.smithi110.stdout:1/281: chown d1/d2/d14/d16/d29 100 1 2024-04-21T23:50:08.554 INFO:tasks.workunit.client.0.smithi110.stdout:3/288: rmdir d6/d12/d14 39 2024-04-21T23:50:08.870 INFO:tasks.workunit.client.0.smithi110.stdout:2/307: creat d9/d1a/f63 x:0 0 0 2024-04-21T23:50:08.882 INFO:tasks.workunit.client.0.smithi110.stdout:7/314: creat d10/d45/d51/d58/f72 x:0 0 0 2024-04-21T23:50:09.033 INFO:tasks.workunit.client.0.smithi110.stdout:2/308: sync 2024-04-21T23:50:09.138 INFO:tasks.workunit.client.0.smithi110.stdout:4/287: dwrite d1/d11/d12/d26/f3b [0,4194304] 0 2024-04-21T23:50:09.703 INFO:tasks.workunit.client.0.smithi110.stdout:2/309: dread d9/fa [0,4194304] 0 2024-04-21T23:50:09.900 INFO:tasks.workunit.client.0.smithi110.stdout:0/319: fsync d0/d14/f5f 0 2024-04-21T23:50:09.910 INFO:tasks.workunit.client.0.smithi110.stdout:6/306: write f4 [640495,84911] 0 2024-04-21T23:50:10.160 INFO:tasks.workunit.client.0.smithi110.stdout:9/321: dwrite d1/d29/f2e [0,4194304] 0 2024-04-21T23:50:10.277 INFO:tasks.workunit.client.0.smithi110.stdout:8/343: getdents d5/da/d17/d6c/d72 0 2024-04-21T23:50:10.555 INFO:tasks.workunit.client.0.smithi110.stdout:4/288: mkdir d1/d11/d20/d23/d3c/d5e 0 2024-04-21T23:50:10.637 INFO:tasks.workunit.client.0.smithi110.stdout:6/307: dread - d16/d3d/d40/d46/f56 zero size 2024-04-21T23:50:10.686 INFO:tasks.workunit.client.0.smithi110.stdout:4/289: readlink d1/d11/d12/l36 0 2024-04-21T23:50:10.809 INFO:tasks.workunit.client.0.smithi110.stdout:0/320: mknod d0/d16/d42/d50/c69 0 2024-04-21T23:50:11.064 INFO:tasks.workunit.client.0.smithi110.stdout:9/322: dread d1/d29/d2a/d6/fe [0,4194304] 0 2024-04-21T23:50:11.095 INFO:tasks.workunit.client.0.smithi110.stdout:8/344: creat d5/d4f/f76 x:0 0 0 2024-04-21T23:50:11.126 INFO:tasks.workunit.client.0.smithi110.stdout:9/323: chown d1/f7 2203605 1 2024-04-21T23:50:11.761 INFO:tasks.workunit.client.0.smithi110.stdout:5/322: link d7/d24/d37/d38/f4d d7/d24/d31/f5e 0 2024-04-21T23:50:12.440 INFO:tasks.workunit.client.0.smithi110.stdout:6/308: truncate d16/d1e/d24/f4e 814160 0 2024-04-21T23:50:12.457 INFO:tasks.workunit.client.0.smithi110.stdout:0/321: mknod d0/d14/c6a 0 2024-04-21T23:50:12.635 INFO:tasks.workunit.client.0.smithi110.stdout:8/345: truncate d5/da/f35 905489 0 2024-04-21T23:50:12.764 INFO:tasks.workunit.client.0.smithi110.stdout:1/282: write d1/d2/f25 [2146946,40005] 0 2024-04-21T23:50:12.836 INFO:tasks.workunit.client.0.smithi110.stdout:7/315: creat d10/d15/d22/f73 x:0 0 0 2024-04-21T23:50:13.461 INFO:tasks.workunit.client.0.smithi110.stdout:9/324: rename d1/d19/c25 to d1/d29/d2a/d2b/c6a 0 2024-04-21T23:50:13.522 INFO:tasks.workunit.client.0.smithi110.stdout:3/289: dwrite d6/d12/d14/d32/f4e [8388608,4194304] 0 2024-04-21T23:50:13.629 INFO:tasks.workunit.client.0.smithi110.stdout:2/310: dwrite d9/d25/d1b/f62 [0,4194304] 0 2024-04-21T23:50:13.763 INFO:tasks.workunit.client.0.smithi110.stdout:7/316: creat d10/d2b/f74 x:0 0 0 2024-04-21T23:50:13.845 INFO:tasks.workunit.client.0.smithi110.stdout:7/317: chown d10/c48 0 1 2024-04-21T23:50:14.402 INFO:tasks.workunit.client.0.smithi110.stdout:1/283: mkdir d1/d2/d14/d16/d5e 0 2024-04-21T23:50:14.500 INFO:tasks.workunit.client.0.smithi110.stdout:2/311: fsync d9/d37/d3a/f41 0 2024-04-21T23:50:14.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/290: symlink d6/d12/d16/d30/l5c 0 2024-04-21T23:50:14.942 INFO:tasks.workunit.client.0.smithi110.stdout:4/290: dwrite d1/d11/f41 [0,4194304] 0 2024-04-21T23:50:14.964 INFO:tasks.workunit.client.0.smithi110.stdout:1/284: creat d1/d2/d1b/d10/f5f x:0 0 0 2024-04-21T23:50:15.566 INFO:tasks.workunit.client.0.smithi110.stdout:2/312: rename d9/fe to d9/d25/d1b/d45/d4d/f64 0 2024-04-21T23:50:15.637 INFO:tasks.workunit.client.0.smithi110.stdout:3/291: dread d6/f45 [0,4194304] 0 2024-04-21T23:50:15.675 INFO:tasks.workunit.client.0.smithi110.stdout:7/318: mkdir d10/d2b/d46/d69/d75 0 2024-04-21T23:50:15.848 INFO:tasks.workunit.client.0.smithi110.stdout:0/322: write d0/d25/f55 [6798632,104566] 0 2024-04-21T23:50:16.006 INFO:tasks.workunit.client.0.smithi110.stdout:4/291: mkdir d1/d11/d12/d26/d5f 0 2024-04-21T23:50:16.077 INFO:tasks.workunit.client.0.smithi110.stdout:5/323: dwrite d7/d9/d17/f51 [0,4194304] 0 2024-04-21T23:50:16.120 INFO:tasks.workunit.client.0.smithi110.stdout:8/346: write d5/f31 [2966523,55120] 0 2024-04-21T23:50:16.278 INFO:tasks.workunit.client.0.smithi110.stdout:2/313: unlink d9/d1a/f21 0 2024-04-21T23:50:16.465 INFO:tasks.workunit.client.0.smithi110.stdout:1/285: dread d1/f26 [0,4194304] 0 2024-04-21T23:50:16.537 INFO:tasks.workunit.client.0.smithi110.stdout:9/325: getdents d1/d29/d2a/d6 0 2024-04-21T23:50:16.649 INFO:tasks.workunit.client.0.smithi110.stdout:6/309: dwrite d16/f1b [0,4194304] 0 2024-04-21T23:50:16.782 INFO:tasks.workunit.client.0.smithi110.stdout:7/319: truncate d10/f5f 1475034 0 2024-04-21T23:50:16.989 INFO:tasks.workunit.client.0.smithi110.stdout:3/292: mkdir d6/d12/d16/d5d 0 2024-04-21T23:50:17.357 INFO:tasks.workunit.client.0.smithi110.stdout:5/324: dread d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:50:17.378 INFO:tasks.workunit.client.0.smithi110.stdout:2/314: mknod d9/d25/d1b/d45/c65 0 2024-04-21T23:50:17.624 INFO:tasks.workunit.client.0.smithi110.stdout:8/347: mknod d5/d24/d33/d3d/c77 0 2024-04-21T23:50:17.868 INFO:tasks.workunit.client.0.smithi110.stdout:1/286: symlink d1/dd/d23/d48/d4e/l60 0 2024-04-21T23:50:17.891 INFO:tasks.workunit.client.0.smithi110.stdout:1/287: chown d1/d1d/d4a/f59 4339187 1 2024-04-21T23:50:17.992 INFO:tasks.workunit.client.0.smithi110.stdout:7/320: creat d10/d45/d60/d5e/d65/f76 x:0 0 0 2024-04-21T23:50:18.010 INFO:tasks.workunit.client.0.smithi110.stdout:7/321: stat d10/d2b/d39 0 2024-04-21T23:50:18.405 INFO:tasks.workunit.client.0.smithi110.stdout:5/325: creat d7/d24/d37/f5f x:0 0 0 2024-04-21T23:50:18.876 INFO:tasks.workunit.client.0.smithi110.stdout:7/322: dread - d10/d15/d22/f6e zero size 2024-04-21T23:50:19.830 INFO:tasks.workunit.client.0.smithi110.stdout:8/348: mkdir d5/da/d17/d6c/d72/d73/d78 0 2024-04-21T23:50:19.896 INFO:tasks.workunit.client.0.smithi110.stdout:1/288: symlink d1/d2/d1b/l61 0 2024-04-21T23:50:19.912 INFO:tasks.workunit.client.0.smithi110.stdout:0/323: creat d0/d27/f6b x:0 0 0 2024-04-21T23:50:19.940 INFO:tasks.workunit.client.0.smithi110.stdout:1/289: readlink d1/d2/d14/l36 0 2024-04-21T23:50:19.988 INFO:tasks.workunit.client.0.smithi110.stdout:7/323: mknod d10/d43/c77 0 2024-04-21T23:50:20.095 INFO:tasks.workunit.client.0.smithi110.stdout:3/293: creat d6/d12/d16/f5e x:0 0 0 2024-04-21T23:50:20.832 INFO:tasks.workunit.client.0.smithi110.stdout:9/326: write d1/d29/d2a/dc/fd [469448,81693] 0 2024-04-21T23:50:20.985 INFO:tasks.workunit.client.0.smithi110.stdout:0/324: rmdir d0/d14/d23 39 2024-04-21T23:50:21.125 INFO:tasks.workunit.client.0.smithi110.stdout:8/349: dread d5/f2a [0,4194304] 0 2024-04-21T23:50:21.309 INFO:tasks.workunit.client.0.smithi110.stdout:4/292: symlink d1/l60 0 2024-04-21T23:50:21.363 INFO:tasks.workunit.client.0.smithi110.stdout:3/294: truncate d6/d12/d14/d32/f33 256951 0 2024-04-21T23:50:21.469 INFO:tasks.workunit.client.0.smithi110.stdout:2/315: write d9/d1a/f26 [3755934,75518] 0 2024-04-21T23:50:21.476 INFO:tasks.workunit.client.0.smithi110.stdout:3/295: dread - d6/d12/d16/f5e zero size 2024-04-21T23:50:21.536 INFO:tasks.workunit.client.0.smithi110.stdout:4/293: dread d1/d11/d12/f18 [0,4194304] 0 2024-04-21T23:50:21.805 INFO:tasks.workunit.client.0.smithi110.stdout:9/327: creat d1/d19/d42/f6b x:0 0 0 2024-04-21T23:50:21.920 INFO:tasks.workunit.client.0.smithi110.stdout:8/350: mkdir d5/d4f/d79 0 2024-04-21T23:50:22.079 INFO:tasks.workunit.client.0.smithi110.stdout:2/316: dwrite d9/d1a/f26 [0,4194304] 0 2024-04-21T23:50:22.455 INFO:tasks.workunit.client.0.smithi110.stdout:6/310: dwrite d16/d1e/d24/f4e [0,4194304] 0 2024-04-21T23:50:22.760 INFO:tasks.workunit.client.0.smithi110.stdout:3/296: dread d6/d12/d14/f25 [0,4194304] 0 2024-04-21T23:50:22.832 INFO:tasks.workunit.client.0.smithi110.stdout:4/294: dread d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:50:23.102 INFO:tasks.workunit.client.0.smithi110.stdout:7/324: rename d10/d15/d22/f4b to d10/d45/d60/f78 0 2024-04-21T23:50:23.461 INFO:tasks.workunit.client.0.smithi110.stdout:8/351: dread - d5/d4f/f76 zero size 2024-04-21T23:50:23.639 INFO:tasks.workunit.client.0.smithi110.stdout:5/326: dwrite d7/d24/d37/d38/f4d [8388608,4194304] 0 2024-04-21T23:50:23.990 INFO:tasks.workunit.client.0.smithi110.stdout:0/325: creat d0/d27/d4b/f6c x:0 0 0 2024-04-21T23:50:24.031 INFO:tasks.workunit.client.0.smithi110.stdout:3/297: readlink d6/l10 0 2024-04-21T23:50:24.046 INFO:tasks.workunit.client.0.smithi110.stdout:3/298: readlink d6/l4a 0 2024-04-21T23:50:24.076 INFO:tasks.workunit.client.0.smithi110.stdout:3/299: dread - d6/d12/d16/f5e zero size 2024-04-21T23:50:24.112 INFO:tasks.workunit.client.0.smithi110.stdout:3/300: read d6/f34 [284095,103925] 0 2024-04-21T23:50:25.203 INFO:tasks.workunit.client.0.smithi110.stdout:1/290: dwrite d1/d2/d30/f47 [0,4194304] 0 2024-04-21T23:50:25.310 INFO:tasks.workunit.client.0.smithi110.stdout:3/301: dread - d6/d12/d14/f53 zero size 2024-04-21T23:50:25.357 INFO:tasks.workunit.client.0.smithi110.stdout:1/291: chown d1/d1d/d4a 2581 1 2024-04-21T23:50:25.400 INFO:tasks.workunit.client.0.smithi110.stdout:1/292: stat d1/dd/d23/d48/d4e/l60 0 2024-04-21T23:50:25.585 INFO:tasks.workunit.client.0.smithi110.stdout:5/327: mknod d7/d24/d49/c60 0 2024-04-21T23:50:25.599 INFO:tasks.workunit.client.0.smithi110.stdout:0/326: truncate d0/f17 500864 0 2024-04-21T23:50:25.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/352: getdents d5/da/d17/d6c/d72 0 2024-04-21T23:50:25.690 INFO:tasks.workunit.client.0.smithi110.stdout:9/328: write d1/d19/f13 [264553,31204] 0 2024-04-21T23:50:25.781 INFO:tasks.workunit.client.0.smithi110.stdout:3/302: creat d6/d12/d14/d4b/f5f x:0 0 0 2024-04-21T23:50:25.920 INFO:tasks.workunit.client.0.smithi110.stdout:1/293: creat d1/d1d/d57/f62 x:0 0 0 2024-04-21T23:50:26.233 INFO:tasks.workunit.client.0.smithi110.stdout:5/328: mkdir d7/d24/d49/d61 0 2024-04-21T23:50:26.772 INFO:tasks.workunit.client.0.smithi110.stdout:5/329: fsync d7/d9/f21 0 2024-04-21T23:50:27.055 INFO:tasks.workunit.client.0.smithi110.stdout:2/317: dwrite d9/d1a/d1d/d4e/f5f [0,4194304] 0 2024-04-21T23:50:27.166 INFO:tasks.workunit.client.0.smithi110.stdout:1/294: fsync d1/d2/f2d 0 2024-04-21T23:50:27.291 INFO:tasks.workunit.client.0.smithi110.stdout:0/327: mkdir d0/d14/d23/d6d 0 2024-04-21T23:50:27.459 INFO:tasks.workunit.client.0.smithi110.stdout:0/328: chown d0/d25/l4d 698462324 1 2024-04-21T23:50:27.536 INFO:tasks.workunit.client.0.smithi110.stdout:7/325: write d10/d15/d22/f42 [135211,66843] 0 2024-04-21T23:50:27.675 INFO:tasks.workunit.client.0.smithi110.stdout:9/329: creat d1/d29/f6c x:0 0 0 2024-04-21T23:50:27.681 INFO:tasks.workunit.client.0.smithi110.stdout:0/329: chown d0/d16/f26 0 1 2024-04-21T23:50:27.700 INFO:tasks.workunit.client.0.smithi110.stdout:4/295: dwrite d1/d11/d12/d26/f3f [0,4194304] 0 2024-04-21T23:50:27.935 INFO:tasks.workunit.client.0.smithi110.stdout:8/353: rename d5/d24/f3c to d5/da/d17/f7a 0 2024-04-21T23:50:27.948 INFO:tasks.workunit.client.0.smithi110.stdout:5/330: fdatasync d7/d24/f36 0 2024-04-21T23:50:28.036 INFO:tasks.workunit.client.0.smithi110.stdout:6/311: write d16/d3d/f43 [921102,86611] 0 2024-04-21T23:50:28.054 INFO:tasks.workunit.client.0.smithi110.stdout:6/312: stat f15 0 2024-04-21T23:50:28.171 INFO:tasks.workunit.client.0.smithi110.stdout:1/295: mknod d1/d2/d1b/d10/c63 0 2024-04-21T23:50:28.190 INFO:tasks.workunit.client.0.smithi110.stdout:1/296: chown d1/dd/d23 28 1 2024-04-21T23:50:28.369 INFO:tasks.workunit.client.0.smithi110.stdout:3/303: fsync d6/d12/d14/d32/f33 0 2024-04-21T23:50:28.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:50:28.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:50:28.427 INFO:tasks.workunit.client.0.smithi110.stdout:7/326: chown d10/d15/c16 2 1 2024-04-21T23:50:28.510 INFO:tasks.workunit.client.0.smithi110.stdout:7/327: dread d10/d15/d22/f42 [0,4194304] 0 2024-04-21T23:50:28.577 INFO:tasks.workunit.client.0.smithi110.stdout:4/296: dread d1/f28 [0,4194304] 0 2024-04-21T23:50:29.095 INFO:tasks.workunit.client.0.smithi110.stdout:5/331: dread d7/d24/f56 [0,4194304] 0 2024-04-21T23:50:29.120 INFO:tasks.workunit.client.0.smithi110.stdout:8/354: truncate d5/f3f 962699 0 2024-04-21T23:50:29.171 INFO:tasks.workunit.client.0.smithi110.stdout:5/332: chown d7/d24/d3a/d54 4185789 1 2024-04-21T23:50:29.237 INFO:tasks.workunit.client.0.smithi110.stdout:5/333: dread d7/d24/f56 [0,4194304] 0 2024-04-21T23:50:29.327 INFO:tasks.workunit.client.0.smithi110.stdout:2/318: symlink d9/d1a/d1d/d2b/d54/l66 0 2024-04-21T23:50:29.351 INFO:tasks.workunit.client.0.smithi110.stdout:2/319: stat d9/d1a/d1d/f36 0 2024-04-21T23:50:29.487 INFO:tasks.workunit.client.0.smithi110.stdout:1/297: creat d1/d2/d14/f64 x:0 0 0 2024-04-21T23:50:29.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/304: creat d6/d12/d14/f60 x:0 0 0 2024-04-21T23:50:30.322 INFO:tasks.workunit.client.0.smithi110.stdout:7/328: dread f9 [0,4194304] 0 2024-04-21T23:50:30.514 INFO:tasks.workunit.client.0.smithi110.stdout:4/297: dread d1/d11/f4b [0,4194304] 0 2024-04-21T23:50:30.745 INFO:tasks.workunit.client.0.smithi110.stdout:3/305: read d6/d12/f2f [292905,88934] 0 2024-04-21T23:50:31.210 INFO:tasks.workunit.client.0.smithi110.stdout:0/330: creat d0/d14/f6e x:0 0 0 2024-04-21T23:50:32.457 INFO:tasks.workunit.client.0.smithi110.stdout:9/330: getdents d1/d19 0 2024-04-21T23:50:32.599 INFO:tasks.workunit.client.0.smithi110.stdout:6/313: getdents d16 0 2024-04-21T23:50:32.952 INFO:tasks.workunit.client.0.smithi110.stdout:5/334: write d7/f58 [417494,45637] 0 2024-04-21T23:50:32.981 INFO:tasks.workunit.client.0.smithi110.stdout:1/298: write d1/f40 [2195357,62688] 0 2024-04-21T23:50:33.073 INFO:tasks.workunit.client.0.smithi110.stdout:5/335: readlink d7/l8 0 2024-04-21T23:50:33.234 INFO:tasks.workunit.client.0.smithi110.stdout:8/355: link d5/c40 d5/c7b 0 2024-04-21T23:50:33.258 INFO:tasks.workunit.client.0.smithi110.stdout:8/356: readlink d5/l34 0 2024-04-21T23:50:33.550 INFO:tasks.workunit.client.0.smithi110.stdout:7/329: creat d10/d15/d22/f79 x:0 0 0 2024-04-21T23:50:33.918 INFO:tasks.workunit.client.0.smithi110.stdout:9/331: creat d1/d29/d59/f6d x:0 0 0 2024-04-21T23:50:33.960 INFO:tasks.workunit.client.0.smithi110.stdout:1/299: read d1/d1d/d4a/f59 [1017476,43033] 0 2024-04-21T23:50:33.964 INFO:tasks.workunit.client.0.smithi110.stdout:9/332: chown d1/d29/d2a 12 1 2024-04-21T23:50:34.003 INFO:tasks.workunit.client.0.smithi110.stdout:9/333: chown d1/l18 3784825 1 2024-04-21T23:50:34.058 INFO:tasks.workunit.client.0.smithi110.stdout:5/336: rmdir d7/d24/d3a/d40 39 2024-04-21T23:50:34.243 INFO:tasks.workunit.client.0.smithi110.stdout:8/357: truncate d5/d4f/f76 290388 0 2024-04-21T23:50:34.445 INFO:tasks.workunit.client.0.smithi110.stdout:4/298: getdents d1 0 2024-04-21T23:50:34.597 INFO:tasks.workunit.client.0.smithi110.stdout:3/306: dwrite d6/d12/d14/d4b/f5b [0,4194304] 0 2024-04-21T23:50:34.728 INFO:tasks.workunit.client.0.smithi110.stdout:4/299: read d1/d11/d12/f19 [3068193,87822] 0 2024-04-21T23:50:34.877 INFO:tasks.workunit.client.0.smithi110.stdout:0/331: write d0/d14/d23/f45 [765775,100272] 0 2024-04-21T23:50:34.882 INFO:tasks.workunit.client.0.smithi110.stdout:6/314: write f3 [184679,100341] 0 2024-04-21T23:50:35.021 INFO:tasks.workunit.client.0.smithi110.stdout:6/315: readlink d16/d1d/l52 0 2024-04-21T23:50:35.238 INFO:tasks.workunit.client.0.smithi110.stdout:2/320: dwrite d9/d25/d1b/d45/d4d/f64 [4194304,4194304] 0 2024-04-21T23:50:35.547 INFO:tasks.workunit.client.0.smithi110.stdout:8/358: truncate d5/f6 220952 0 2024-04-21T23:50:35.953 INFO:tasks.workunit.client.0.smithi110.stdout:0/332: mknod d0/d14/d23/d3b/c6f 0 2024-04-21T23:50:36.050 INFO:tasks.workunit.client.0.smithi110.stdout:3/307: dread d6/d12/d16/d30/f51 [0,4194304] 0 2024-04-21T23:50:36.104 INFO:tasks.workunit.client.0.smithi110.stdout:1/300: write d1/d2/d30/f47 [1245438,78440] 0 2024-04-21T23:50:36.322 INFO:tasks.workunit.client.0.smithi110.stdout:4/300: creat d1/d11/d20/d23/d3c/d5e/f61 x:0 0 0 2024-04-21T23:50:36.494 INFO:tasks.workunit.client.0.smithi110.stdout:2/321: creat d9/d25/d1b/d60/f67 x:0 0 0 2024-04-21T23:50:36.825 INFO:tasks.workunit.client.0.smithi110.stdout:9/334: dwrite d1/d29/d4d/f68 [0,4194304] 0 2024-04-21T23:50:36.963 INFO:tasks.workunit.client.0.smithi110.stdout:8/359: mkdir d5/da/d17/d7c 0 2024-04-21T23:50:36.988 INFO:tasks.workunit.client.0.smithi110.stdout:5/337: write d7/d9/d17/f2c [1997657,15361] 0 2024-04-21T23:50:37.020 INFO:tasks.workunit.client.0.smithi110.stdout:7/330: write d10/d15/f25 [552753,94489] 0 2024-04-21T23:50:37.066 INFO:tasks.workunit.client.0.smithi110.stdout:4/301: symlink d1/d11/d20/d23/d1c/d40/l62 0 2024-04-21T23:50:37.127 INFO:tasks.workunit.client.0.smithi110.stdout:8/360: chown d5/d6f/f70 2864209 1 2024-04-21T23:50:37.155 INFO:tasks.workunit.client.0.smithi110.stdout:0/333: mknod d0/d25/d5a/d63/c70 0 2024-04-21T23:50:37.159 INFO:tasks.workunit.client.0.smithi110.stdout:4/302: chown d1/f39 995570603 1 2024-04-21T23:50:37.311 INFO:tasks.workunit.client.0.smithi110.stdout:2/322: mkdir d9/d25/d1b/d45/d50/d68 0 2024-04-21T23:50:37.361 INFO:tasks.workunit.client.0.smithi110.stdout:2/323: write d9/d25/d1b/d60/f67 [5677,32865] 0 2024-04-21T23:50:37.663 INFO:tasks.workunit.client.0.smithi110.stdout:9/335: mknod d1/d29/d59/c6e 0 2024-04-21T23:50:37.971 INFO:tasks.workunit.client.0.smithi110.stdout:7/331: creat d10/d45/d60/d5e/d65/f7a x:0 0 0 2024-04-21T23:50:38.003 INFO:tasks.workunit.client.0.smithi110.stdout:6/316: write d16/d1e/d24/f4e [5075006,30007] 0 2024-04-21T23:50:38.253 INFO:tasks.workunit.client.0.smithi110.stdout:4/303: creat d1/d11/d20/d23/d1c/d40/f63 x:0 0 0 2024-04-21T23:50:38.339 INFO:tasks.workunit.client.0.smithi110.stdout:2/324: creat d9/d1a/d1d/d2b/f69 x:0 0 0 2024-04-21T23:50:38.349 INFO:tasks.workunit.client.0.smithi110.stdout:7/332: sync 2024-04-21T23:50:38.519 INFO:tasks.workunit.client.0.smithi110.stdout:3/308: link d6/d12/d14/d32/f3b d6/d12/d14/d3f/f61 0 2024-04-21T23:50:38.538 INFO:tasks.workunit.client.0.smithi110.stdout:3/309: chown d6/f19 1439793378 1 2024-04-21T23:50:38.559 INFO:tasks.workunit.client.0.smithi110.stdout:3/310: readlink d6/d12/d16/l52 0 2024-04-21T23:50:38.569 INFO:tasks.workunit.client.0.smithi110.stdout:9/336: rmdir d1/d29/d2a 39 2024-04-21T23:50:38.583 INFO:tasks.workunit.client.0.smithi110.stdout:3/311: stat d6/c9 0 2024-04-21T23:50:38.616 INFO:tasks.workunit.client.0.smithi110.stdout:3/312: chown d6/f38 450344976 1 2024-04-21T23:50:38.780 INFO:tasks.workunit.client.0.smithi110.stdout:5/338: symlink d7/d24/d3a/d54/l62 0 2024-04-21T23:50:38.875 INFO:tasks.workunit.client.0.smithi110.stdout:8/361: truncate d5/d24/d33/f4d 188780 0 2024-04-21T23:50:39.274 INFO:tasks.workunit.client.0.smithi110.stdout:0/334: fdatasync d0/d27/d4b/f4f 0 2024-04-21T23:50:39.306 INFO:tasks.workunit.client.0.smithi110.stdout:4/304: readlink d1/d11/l14 0 2024-04-21T23:50:39.400 INFO:tasks.workunit.client.0.smithi110.stdout:2/325: read d9/d1a/f1e [940066,102220] 0 2024-04-21T23:50:39.408 INFO:tasks.workunit.client.0.smithi110.stdout:1/301: dwrite d1/d2/d1b/d10/f5f [0,4194304] 0 2024-04-21T23:50:39.600 INFO:tasks.workunit.client.0.smithi110.stdout:4/305: write d1/d11/d20/d23/d3c/d5e/f61 [164416,38313] 0 2024-04-21T23:50:39.676 INFO:tasks.workunit.client.0.smithi110.stdout:3/313: fsync d6/d12/f57 0 2024-04-21T23:50:39.749 INFO:tasks.workunit.client.0.smithi110.stdout:5/339: write d7/f58 [1197637,94543] 0 2024-04-21T23:50:39.928 INFO:tasks.workunit.client.0.smithi110.stdout:8/362: rename d5/da/d17/d3b to d5/da/d17/d6c/d7d 0 2024-04-21T23:50:40.509 INFO:tasks.workunit.client.0.smithi110.stdout:7/333: symlink d10/d45/d60/l7b 0 2024-04-21T23:50:40.689 INFO:tasks.workunit.client.0.smithi110.stdout:0/335: mknod d0/d14/d23/d3b/c71 0 2024-04-21T23:50:41.114 INFO:tasks.workunit.client.0.smithi110.stdout:1/302: mkdir d1/d2/d14/d65 0 2024-04-21T23:50:41.128 INFO:tasks.workunit.client.0.smithi110.stdout:4/306: truncate d1/fd 1215729 0 2024-04-21T23:50:41.485 INFO:tasks.workunit.client.0.smithi110.stdout:5/340: dread d7/d24/d31/f45 [0,4194304] 0 2024-04-21T23:50:41.855 INFO:tasks.workunit.client.0.smithi110.stdout:6/317: dwrite f15 [0,4194304] 0 2024-04-21T23:50:41.995 INFO:tasks.workunit.client.0.smithi110.stdout:7/334: dread - d10/d2b/f74 zero size 2024-04-21T23:50:42.043 INFO:tasks.workunit.client.0.smithi110.stdout:7/335: chown d10/d2b/d39/l3a 0 1 2024-04-21T23:50:42.055 INFO:tasks.workunit.client.0.smithi110.stdout:7/336: chown d10/d2b 3547956 1 2024-04-21T23:50:42.164 INFO:tasks.workunit.client.0.smithi110.stdout:2/326: fdatasync d9/d25/d1c/f28 0 2024-04-21T23:50:42.387 INFO:tasks.workunit.client.0.smithi110.stdout:4/307: unlink d1/d11/d12/d26/l45 0 2024-04-21T23:50:42.615 INFO:tasks.workunit.client.0.smithi110.stdout:1/303: mknod d1/dd/d23/d48/d4e/c66 0 2024-04-21T23:50:42.663 INFO:tasks.workunit.client.0.smithi110.stdout:3/314: mknod d6/d12/c62 0 2024-04-21T23:50:42.701 INFO:tasks.workunit.client.0.smithi110.stdout:3/315: chown d6/d12/d16/d30/l5c 476888 1 2024-04-21T23:50:42.898 INFO:tasks.workunit.client.0.smithi110.stdout:6/318: symlink d16/d1d/d38/l61 0 2024-04-21T23:50:43.869 INFO:tasks.workunit.client.0.smithi110.stdout:3/316: creat d6/d12/d14/d4b/f63 x:0 0 0 2024-04-21T23:50:43.996 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:58:24.257 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.015 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:58:24.276 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.106 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:58:24.367 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.111 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:58:24.308 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.122 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:58:24.319 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.135 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:58:24.332 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.140 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:58:24.337 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.204 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:58:24.401 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.221 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:58:24.417 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:50:44.752 INFO:tasks.workunit.client.0.smithi110.stdout:8/363: write d5/d24/f2f [2567906,89762] 0 2024-04-21T23:50:44.799 INFO:tasks.workunit.client.0.smithi110.stdout:8/364: chown d5/d24/d33/d3d/c4b 65 1 2024-04-21T23:50:44.806 INFO:tasks.workunit.client.0.smithi110.stdout:6/319: truncate d16/d1d/f25 993097 0 2024-04-21T23:50:45.325 INFO:tasks.workunit.client.0.smithi110.stdout:1/304: rmdir d1/d2/d14/d16/d5e 0 2024-04-21T23:50:45.378 INFO:tasks.workunit.client.0.smithi110.stdout:7/337: getdents d10/d2b/d46/d69 0 2024-04-21T23:50:45.908 INFO:tasks.workunit.client.0.smithi110.stdout:0/336: dwrite d0/d27/f6b [0,4194304] 0 2024-04-21T23:50:46.062 INFO:tasks.workunit.client.0.smithi110.stdout:6/320: dread f3 [4194304,4194304] 0 2024-04-21T23:50:46.114 INFO:tasks.workunit.client.0.smithi110.stdout:3/317: link d6/d12/d16/d30/f51 d6/d12/d50/f64 0 2024-04-21T23:50:46.248 INFO:tasks.workunit.client.0.smithi110.stdout:8/365: creat d5/da/d17/d7c/f7e x:0 0 0 2024-04-21T23:50:46.715 INFO:tasks.workunit.client.0.smithi110.stdout:3/318: dread - d6/d12/d3c/f5a zero size 2024-04-21T23:50:46.878 INFO:tasks.workunit.client.0.smithi110.stdout:0/337: dread d0/d14/f1c [0,4194304] 0 2024-04-21T23:50:46.974 INFO:tasks.workunit.client.0.smithi110.stdout:3/319: sync 2024-04-21T23:50:47.114 INFO:tasks.workunit.client.0.smithi110.stdout:3/320: sync 2024-04-21T23:50:47.119 INFO:tasks.workunit.client.0.smithi110.stdout:6/321: mkdir d16/d1d/d38/d48/d5e/d62 0 2024-04-21T23:50:47.157 INFO:tasks.workunit.client.0.smithi110.stdout:2/327: write d9/d1a/d1d/d4e/f5f [222190,98194] 0 2024-04-21T23:50:47.191 INFO:tasks.workunit.client.0.smithi110.stdout:6/322: stat d16/l31 0 2024-04-21T23:50:47.543 INFO:tasks.workunit.client.0.smithi110.stdout:3/321: mkdir d6/d12/d3c/d65 0 2024-04-21T23:50:47.649 INFO:tasks.workunit.client.0.smithi110.stdout:6/323: creat d16/f63 x:0 0 0 2024-04-21T23:50:48.090 INFO:tasks.workunit.client.0.smithi110.stdout:3/322: creat d6/d12/d50/f66 x:0 0 0 2024-04-21T23:50:48.395 INFO:tasks.workunit.client.0.smithi110.stdout:4/308: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:50:48.508 INFO:tasks.workunit.client.0.smithi110.stdout:4/309: readlink d1/d35/l4c 0 2024-04-21T23:50:48.869 INFO:tasks.workunit.client.0.smithi110.stdout:3/323: mkdir d6/d12/d16/d30/d67 0 2024-04-21T23:50:49.122 INFO:tasks.workunit.client.0.smithi110.stdout:7/338: write d10/f23 [1262750,96385] 0 2024-04-21T23:50:49.422 INFO:tasks.workunit.client.0.smithi110.stdout:9/337: mkdir d1/d29/d6f 0 2024-04-21T23:50:49.437 INFO:tasks.workunit.client.0.smithi110.stdout:5/341: rmdir d7 39 2024-04-21T23:50:49.715 INFO:tasks.workunit.client.0.smithi110.stdout:0/338: write d0/d14/d23/d3b/f67 [209535,103192] 0 2024-04-21T23:50:49.801 INFO:tasks.workunit.client.0.smithi110.stdout:1/305: dwrite d1/d2/d1b/f35 [0,4194304] 0 2024-04-21T23:50:50.053 INFO:tasks.workunit.client.0.smithi110.stdout:7/339: chown d10/d15/d22/l5c 15 1 2024-04-21T23:50:50.078 INFO:tasks.workunit.client.0.smithi110.stdout:7/340: chown d10/d45/d4d 28 1 2024-04-21T23:50:50.131 INFO:tasks.workunit.client.0.smithi110.stdout:9/338: mknod d1/d19/d42/c70 0 2024-04-21T23:50:50.180 INFO:tasks.workunit.client.0.smithi110.stdout:8/366: rename d5/da/d17/c28 to d5/da/d17/c7f 0 2024-04-21T23:50:50.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/339: symlink d0/d27/l72 0 2024-04-21T23:50:50.479 INFO:tasks.workunit.client.0.smithi110.stdout:1/306: symlink d1/d1d/d4a/l67 0 2024-04-21T23:50:50.721 INFO:tasks.workunit.client.0.smithi110.stdout:7/341: dread - d10/d15/d22/f73 zero size 2024-04-21T23:50:51.003 INFO:tasks.workunit.client.0.smithi110.stdout:7/342: truncate d10/f23 1811205 0 2024-04-21T23:50:51.068 INFO:tasks.workunit.client.0.smithi110.stdout:3/324: dwrite d6/d12/d16/f23 [0,4194304] 0 2024-04-21T23:50:51.434 INFO:tasks.workunit.client.0.smithi110.stdout:2/328: rename d9/d25/d1b/c2c to d9/c6a 0 2024-04-21T23:50:51.488 INFO:tasks.workunit.client.0.smithi110.stdout:8/367: mkdir d5/d80 0 2024-04-21T23:50:51.499 INFO:tasks.workunit.client.0.smithi110.stdout:1/307: dread - d1/dd/d23/f54 zero size 2024-04-21T23:50:51.570 INFO:tasks.workunit.client.0.smithi110.stdout:6/324: rename d16/d1e/d24/l47 to d16/d1e/d24/l64 0 2024-04-21T23:50:51.600 INFO:tasks.workunit.client.0.smithi110.stdout:1/308: chown d1/dd/d23 177 1 2024-04-21T23:50:51.866 INFO:tasks.workunit.client.0.smithi110.stdout:3/325: unlink d6/d12/d14/c1b 0 2024-04-21T23:50:52.236 INFO:tasks.workunit.client.0.smithi110.stdout:4/310: rename d1/d11/d20/f53 to d1/d11/d12/f64 0 2024-04-21T23:50:52.378 INFO:tasks.workunit.client.0.smithi110.stdout:8/368: symlink d5/d24/d33/d3d/d5c/l81 0 2024-04-21T23:50:52.398 INFO:tasks.workunit.client.0.smithi110.stdout:8/369: chown d5/l34 1431412 1 2024-04-21T23:50:52.568 INFO:tasks.workunit.client.0.smithi110.stdout:5/342: write d7/d9/d17/f1c [4538846,47051] 0 2024-04-21T23:50:52.628 INFO:tasks.workunit.client.0.smithi110.stdout:3/326: fsync d6/d12/d14/d32/f4e 0 2024-04-21T23:50:53.021 INFO:tasks.workunit.client.0.smithi110.stdout:4/311: creat d1/d11/d12/f65 x:0 0 0 2024-04-21T23:50:53.042 INFO:tasks.workunit.client.0.smithi110.stdout:8/370: chown d5/da/d17/c7f 0 1 2024-04-21T23:50:53.648 INFO:tasks.workunit.client.0.smithi110.stdout:3/327: creat d6/d12/d3c/f68 x:0 0 0 2024-04-21T23:50:53.673 INFO:tasks.workunit.client.0.smithi110.stdout:3/328: readlink d6/d12/d14/l21 0 2024-04-21T23:50:53.902 INFO:tasks.workunit.client.0.smithi110.stdout:0/340: rename d0/d25/l2d to d0/d27/l73 0 2024-04-21T23:50:54.133 INFO:tasks.workunit.client.0.smithi110.stdout:5/343: creat d7/d9/d17/d48/f63 x:0 0 0 2024-04-21T23:50:54.164 INFO:tasks.workunit.client.0.smithi110.stdout:7/343: write d10/d45/f52 [2511450,115365] 0 2024-04-21T23:50:54.646 INFO:tasks.workunit.client.0.smithi110.stdout:3/329: dread f0 [0,4194304] 0 2024-04-21T23:50:54.884 INFO:tasks.workunit.client.0.smithi110.stdout:9/339: rename d1/d29/d2a/d3c/l5b to d1/d29/d2a/d2b/d58/l71 0 2024-04-21T23:50:55.039 INFO:tasks.workunit.client.0.smithi110.stdout:7/344: creat d10/d2b/f7c x:0 0 0 2024-04-21T23:50:55.215 INFO:tasks.workunit.client.0.smithi110.stdout:1/309: dwrite d1/d2/f25 [0,4194304] 0 2024-04-21T23:50:55.290 INFO:tasks.workunit.client.0.smithi110.stdout:3/330: truncate d6/d12/d16/d30/f46 237434 0 2024-04-21T23:50:55.400 INFO:tasks.workunit.client.0.smithi110.stdout:0/341: mknod d0/c74 0 2024-04-21T23:50:55.414 INFO:tasks.workunit.client.0.smithi110.stdout:1/310: sync 2024-04-21T23:50:55.525 INFO:tasks.workunit.client.0.smithi110.stdout:5/344: fdatasync d7/d35/f4c 0 2024-04-21T23:50:55.714 INFO:tasks.workunit.client.0.smithi110.stdout:2/329: rename d9/d37 to d9/d1a/d1d/d4a/d6b 0 2024-04-21T23:50:57.443 INFO:tasks.workunit.client.0.smithi110.stdout:8/371: dwrite d5/fe [0,4194304] 0 2024-04-21T23:50:57.591 INFO:tasks.workunit.client.0.smithi110.stdout:6/325: rename d16/f1c to d16/d1d/d5c/f65 0 2024-04-21T23:50:57.849 INFO:tasks.workunit.client.0.smithi110.stdout:9/340: write d1/d29/f2e [2926957,128464] 0 2024-04-21T23:50:57.931 INFO:tasks.workunit.client.0.smithi110.stdout:1/311: creat d1/d1d/f68 x:0 0 0 2024-04-21T23:50:58.316 INFO:tasks.workunit.client.0.smithi110.stdout:7/345: dwrite d10/d15/d22/f6e [0,4194304] 0 2024-04-21T23:50:58.438 INFO:tasks.workunit.client.0.smithi110.stdout:7/346: stat d10/d15/f2e 0 2024-04-21T23:50:58.492 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:50:58.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:50:58.586 INFO:tasks.workunit.client.0.smithi110.stdout:8/372: truncate d5/da/d17/f5d 844420 0 2024-04-21T23:50:58.755 INFO:tasks.workunit.client.0.smithi110.stdout:0/342: getdents d0/d25/d5a 0 2024-04-21T23:50:58.911 INFO:tasks.workunit.client.0.smithi110.stdout:5/345: write d7/d24/d37/d38/f4d [10316708,53701] 0 2024-04-21T23:50:58.980 INFO:tasks.workunit.client.0.smithi110.stdout:3/331: truncate d6/d12/d16/d30/f35 265236 0 2024-04-21T23:50:59.155 INFO:tasks.workunit.client.0.smithi110.stdout:7/347: symlink d10/d45/d4d/l7d 0 2024-04-21T23:50:59.161 INFO:tasks.workunit.client.0.smithi110.stdout:2/330: write d9/d25/d1b/f3b [4543407,88791] 0 2024-04-21T23:50:59.410 INFO:tasks.workunit.client.0.smithi110.stdout:8/373: mkdir d5/d24/d33/d3d/d82 0 2024-04-21T23:50:59.710 INFO:tasks.workunit.client.0.smithi110.stdout:5/346: mkdir d7/d24/d49/d64 0 2024-04-21T23:50:59.735 INFO:tasks.workunit.client.0.smithi110.stdout:5/347: dread - d7/d9/f3d zero size 2024-04-21T23:50:59.754 INFO:tasks.workunit.client.0.smithi110.stdout:5/348: chown d7/d22/d5b 9 1 2024-04-21T23:51:00.078 INFO:tasks.workunit.client.0.smithi110.stdout:2/331: creat d9/d1a/d1d/d2b/d5b/f6c x:0 0 0 2024-04-21T23:51:00.191 INFO:tasks.workunit.client.0.smithi110.stdout:4/312: rename d1/d11/d20/f34 to d1/d11/f66 0 2024-04-21T23:51:00.698 INFO:tasks.workunit.client.0.smithi110.stdout:5/349: rmdir d7/d24/d37/d38 39 2024-04-21T23:51:01.014 INFO:tasks.workunit.client.0.smithi110.stdout:7/348: symlink d10/d15/d22/l7e 0 2024-04-21T23:51:01.080 INFO:tasks.workunit.client.0.smithi110.stdout:5/350: dread d7/d35/f4c [0,4194304] 0 2024-04-21T23:51:01.356 INFO:tasks.workunit.client.0.smithi110.stdout:2/332: dread d9/d25/d1b/d60/f67 [0,4194304] 0 2024-04-21T23:51:01.477 INFO:tasks.workunit.client.0.smithi110.stdout:8/374: creat d5/d6f/d71/f83 x:0 0 0 2024-04-21T23:51:01.537 INFO:tasks.workunit.client.0.smithi110.stdout:9/341: write d1/d29/d4d/f68 [1571578,10350] 0 2024-04-21T23:51:01.632 INFO:tasks.workunit.client.0.smithi110.stdout:1/312: write d1/dd/d23/f54 [533279,56955] 0 2024-04-21T23:51:01.768 INFO:tasks.workunit.client.0.smithi110.stdout:9/342: dread d1/d29/d2a/d3c/f53 [0,4194304] 0 2024-04-21T23:51:01.794 INFO:tasks.workunit.client.0.smithi110.stdout:6/326: truncate d16/d1e/f2a 2951947 0 2024-04-21T23:51:02.046 INFO:tasks.workunit.client.0.smithi110.stdout:0/343: rename d0/d14/d23/d3b/l49 to d0/d25/d5a/l75 0 2024-04-21T23:51:02.079 INFO:tasks.workunit.client.0.smithi110.stdout:0/344: chown d0/d14/d23/f45 1045 1 2024-04-21T23:51:02.289 INFO:tasks.workunit.client.0.smithi110.stdout:2/333: truncate d9/f10 749982 0 2024-04-21T23:51:02.302 INFO:tasks.workunit.client.0.smithi110.stdout:2/334: readlink d9/lb 0 2024-04-21T23:51:02.590 INFO:tasks.workunit.client.0.smithi110.stdout:1/313: dread d1/d2/d14/d16/d29/f32 [0,4194304] 0 2024-04-21T23:51:02.642 INFO:tasks.workunit.client.0.smithi110.stdout:6/327: mkdir d16/d1e/d24/d66 0 2024-04-21T23:51:02.708 INFO:tasks.workunit.client.0.smithi110.stdout:3/332: write d6/d12/d14/f53 [511825,76438] 0 2024-04-21T23:51:02.783 INFO:tasks.workunit.client.0.smithi110.stdout:3/333: chown d6/d12/d14/c15 179482804 1 2024-04-21T23:51:03.024 INFO:tasks.workunit.client.0.smithi110.stdout:6/328: sync 2024-04-21T23:51:03.637 INFO:tasks.workunit.client.0.smithi110.stdout:3/334: dread d6/d12/d16/d30/f51 [0,4194304] 0 2024-04-21T23:51:03.856 INFO:tasks.workunit.client.0.smithi110.stdout:0/345: rename d0/d16/c1f to d0/d25/c76 0 2024-04-21T23:51:04.358 INFO:tasks.workunit.client.0.smithi110.stdout:3/335: stat d6/f34 0 2024-04-21T23:51:04.472 INFO:tasks.workunit.client.0.smithi110.stdout:6/329: creat d16/d3d/d40/d46/f67 x:0 0 0 2024-04-21T23:51:04.572 INFO:tasks.workunit.client.0.smithi110.stdout:6/330: sync 2024-04-21T23:51:04.686 INFO:tasks.workunit.client.0.smithi110.stdout:4/313: dwrite d1/f28 [0,4194304] 0 2024-04-21T23:51:05.072 INFO:tasks.workunit.client.0.smithi110.stdout:3/336: fsync d6/d12/d16/f23 0 2024-04-21T23:51:05.159 INFO:tasks.workunit.client.0.smithi110.stdout:7/349: dwrite d10/f19 [0,4194304] 0 2024-04-21T23:51:05.516 INFO:tasks.workunit.client.0.smithi110.stdout:6/331: creat d16/d1e/d24/d33/f68 x:0 0 0 2024-04-21T23:51:05.606 INFO:tasks.workunit.client.0.smithi110.stdout:8/375: dwrite d5/d24/f14 [0,4194304] 0 2024-04-21T23:51:05.866 INFO:tasks.workunit.client.0.smithi110.stdout:5/351: write d7/d24/d3a/d40/f41 [3158213,116337] 0 2024-04-21T23:51:05.948 INFO:tasks.workunit.client.0.smithi110.stdout:3/337: stat d6/l18 0 2024-04-21T23:51:06.166 INFO:tasks.workunit.client.0.smithi110.stdout:9/343: dwrite d1/d29/d2a/dc/f1f [0,4194304] 0 2024-04-21T23:51:06.374 INFO:tasks.workunit.client.0.smithi110.stdout:8/376: truncate d5/d24/d33/d3d/f47 5156845 0 2024-04-21T23:51:06.733 INFO:tasks.workunit.client.0.smithi110.stdout:2/335: dwrite d9/d25/d1b/d45/d4d/f64 [8388608,4194304] 0 2024-04-21T23:51:06.986 INFO:tasks.workunit.client.0.smithi110.stdout:1/314: dwrite d1/d2/d1b/f9 [4194304,4194304] 0 2024-04-21T23:51:07.556 INFO:tasks.workunit.client.0.smithi110.stdout:8/377: truncate d5/d24/d33/d3d/f46 631896 0 2024-04-21T23:51:08.011 INFO:tasks.workunit.client.0.smithi110.stdout:0/346: dwrite d0/d25/f55 [0,4194304] 0 2024-04-21T23:51:08.398 INFO:tasks.workunit.client.0.smithi110.stdout:8/378: mkdir d5/d24/d33/d84 0 2024-04-21T23:51:08.633 INFO:tasks.workunit.client.0.smithi110.stdout:7/350: write d10/d45/d51/d58/f72 [638161,125734] 0 2024-04-21T23:51:08.723 INFO:tasks.workunit.client.0.smithi110.stdout:4/314: dwrite d1/d11/d20/d23/d1c/d40/f5a [0,4194304] 0 2024-04-21T23:51:08.814 INFO:tasks.workunit.client.0.smithi110.stdout:7/351: readlink d10/d2b/d39/l3a 0 2024-04-21T23:51:09.050 INFO:tasks.workunit.client.0.smithi110.stdout:5/352: write d7/d9/f21 [1738384,107414] 0 2024-04-21T23:51:09.137 INFO:tasks.workunit.client.0.smithi110.stdout:3/338: write d6/d12/d50/f64 [1462049,59124] 0 2024-04-21T23:51:09.253 INFO:tasks.workunit.client.0.smithi110.stdout:1/315: mknod d1/d2/d14/d16/d27/d3e/c69 0 2024-04-21T23:51:09.276 INFO:tasks.workunit.client.0.smithi110.stdout:9/344: write d1/d29/d2a/d6/f27 [2511284,100577] 0 2024-04-21T23:51:09.421 INFO:tasks.workunit.client.0.smithi110.stdout:3/339: readlink d6/d12/d16/l1c 0 2024-04-21T23:51:09.465 INFO:tasks.workunit.client.0.smithi110.stdout:7/352: dread d10/d15/d22/d2c/f31 [0,4194304] 0 2024-04-21T23:51:09.556 INFO:tasks.workunit.client.0.smithi110.stdout:6/332: dwrite d16/d3d/f30 [0,4194304] 0 2024-04-21T23:51:09.868 INFO:tasks.workunit.client.0.smithi110.stdout:2/336: dwrite d9/d1a/d1d/d2b/f56 [0,4194304] 0 2024-04-21T23:51:10.063 INFO:tasks.workunit.client.0.smithi110.stdout:0/347: write d0/d27/f6b [4357660,20594] 0 2024-04-21T23:51:10.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/345: mknod d1/d29/d4d/c72 0 2024-04-21T23:51:10.165 INFO:tasks.workunit.client.0.smithi110.stdout:0/348: chown d0/d14/f6e 500 1 2024-04-21T23:51:10.179 INFO:tasks.workunit.client.0.smithi110.stdout:9/346: readlink d1/d29/d2a/d6/d1d/l35 0 2024-04-21T23:51:10.241 INFO:tasks.workunit.client.0.smithi110.stdout:7/353: mkdir d10/d2b/d39/d7f 0 2024-04-21T23:51:10.474 INFO:tasks.workunit.client.0.smithi110.stdout:7/354: dread f9 [4194304,4194304] 0 2024-04-21T23:51:10.703 INFO:tasks.workunit.client.0.smithi110.stdout:8/379: rename d5/d24/f45 to d5/da/d17/f85 0 2024-04-21T23:51:10.793 INFO:tasks.workunit.client.0.smithi110.stdout:2/337: fsync d9/d25/d1b/f3d 0 2024-04-21T23:51:10.976 INFO:tasks.workunit.client.0.smithi110.stdout:0/349: creat d0/d25/d5a/d63/f77 x:0 0 0 2024-04-21T23:51:11.236 INFO:tasks.workunit.client.0.smithi110.stdout:6/333: read d16/d1d/d5c/f65 [3618537,95323] 0 2024-04-21T23:51:11.598 INFO:tasks.workunit.client.0.smithi110.stdout:4/315: rename d1/d11/d20/c24 to d1/d11/d12/d26/d5f/c67 0 2024-04-21T23:51:11.739 INFO:tasks.workunit.client.0.smithi110.stdout:1/316: dwrite d1/f40 [0,4194304] 0 2024-04-21T23:51:11.752 INFO:tasks.workunit.client.0.smithi110.stdout:2/338: symlink d9/d25/d1b/l6d 0 2024-04-21T23:51:11.863 INFO:tasks.workunit.client.0.smithi110.stdout:1/317: readlink d1/d2/d14/l4c 0 2024-04-21T23:51:12.904 INFO:tasks.workunit.client.0.smithi110.stdout:6/334: dread d16/d1e/d24/d33/f39 [0,4194304] 0 2024-04-21T23:51:12.950 INFO:tasks.workunit.client.0.smithi110.stdout:3/340: dwrite d6/f45 [0,4194304] 0 2024-04-21T23:51:13.110 INFO:tasks.workunit.client.0.smithi110.stdout:5/353: rename d7/d9/l1a to d7/d24/d49/d61/l65 0 2024-04-21T23:51:13.117 INFO:tasks.workunit.client.0.smithi110.stdout:9/347: write d1/d29/d2a/d2b/d58/f63 [68994,16341] 0 2024-04-21T23:51:13.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/354: sync 2024-04-21T23:51:13.482 INFO:tasks.workunit.client.0.smithi110.stdout:8/380: write d5/f54 [3424606,129036] 0 2024-04-21T23:51:13.941 INFO:tasks.workunit.client.0.smithi110.stdout:0/350: dwrite d0/d27/d4b/f54 [0,4194304] 0 2024-04-21T23:51:13.956 INFO:tasks.workunit.client.0.smithi110.stdout:3/341: rmdir d6/d12 39 2024-04-21T23:51:14.057 INFO:tasks.workunit.client.0.smithi110.stdout:6/335: symlink d16/d3d/d40/l69 0 2024-04-21T23:51:14.142 INFO:tasks.workunit.client.0.smithi110.stdout:7/355: rename d10/d45/d4d to d10/d2b/d39/d7f/d80 0 2024-04-21T23:51:14.156 INFO:tasks.workunit.client.0.smithi110.stdout:2/339: truncate d9/d25/f5e 633178 0 2024-04-21T23:51:14.175 INFO:tasks.workunit.client.0.smithi110.stdout:9/348: symlink d1/d29/d2a/d3c/l73 0 2024-04-21T23:51:14.198 INFO:tasks.workunit.client.0.smithi110.stdout:4/316: dwrite d1/d11/d20/d23/d1c/d40/f63 [0,4194304] 0 2024-04-21T23:51:14.324 INFO:tasks.workunit.client.0.smithi110.stdout:5/355: fsync d7/d9/d17/d48/f63 0 2024-04-21T23:51:14.726 INFO:tasks.workunit.client.0.smithi110.stdout:1/318: mknod d1/d2/d14/d16/d27/c6a 0 2024-04-21T23:51:15.256 INFO:tasks.workunit.client.0.smithi110.stdout:6/336: mkdir d16/d1d/d38/d48/d5e/d6a 0 2024-04-21T23:51:15.271 INFO:tasks.workunit.client.0.smithi110.stdout:4/317: creat d1/d11/d12/f68 x:0 0 0 2024-04-21T23:51:15.343 INFO:tasks.workunit.client.0.smithi110.stdout:6/337: stat d16/d1e/d24 0 2024-04-21T23:51:15.491 INFO:tasks.workunit.client.0.smithi110.stdout:7/356: dread d10/f23 [0,4194304] 0 2024-04-21T23:51:15.551 INFO:tasks.workunit.client.0.smithi110.stdout:6/338: chown d16/d1d/d38/d48/d5e/d6a 48193 1 2024-04-21T23:51:15.624 INFO:tasks.workunit.client.0.smithi110.stdout:0/351: write d0/d14/f1c [2155586,61638] 0 2024-04-21T23:51:15.736 INFO:tasks.workunit.client.0.smithi110.stdout:2/340: dread d9/d1a/d1d/d4e/f5f [0,4194304] 0 2024-04-21T23:51:15.923 INFO:tasks.workunit.client.0.smithi110.stdout:1/319: rmdir d1/d1d/d4a 39 2024-04-21T23:51:16.185 INFO:tasks.workunit.client.0.smithi110.stdout:7/357: rename d10/d2b/c57 to d10/d27/c81 0 2024-04-21T23:51:16.214 INFO:tasks.workunit.client.0.smithi110.stdout:7/358: chown d10/d2b/d46/d69 591403 1 2024-04-21T23:51:16.355 INFO:tasks.workunit.client.0.smithi110.stdout:6/339: creat d16/d1d/d38/d48/d5e/f6b x:0 0 0 2024-04-21T23:51:16.407 INFO:tasks.workunit.client.0.smithi110.stdout:2/341: rmdir d9/d25/d1c 39 2024-04-21T23:51:16.533 INFO:tasks.workunit.client.0.smithi110.stdout:9/349: dwrite d1/d29/d2a/d6/fe [0,4194304] 0 2024-04-21T23:51:16.648 INFO:tasks.workunit.client.0.smithi110.stdout:0/352: truncate d0/d14/f32 1028439 0 2024-04-21T23:51:16.713 INFO:tasks.workunit.client.0.smithi110.stdout:5/356: write d7/d24/d3a/d40/f41 [1545833,8297] 0 2024-04-21T23:51:16.820 INFO:tasks.workunit.client.0.smithi110.stdout:8/381: write d5/da/d17/f7a [9177877,111276] 0 2024-04-21T23:51:17.253 INFO:tasks.workunit.client.0.smithi110.stdout:7/359: rename d10/f19 to d10/d27/f82 0 2024-04-21T23:51:17.432 INFO:tasks.workunit.client.0.smithi110.stdout:1/320: dread d1/d2/d1b/f9 [0,4194304] 0 2024-04-21T23:51:17.478 INFO:tasks.workunit.client.0.smithi110.stdout:7/360: chown d10/d45/d60/d5e/d65/f7a 240 1 2024-04-21T23:51:17.586 INFO:tasks.workunit.client.0.smithi110.stdout:4/318: write d1/d11/d12/f65 [96463,92742] 0 2024-04-21T23:51:17.684 INFO:tasks.workunit.client.0.smithi110.stdout:0/353: symlink d0/d16/l78 0 2024-04-21T23:51:17.714 INFO:tasks.workunit.client.0.smithi110.stdout:0/354: chown d0/d16/d42/f61 42498 1 2024-04-21T23:51:17.753 INFO:tasks.workunit.client.0.smithi110.stdout:9/350: fsync d1/d29/d2a/dc/d30/f61 0 2024-04-21T23:51:18.872 INFO:tasks.workunit.client.0.smithi110.stdout:0/355: creat d0/d25/f79 x:0 0 0 2024-04-21T23:51:18.913 INFO:tasks.workunit.client.0.smithi110.stdout:0/356: chown d0/d14/d23/d3b/c3d 27910 1 2024-04-21T23:51:19.499 INFO:tasks.workunit.client.0.smithi110.stdout:8/382: symlink d5/d24/d33/d84/l86 0 2024-04-21T23:51:19.518 INFO:tasks.workunit.client.0.smithi110.stdout:2/342: write d9/fa [8842511,25212] 0 2024-04-21T23:51:19.644 INFO:tasks.workunit.client.0.smithi110.stdout:6/340: write d16/d1d/d38/f4f [957622,438] 0 2024-04-21T23:51:19.670 INFO:tasks.workunit.client.0.smithi110.stdout:9/351: dread d1/d29/d2a/dc/fd [0,4194304] 0 2024-04-21T23:51:19.774 INFO:tasks.workunit.client.0.smithi110.stdout:0/357: stat d0/d2a/c65 0 2024-04-21T23:51:19.912 INFO:tasks.workunit.client.0.smithi110.stdout:8/383: sync 2024-04-21T23:51:20.004 INFO:tasks.workunit.client.0.smithi110.stdout:8/384: sync 2024-04-21T23:51:20.274 INFO:tasks.workunit.client.0.smithi110.stdout:3/342: write d6/d12/d14/d3f/f49 [284782,47601] 0 2024-04-21T23:51:20.424 INFO:tasks.workunit.client.0.smithi110.stdout:4/319: creat d1/d11/f69 x:0 0 0 2024-04-21T23:51:20.596 INFO:tasks.workunit.client.0.smithi110.stdout:6/341: dread d16/d1d/f4a [0,4194304] 0 2024-04-21T23:51:20.629 INFO:tasks.workunit.client.0.smithi110.stdout:6/342: dread - d16/d1e/d24/f2c zero size 2024-04-21T23:51:20.662 INFO:tasks.workunit.client.0.smithi110.stdout:6/343: readlink d16/d1e/d24/d33/l58 0 2024-04-21T23:51:20.685 INFO:tasks.workunit.client.0.smithi110.stdout:6/344: readlink d16/d1e/d24/l50 0 2024-04-21T23:51:20.784 INFO:tasks.workunit.client.0.smithi110.stdout:9/352: symlink d1/d29/d2a/dc/l74 0 2024-04-21T23:51:20.877 INFO:tasks.workunit.client.0.smithi110.stdout:0/358: readlink d0/l1d 0 2024-04-21T23:51:20.954 INFO:tasks.workunit.client.0.smithi110.stdout:0/359: sync 2024-04-21T23:51:21.067 INFO:tasks.workunit.client.0.smithi110.stdout:5/357: link d7/d9/f16 d7/d24/d37/d38/f66 0 2024-04-21T23:51:21.078 INFO:tasks.workunit.client.0.smithi110.stdout:8/385: truncate d5/f31 2704730 0 2024-04-21T23:51:21.094 INFO:tasks.workunit.client.0.smithi110.stdout:1/321: write d1/d2/d14/d16/d29/f41 [2524289,65703] 0 2024-04-21T23:51:21.260 INFO:tasks.workunit.client.0.smithi110.stdout:4/320: fsync d1/d11/d12/d26/f30 0 2024-04-21T23:51:21.605 INFO:tasks.workunit.client.0.smithi110.stdout:9/353: rename d1/d29/d2a/dc/d30/f31 to d1/d29/d6f/f75 0 2024-04-21T23:51:22.135 INFO:tasks.workunit.client.0.smithi110.stdout:7/361: write d10/f5f [1285446,128898] 0 2024-04-21T23:51:22.177 INFO:tasks.workunit.client.0.smithi110.stdout:5/358: fsync d7/d35/f47 0 2024-04-21T23:51:22.487 INFO:tasks.workunit.client.0.smithi110.stdout:3/343: symlink d6/d12/l69 0 2024-04-21T23:51:22.663 INFO:tasks.workunit.client.0.smithi110.stdout:8/386: read d5/d24/d33/d3d/f47 [3922009,51638] 0 2024-04-21T23:51:22.774 INFO:tasks.workunit.client.0.smithi110.stdout:1/322: dread d1/dd/d23/f24 [0,4194304] 0 2024-04-21T23:51:23.037 INFO:tasks.workunit.client.0.smithi110.stdout:2/343: dwrite d9/d1a/d1d/d2b/f69 [0,4194304] 0 2024-04-21T23:51:23.301 INFO:tasks.workunit.client.0.smithi110.stdout:0/360: write d0/d2a/f57 [629770,60094] 0 2024-04-21T23:51:24.253 INFO:tasks.workunit.client.0.smithi110.stdout:8/387: rmdir d5/da/d17/d6c 39 2024-04-21T23:51:24.386 INFO:tasks.workunit.client.0.smithi110.stdout:1/323: unlink d1/d2/d1b/d10/f2c 0 2024-04-21T23:51:24.439 INFO:tasks.workunit.client.0.smithi110.stdout:9/354: mkdir d1/d52/d76 0 2024-04-21T23:51:25.093 INFO:tasks.workunit.client.0.smithi110.stdout:0/361: dread d0/d14/f32 [0,4194304] 0 2024-04-21T23:51:25.143 INFO:tasks.workunit.client.0.smithi110.stdout:6/345: link d16/d3d/d40/f5b d16/d1e/f6c 0 2024-04-21T23:51:25.317 INFO:tasks.workunit.client.0.smithi110.stdout:4/321: dwrite d1/d11/d20/d23/d3c/d5e/f61 [0,4194304] 0 2024-04-21T23:51:25.582 INFO:tasks.workunit.client.0.smithi110.stdout:2/344: creat d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e x:0 0 0 2024-04-21T23:51:25.588 INFO:tasks.workunit.client.0.smithi110.stdout:5/359: write d7/f27 [4337071,130582] 0 2024-04-21T23:51:25.594 INFO:tasks.workunit.client.0.smithi110.stdout:9/355: dread - d1/f5d zero size 2024-04-21T23:51:25.711 INFO:tasks.workunit.client.0.smithi110.stdout:7/362: dwrite f6 [0,4194304] 0 2024-04-21T23:51:25.918 INFO:tasks.workunit.client.0.smithi110.stdout:3/344: creat d6/f6a x:0 0 0 2024-04-21T23:51:25.944 INFO:tasks.workunit.client.0.smithi110.stdout:8/388: dread d5/f3f [0,4194304] 0 2024-04-21T23:51:26.312 INFO:tasks.workunit.client.0.smithi110.stdout:6/346: dread f4 [0,4194304] 0 2024-04-21T23:51:26.413 INFO:tasks.workunit.client.0.smithi110.stdout:5/360: dwrite d7/d9/f33 [0,4194304] 0 2024-04-21T23:51:26.565 INFO:tasks.workunit.client.0.smithi110.stdout:2/345: fdatasync d9/d1a/f1e 0 2024-04-21T23:51:26.866 INFO:tasks.workunit.client.0.smithi110.stdout:9/356: creat d1/d29/d2a/d6/f77 x:0 0 0 2024-04-21T23:51:27.172 INFO:tasks.workunit.client.0.smithi110.stdout:0/362: symlink d0/d14/d23/l7a 0 2024-04-21T23:51:27.342 INFO:tasks.workunit.client.0.smithi110.stdout:8/389: creat d5/da/d17/d7c/f87 x:0 0 0 2024-04-21T23:51:27.423 INFO:tasks.workunit.client.0.smithi110.stdout:1/324: creat d1/d2/d14/d16/d27/f6b x:0 0 0 2024-04-21T23:51:27.665 INFO:tasks.workunit.client.0.smithi110.stdout:3/345: rename d6/d12/d14/d3f/l58 to d6/d12/d14/d4b/l6b 0 2024-04-21T23:51:28.089 INFO:tasks.workunit.client.0.smithi110.stdout:6/347: creat d16/d3d/d40/d46/f6d x:0 0 0 2024-04-21T23:51:28.105 INFO:tasks.workunit.client.0.smithi110.stdout:5/361: truncate d7/d9/d17/f2c 441087 0 2024-04-21T23:51:28.167 INFO:tasks.workunit.client.0.smithi110.stdout:2/346: dread d9/d25/f46 [0,4194304] 0 2024-04-21T23:51:28.364 INFO:tasks.workunit.client.0.smithi110.stdout:8/390: rmdir d5/d24/d33/d3d 39 2024-04-21T23:51:28.482 INFO:tasks.workunit.client.0.smithi110.stdout:1/325: unlink d1/d2/d14/d16/d29/l2f 0 2024-04-21T23:51:28.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:51:28.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:51:28.761 INFO:tasks.workunit.client.0.smithi110.stdout:3/346: creat d6/d12/d50/f6c x:0 0 0 2024-04-21T23:51:29.046 INFO:tasks.workunit.client.0.smithi110.stdout:5/362: read d7/d9/f16 [203829,77466] 0 2024-04-21T23:51:29.183 INFO:tasks.workunit.client.0.smithi110.stdout:9/357: truncate d1/d29/d6f/f75 175362 0 2024-04-21T23:51:29.290 INFO:tasks.workunit.client.0.smithi110.stdout:2/347: dread - d9/d1a/d1d/d4a/d6b/d3a/f61 zero size 2024-04-21T23:51:29.446 INFO:tasks.workunit.client.0.smithi110.stdout:0/363: fsync d0/fa 0 2024-04-21T23:51:29.473 INFO:tasks.workunit.client.0.smithi110.stdout:7/363: write d10/d2b/d39/f4e [92363,54516] 0 2024-04-21T23:51:29.535 INFO:tasks.workunit.client.0.smithi110.stdout:7/364: chown d10/d2b/c35 692 1 2024-04-21T23:51:29.568 INFO:tasks.workunit.client.0.smithi110.stdout:7/365: chown d10/d2b/d46/l6c 3614876 1 2024-04-21T23:51:30.216 INFO:tasks.workunit.client.0.smithi110.stdout:4/322: getdents d1 0 2024-04-21T23:51:30.644 INFO:tasks.workunit.client.0.smithi110.stdout:6/348: creat d16/d1e/d24/d66/f6e x:0 0 0 2024-04-21T23:51:30.726 INFO:tasks.workunit.client.0.smithi110.stdout:5/363: rmdir d7/d22/d5b 39 2024-04-21T23:51:31.046 INFO:tasks.workunit.client.0.smithi110.stdout:2/348: symlink d9/d1a/d1d/d4a/l6f 0 2024-04-21T23:51:31.470 INFO:tasks.workunit.client.0.smithi110.stdout:7/366: symlink d10/d45/d51/d58/l83 0 2024-04-21T23:51:31.487 INFO:tasks.workunit.client.0.smithi110.stdout:7/367: chown d10/f1d 0 1 2024-04-21T23:51:31.545 INFO:tasks.workunit.client.0.smithi110.stdout:1/326: symlink d1/l6c 0 2024-04-21T23:51:31.568 INFO:tasks.workunit.client.0.smithi110.stdout:1/327: chown d1/d2/f2d 2 1 2024-04-21T23:51:31.862 INFO:tasks.workunit.client.0.smithi110.stdout:8/391: dwrite d5/d24/f14 [0,4194304] 0 2024-04-21T23:51:31.953 INFO:tasks.workunit.client.0.smithi110.stdout:6/349: rmdir d16/d1d 39 2024-04-21T23:51:32.062 INFO:tasks.workunit.client.0.smithi110.stdout:5/364: rename d7/d24/d37/d38/c4b to d7/d24/d49/c67 0 2024-04-21T23:51:32.110 INFO:tasks.workunit.client.0.smithi110.stdout:5/365: chown d7/d35/f4c 3281567 1 2024-04-21T23:51:32.646 INFO:tasks.workunit.client.0.smithi110.stdout:4/323: getdents d1/d11/d20/d58 0 2024-04-21T23:51:32.689 INFO:tasks.workunit.client.0.smithi110.stdout:1/328: truncate d1/d2/d1b/f11 2802105 0 2024-04-21T23:51:33.101 INFO:tasks.workunit.client.0.smithi110.stdout:9/358: dwrite d1/d29/d2a/d6/f27 [0,4194304] 0 2024-04-21T23:51:33.226 INFO:tasks.workunit.client.0.smithi110.stdout:9/359: stat d1/d19/d42/f6b 0 2024-04-21T23:51:33.342 INFO:tasks.workunit.client.0.smithi110.stdout:2/349: rename d9/d25/d1b/f3d to d9/d1a/d1d/d2b/d54/f70 0 2024-04-21T23:51:33.371 INFO:tasks.workunit.client.0.smithi110.stdout:8/392: chown d5/da/d17/d6c/d72/d73 17420023 1 2024-04-21T23:51:33.816 INFO:tasks.workunit.client.0.smithi110.stdout:3/347: write d6/f38 [3125735,4873] 0 2024-04-21T23:51:34.401 INFO:tasks.workunit.client.0.smithi110.stdout:9/360: truncate d1/d29/d2a/d6/f56 2999037 0 2024-04-21T23:51:34.417 INFO:tasks.workunit.client.0.smithi110.stdout:0/364: write d0/f1e [1569889,130230] 0 2024-04-21T23:51:34.508 INFO:tasks.workunit.client.0.smithi110.stdout:7/368: write f5 [1210454,105223] 0 2024-04-21T23:51:34.585 INFO:tasks.workunit.client.0.smithi110.stdout:5/366: mkdir d7/d22/d5b/d68 0 2024-04-21T23:51:34.596 INFO:tasks.workunit.client.0.smithi110.stdout:7/369: stat d10/f34 0 2024-04-21T23:51:34.671 INFO:tasks.workunit.client.0.smithi110.stdout:8/393: mkdir d5/da/d88 0 2024-04-21T23:51:34.918 INFO:tasks.workunit.client.0.smithi110.stdout:2/350: dread d9/d25/f2f [0,4194304] 0 2024-04-21T23:51:35.113 INFO:tasks.workunit.client.0.smithi110.stdout:6/350: rmdir d16/d3d/d40 39 2024-04-21T23:51:35.114 INFO:tasks.workunit.client.0.smithi110.stdout:8/394: sync 2024-04-21T23:51:35.324 INFO:tasks.workunit.client.0.smithi110.stdout:9/361: fdatasync d1/d29/d2a/dc/fd 0 2024-04-21T23:51:35.330 INFO:tasks.workunit.client.0.smithi110.stdout:7/370: fsync d10/d15/f2e 0 2024-04-21T23:51:35.536 INFO:tasks.workunit.client.0.smithi110.stdout:1/329: link d1/f39 d1/dd/f6d 0 2024-04-21T23:51:35.576 INFO:tasks.workunit.client.0.smithi110.stdout:8/395: creat d5/d6f/f89 x:0 0 0 2024-04-21T23:51:35.587 INFO:tasks.workunit.client.0.smithi110.stdout:0/365: truncate d0/f21 383588 0 2024-04-21T23:51:35.628 INFO:tasks.workunit.client.0.smithi110.stdout:2/351: read d9/d25/f5e [338024,39300] 0 2024-04-21T23:51:35.689 INFO:tasks.workunit.client.0.smithi110.stdout:0/366: readlink d0/d14/l35 0 2024-04-21T23:51:35.817 INFO:tasks.workunit.client.0.smithi110.stdout:7/371: rmdir d10/d2b/d39/d7f/d80/d53 39 2024-04-21T23:51:36.291 INFO:tasks.workunit.client.0.smithi110.stdout:4/324: unlink d1/d11/d20/d23/f2f 0 2024-04-21T23:51:36.407 INFO:tasks.workunit.client.0.smithi110.stdout:8/396: unlink d5/da/l16 0 2024-04-21T23:51:36.447 INFO:tasks.workunit.client.0.smithi110.stdout:8/397: write d5/d6f/f89 [265256,79555] 0 2024-04-21T23:51:37.605 INFO:tasks.workunit.client.0.smithi110.stdout:2/352: symlink d9/d25/d1b/d45/d50/d68/l71 0 2024-04-21T23:51:37.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/348: write d6/d12/d14/d4b/f5b [4885502,109261] 0 2024-04-21T23:51:38.102 INFO:tasks.workunit.client.0.smithi110.stdout:8/398: mknod d5/d4f/d79/c8a 0 2024-04-21T23:51:38.225 INFO:tasks.workunit.client.0.smithi110.stdout:3/349: creat d6/d12/d14/d32/f6d x:0 0 0 2024-04-21T23:51:38.382 INFO:tasks.workunit.client.0.smithi110.stdout:2/353: creat d9/d25/d1b/d60/f72 x:0 0 0 2024-04-21T23:51:38.460 INFO:tasks.workunit.client.0.smithi110.stdout:5/367: dwrite d7/f58 [0,4194304] 0 2024-04-21T23:51:38.628 INFO:tasks.workunit.client.0.smithi110.stdout:8/399: chown d5/ff 1413449959 1 2024-04-21T23:51:38.686 INFO:tasks.workunit.client.0.smithi110.stdout:3/350: mknod d6/d12/d14/d3f/c6e 0 2024-04-21T23:51:38.881 INFO:tasks.workunit.client.0.smithi110.stdout:2/354: fdatasync d9/d1a/f1e 0 2024-04-21T23:51:39.001 INFO:tasks.workunit.client.0.smithi110.stdout:9/362: dwrite d1/d29/d4d/f68 [0,4194304] 0 2024-04-21T23:51:39.182 INFO:tasks.workunit.client.0.smithi110.stdout:3/351: unlink f0 0 2024-04-21T23:51:39.435 INFO:tasks.workunit.client.0.smithi110.stdout:6/351: dwrite d16/d3d/d40/f4b [0,4194304] 0 2024-04-21T23:51:39.634 INFO:tasks.workunit.client.0.smithi110.stdout:8/400: creat d5/d24/d33/d3d/d5c/f8b x:0 0 0 2024-04-21T23:51:39.671 INFO:tasks.workunit.client.0.smithi110.stdout:6/352: sync 2024-04-21T23:51:39.747 INFO:tasks.workunit.client.0.smithi110.stdout:1/330: dwrite d1/d2/d1b/fc [0,4194304] 0 2024-04-21T23:51:40.076 INFO:tasks.workunit.client.0.smithi110.stdout:0/367: dwrite d0/d16/f26 [4194304,4194304] 0 2024-04-21T23:51:40.187 INFO:tasks.workunit.client.0.smithi110.stdout:9/363: fsync d1/d29/d2a/d6/d1d/f5e 0 2024-04-21T23:51:40.254 INFO:tasks.workunit.client.0.smithi110.stdout:4/325: write d1/d11/d12/f18 [871944,80374] 0 2024-04-21T23:51:40.638 INFO:tasks.workunit.client.0.smithi110.stdout:2/355: dread d9/d25/d1b/d45/d4d/f64 [0,4194304] 0 2024-04-21T23:51:40.761 INFO:tasks.workunit.client.0.smithi110.stdout:7/372: write d10/d15/f21 [3790922,81382] 0 2024-04-21T23:51:41.149 INFO:tasks.workunit.client.0.smithi110.stdout:6/353: symlink d16/d1d/d38/l6f 0 2024-04-21T23:51:41.175 INFO:tasks.workunit.client.0.smithi110.stdout:6/354: chown d16/d3d/d40/d46 4564 1 2024-04-21T23:51:41.660 INFO:tasks.workunit.client.0.smithi110.stdout:2/356: creat d9/d25/d1b/d45/d4d/f73 x:0 0 0 2024-04-21T23:51:41.732 INFO:tasks.workunit.client.0.smithi110.stdout:5/368: write d7/d24/f53 [755067,20412] 0 2024-04-21T23:51:42.555 INFO:tasks.workunit.client.0.smithi110.stdout:3/352: getdents d6/d12/d14 0 2024-04-21T23:51:42.686 INFO:tasks.workunit.client.0.smithi110.stdout:6/355: mkdir d16/d1d/d38/d48/d5e/d6a/d70 0 2024-04-21T23:51:43.146 INFO:tasks.workunit.client.0.smithi110.stdout:3/353: truncate d6/d12/d16/f2a 926698 0 2024-04-21T23:51:43.349 INFO:tasks.workunit.client.0.smithi110.stdout:6/356: rmdir d16/d1d/d38/d48 39 2024-04-21T23:51:44.266 INFO:tasks.workunit.client.0.smithi110.stdout:6/357: fsync d16/d1d/d38/f45 0 2024-04-21T23:51:44.299 INFO:tasks.workunit.client.0.smithi110.stdout:8/401: write d5/da/d17/f22 [1854369,68292] 0 2024-04-21T23:51:44.315 INFO:tasks.workunit.client.0.smithi110.stdout:2/357: getdents d9/d1a/d1d/d4a 0 2024-04-21T23:51:44.391 INFO:tasks.workunit.client.0.smithi110.stdout:1/331: write d1/d2/d14/d16/d29/f32 [1404760,87478] 0 2024-04-21T23:51:44.397 INFO:tasks.workunit.client.0.smithi110.stdout:5/369: write d7/d24/d31/f5e [11534763,88038] 0 2024-04-21T23:51:44.474 INFO:tasks.workunit.client.0.smithi110.stdout:9/364: rename d1/d29/d4d/c72 to d1/d29/d2a/c78 0 2024-04-21T23:51:44.755 INFO:tasks.workunit.client.0.smithi110.stdout:8/402: chown d5/da/d17/c30 660 1 2024-04-21T23:51:44.775 INFO:tasks.workunit.client.0.smithi110.stdout:0/368: dread d0/d16/d42/f52 [0,4194304] 0 2024-04-21T23:51:45.012 INFO:tasks.workunit.client.0.smithi110.stdout:4/326: dwrite d1/d11/d12/d26/f38 [0,4194304] 0 2024-04-21T23:51:45.100 INFO:tasks.workunit.client.0.smithi110.stdout:7/373: dwrite d10/d15/f2e [0,4194304] 0 2024-04-21T23:51:45.278 INFO:tasks.workunit.client.0.smithi110.stdout:2/358: creat d9/d25/d1b/d45/d4d/f74 x:0 0 0 2024-04-21T23:51:45.281 INFO:tasks.workunit.client.0.smithi110.stdout:9/365: read - d1/d29/f6c zero size 2024-04-21T23:51:45.564 INFO:tasks.workunit.client.0.smithi110.stdout:5/370: dread d7/d24/d37/d38/f4d [8388608,4194304] 0 2024-04-21T23:51:45.660 INFO:tasks.workunit.client.0.smithi110.stdout:3/354: dwrite d6/f38 [4194304,4194304] 0 2024-04-21T23:51:45.885 INFO:tasks.workunit.client.0.smithi110.stdout:1/332: symlink d1/d2/d1b/l6e 0 2024-04-21T23:51:46.103 INFO:tasks.workunit.client.0.smithi110.stdout:6/358: creat d16/d1e/d24/f71 x:0 0 0 2024-04-21T23:51:46.299 INFO:tasks.workunit.client.0.smithi110.stdout:4/327: mkdir d1/d11/d20/d23/d1c/d47/d4f/d6a 0 2024-04-21T23:51:46.387 INFO:tasks.workunit.client.0.smithi110.stdout:9/366: mkdir d1/d29/d2a/dc/d30/d79 0 2024-04-21T23:51:46.500 INFO:tasks.workunit.client.0.smithi110.stdout:2/359: dread d9/d25/d1b/f3b [0,4194304] 0 2024-04-21T23:51:46.560 INFO:tasks.workunit.client.0.smithi110.stdout:0/369: truncate d0/fc 145934 0 2024-04-21T23:51:46.643 INFO:tasks.workunit.client.0.smithi110.stdout:5/371: mkdir d7/d9/d17/d48/d69 0 2024-04-21T23:51:47.439 INFO:tasks.workunit.client.0.smithi110.stdout:8/403: dwrite d5/d24/d33/d3d/f66 [0,4194304] 0 2024-04-21T23:51:47.810 INFO:tasks.workunit.client.0.smithi110.stdout:7/374: write d10/d2b/f6d [268058,121165] 0 2024-04-21T23:51:47.881 INFO:tasks.workunit.client.0.smithi110.stdout:3/355: write d6/d12/d50/f64 [204264,13586] 0 2024-04-21T23:51:48.407 INFO:tasks.workunit.client.0.smithi110.stdout:5/372: chown d7/d24/d49/c67 10 1 2024-04-21T23:51:48.621 INFO:tasks.workunit.client.0.smithi110.stdout:5/373: sync 2024-04-21T23:51:48.643 INFO:tasks.workunit.client.0.smithi110.stdout:1/333: truncate d1/d2/d1b/f9 3558264 0 2024-04-21T23:51:49.042 INFO:tasks.workunit.client.0.smithi110.stdout:9/367: dwrite d1/d19/f48 [0,4194304] 0 2024-04-21T23:51:49.073 INFO:tasks.workunit.client.0.smithi110.stdout:4/328: write d1/d11/d20/d23/d1c/d40/f63 [2940825,19628] 0 2024-04-21T23:51:49.079 INFO:tasks.workunit.client.0.smithi110.stdout:7/375: symlink d10/d2b/d46/d69/l84 0 2024-04-21T23:51:49.333 INFO:tasks.workunit.client.0.smithi110.stdout:6/359: rename d16/l27 to d16/d1e/d24/d66/l72 0 2024-04-21T23:51:49.647 INFO:tasks.workunit.client.0.smithi110.stdout:2/360: dwrite d9/d25/d1b/d60/f67 [0,4194304] 0 2024-04-21T23:51:49.794 INFO:tasks.workunit.client.0.smithi110.stdout:8/404: write d5/d24/d33/d3d/f64 [976397,1245] 0 2024-04-21T23:51:49.942 INFO:tasks.workunit.client.0.smithi110.stdout:8/405: chown d5/d80 14946564 1 2024-04-21T23:51:49.999 INFO:tasks.workunit.client.0.smithi110.stdout:0/370: dwrite d0/d14/d23/f45 [0,4194304] 0 2024-04-21T23:51:50.115 INFO:tasks.workunit.client.0.smithi110.stdout:4/329: mkdir d1/d35/d6b 0 2024-04-21T23:51:50.234 INFO:tasks.workunit.client.0.smithi110.stdout:7/376: truncate d10/f1d 237657 0 2024-04-21T23:51:50.276 INFO:tasks.workunit.client.0.smithi110.stdout:6/360: symlink d16/d3d/d40/d46/l73 0 2024-04-21T23:51:50.286 INFO:tasks.workunit.client.0.smithi110.stdout:5/374: mknod d7/d24/d49/d64/c6a 0 2024-04-21T23:51:50.531 INFO:tasks.workunit.client.0.smithi110.stdout:4/330: stat d1/d11/d20/d23/d1c/d47/c46 0 2024-04-21T23:51:50.549 INFO:tasks.workunit.client.0.smithi110.stdout:1/334: dread d1/dd/f6d [0,4194304] 0 2024-04-21T23:51:50.655 INFO:tasks.workunit.client.0.smithi110.stdout:3/356: dwrite d6/d12/d14/d32/f4e [8388608,4194304] 0 2024-04-21T23:51:50.800 INFO:tasks.workunit.client.0.smithi110.stdout:9/368: dread d1/d29/d2a/d6/fe [0,4194304] 0 2024-04-21T23:51:51.005 INFO:tasks.workunit.client.0.smithi110.stdout:0/371: mknod d0/d16/d5d/c7b 0 2024-04-21T23:51:51.064 INFO:tasks.workunit.client.0.smithi110.stdout:5/375: rmdir d7/d9 39 2024-04-21T23:51:51.089 INFO:tasks.workunit.client.0.smithi110.stdout:7/377: fsync d10/d2b/d39/f4e 0 2024-04-21T23:51:51.216 INFO:tasks.workunit.client.0.smithi110.stdout:8/406: rename d5/d6f/d71 to d5/da/d17/d6c/d72/d73/d78/d8c 0 2024-04-21T23:51:51.245 INFO:tasks.workunit.client.0.smithi110.stdout:1/335: rmdir d1/d2/d14/d16/d27 39 2024-04-21T23:51:51.358 INFO:tasks.workunit.client.0.smithi110.stdout:6/361: write d16/d3d/f2b [85021,26466] 0 2024-04-21T23:51:51.383 INFO:tasks.workunit.client.0.smithi110.stdout:6/362: dread - d16/d1d/f5a zero size 2024-04-21T23:51:51.400 INFO:tasks.workunit.client.0.smithi110.stdout:6/363: stat d16/d1e/d24/f2c 0 2024-04-21T23:51:51.788 INFO:tasks.workunit.client.0.smithi110.stdout:2/361: creat d9/d1a/d1d/f75 x:0 0 0 2024-04-21T23:51:52.030 INFO:tasks.workunit.client.0.smithi110.stdout:0/372: dread d0/d16/f18 [0,4194304] 0 2024-04-21T23:51:52.065 INFO:tasks.workunit.client.0.smithi110.stdout:3/357: mkdir d6/d12/d16/d6f 0 2024-04-21T23:51:52.078 INFO:tasks.workunit.client.0.smithi110.stdout:7/378: truncate d10/f23 1271913 0 2024-04-21T23:51:52.095 INFO:tasks.workunit.client.0.smithi110.stdout:1/336: mkdir d1/d2/d14/d6f 0 2024-04-21T23:51:52.100 INFO:tasks.workunit.client.0.smithi110.stdout:5/376: fdatasync d7/d24/d37/d38/f4d 0 2024-04-21T23:51:52.849 INFO:tasks.workunit.client.0.smithi110.stdout:2/362: fsync d9/fa 0 2024-04-21T23:51:52.912 INFO:tasks.workunit.client.0.smithi110.stdout:2/363: chown d9/d1a/d1d/d4a/d6b/d3a/l58 205995 1 2024-04-21T23:51:53.440 INFO:tasks.workunit.client.0.smithi110.stdout:7/379: creat d10/d45/d51/f85 x:0 0 0 2024-04-21T23:51:53.531 INFO:tasks.workunit.client.0.smithi110.stdout:9/369: link d1/d29/d2a/dc/l74 d1/d29/d2a/dc/d30/d79/l7a 0 2024-04-21T23:51:53.633 INFO:tasks.workunit.client.0.smithi110.stdout:4/331: dwrite d1/d11/d12/f64 [0,4194304] 0 2024-04-21T23:51:53.827 INFO:tasks.workunit.client.0.smithi110.stdout:2/364: truncate d9/d1a/d1d/d4a/f4f 1052308 0 2024-04-21T23:51:54.003 INFO:tasks.workunit.client.0.smithi110.stdout:2/365: sync 2024-04-21T23:51:54.018 INFO:tasks.workunit.client.0.smithi110.stdout:8/407: dwrite d5/f39 [0,4194304] 0 2024-04-21T23:51:54.390 INFO:tasks.workunit.client.0.smithi110.stdout:6/364: write d16/d1d/d5c/f65 [5017714,128893] 0 2024-04-21T23:51:54.451 INFO:tasks.workunit.client.0.smithi110.stdout:3/358: unlink d6/d12/d16/f2a 0 2024-04-21T23:51:54.475 INFO:tasks.workunit.client.0.smithi110.stdout:8/408: dread d5/f2a [0,4194304] 0 2024-04-21T23:51:54.532 INFO:tasks.workunit.client.0.smithi110.stdout:8/409: chown d5/f54 5285072 1 2024-04-21T23:51:54.886 INFO:tasks.workunit.client.0.smithi110.stdout:4/332: rmdir d1/d11/d20/d23/d3c/d5e 39 2024-04-21T23:51:54.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/370: dread d1/d29/d2a/d6/f27 [0,4194304] 0 2024-04-21T23:51:55.098 INFO:tasks.workunit.client.0.smithi110.stdout:9/371: dread d1/d29/d2a/d6/f27 [0,4194304] 0 2024-04-21T23:51:55.481 INFO:tasks.workunit.client.0.smithi110.stdout:6/365: unlink d16/d1e/c35 0 2024-04-21T23:51:55.495 INFO:tasks.workunit.client.0.smithi110.stdout:3/359: truncate d6/d12/f1a 866677 0 2024-04-21T23:51:55.561 INFO:tasks.workunit.client.0.smithi110.stdout:8/410: chown d5/da/d17/l2e 1 1 2024-04-21T23:51:55.847 INFO:tasks.workunit.client.0.smithi110.stdout:0/373: getdents d0/d16 0 2024-04-21T23:51:55.955 INFO:tasks.workunit.client.0.smithi110.stdout:2/366: truncate d9/d1a/d1d/d2b/d54/f70 941311 0 2024-04-21T23:51:56.175 INFO:tasks.workunit.client.0.smithi110.stdout:9/372: mkdir d1/d29/d2a/d2b/d58/d7b 0 2024-04-21T23:51:56.562 INFO:tasks.workunit.client.0.smithi110.stdout:5/377: write d7/d9/d17/f51 [1772276,40260] 0 2024-04-21T23:51:56.942 INFO:tasks.workunit.client.0.smithi110.stdout:4/333: symlink d1/d35/d6b/l6c 0 2024-04-21T23:51:57.245 INFO:tasks.workunit.client.0.smithi110.stdout:0/374: mknod d0/d56/c7c 0 2024-04-21T23:51:57.414 INFO:tasks.workunit.client.0.smithi110.stdout:2/367: fsync d9/d1a/d1d/f36 0 2024-04-21T23:51:58.039 INFO:tasks.workunit.client.0.smithi110.stdout:7/380: getdents d10/d45/d60 0 2024-04-21T23:51:58.105 INFO:tasks.workunit.client.0.smithi110.stdout:8/411: truncate d5/d24/f49 2163887 0 2024-04-21T23:51:58.314 INFO:tasks.workunit.client.0.smithi110.stdout:5/378: dread d7/d9/d17/f18 [4194304,4194304] 0 2024-04-21T23:51:58.439 INFO:tasks.workunit.client.0.smithi110.stdout:5/379: read d7/d24/d37/d38/f66 [136705,38756] 0 2024-04-21T23:51:58.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:51:58.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:51:58.923 INFO:tasks.workunit.client.0.smithi110.stdout:6/366: mkdir d16/d1d/d38/d48/d5e/d6a/d70/d74 0 2024-04-21T23:51:58.941 INFO:tasks.workunit.client.0.smithi110.stdout:6/367: chown f15 5593848 1 2024-04-21T23:51:59.151 INFO:tasks.workunit.client.0.smithi110.stdout:0/375: mkdir d0/d27/d68/d7d 0 2024-04-21T23:51:59.156 INFO:tasks.workunit.client.0.smithi110.stdout:1/337: rmdir d1/dd 39 2024-04-21T23:51:59.204 INFO:tasks.workunit.client.0.smithi110.stdout:0/376: chown d0/d14/l35 3760 1 2024-04-21T23:51:59.300 INFO:tasks.workunit.client.0.smithi110.stdout:8/412: truncate d5/d24/f2c 656629 0 2024-04-21T23:51:59.324 INFO:tasks.workunit.client.0.smithi110.stdout:8/413: rename d5 to d5/d6f/d8d 22 2024-04-21T23:51:59.406 INFO:tasks.workunit.client.0.smithi110.stdout:3/360: write d6/d12/d14/d3f/f49 [1135150,21240] 0 2024-04-21T23:51:59.442 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:59:39.703 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.528 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:59:39.789 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.600 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:00:59:39.862 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.638 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:59:39.835 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.645 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:59:39.842 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.647 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:59:39.844 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.654 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:59:39.851 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.721 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:00:59:39.918 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:51:59.724 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:00:59:39.921 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:52:00.094 INFO:tasks.workunit.client.0.smithi110.stdout:9/373: dwrite d1/d29/d2a/d2b/d58/f63 [0,4194304] 0 2024-04-21T23:52:00.218 INFO:tasks.workunit.client.0.smithi110.stdout:1/338: truncate d1/ff 659342 0 2024-04-21T23:52:00.662 INFO:tasks.workunit.client.0.smithi110.stdout:2/368: dwrite d9/d25/d1b/f62 [4194304,4194304] 0 2024-04-21T23:52:00.840 INFO:tasks.workunit.client.0.smithi110.stdout:6/368: symlink d16/d1d/d38/l75 0 2024-04-21T23:52:00.964 INFO:tasks.workunit.client.0.smithi110.stdout:4/334: getdents d1/d11/d20/d23/d3c 0 2024-04-21T23:52:01.092 INFO:tasks.workunit.client.0.smithi110.stdout:7/381: link d10/d15/d22/f6e d10/d2b/d46/f86 0 2024-04-21T23:52:01.307 INFO:tasks.workunit.client.0.smithi110.stdout:0/377: symlink d0/d27/d68/d7d/l7e 0 2024-04-21T23:52:01.329 INFO:tasks.workunit.client.0.smithi110.stdout:0/378: readlink d0/d14/l35 0 2024-04-21T23:52:01.553 INFO:tasks.workunit.client.0.smithi110.stdout:9/374: creat d1/d29/d2a/d6/d1d/f7c x:0 0 0 2024-04-21T23:52:02.334 INFO:tasks.workunit.client.0.smithi110.stdout:2/369: dread - d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e zero size 2024-04-21T23:52:02.609 INFO:tasks.workunit.client.0.smithi110.stdout:5/380: symlink d7/d24/d37/l6b 0 2024-04-21T23:52:02.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/369: fdatasync d16/d1e/d24/f5d 0 2024-04-21T23:52:02.777 INFO:tasks.workunit.client.0.smithi110.stdout:7/382: mknod d10/d45/d60/d5e/c87 0 2024-04-21T23:52:03.135 INFO:tasks.workunit.client.0.smithi110.stdout:8/414: write d5/d24/d33/d3d/f64 [643652,106720] 0 2024-04-21T23:52:03.199 INFO:tasks.workunit.client.0.smithi110.stdout:9/375: fsync d1/d29/d59/f6d 0 2024-04-21T23:52:03.356 INFO:tasks.workunit.client.0.smithi110.stdout:3/361: link d6/d12/d14/d32/f6d d6/d12/d14/d32/f70 0 2024-04-21T23:52:03.440 INFO:tasks.workunit.client.0.smithi110.stdout:2/370: truncate d9/d1a/f63 435121 0 2024-04-21T23:52:03.506 INFO:tasks.workunit.client.0.smithi110.stdout:2/371: chown d9/d25/d1b/d45/d4d/l51 29 1 2024-04-21T23:52:03.810 INFO:tasks.workunit.client.0.smithi110.stdout:6/370: creat d16/d3d/d40/d46/f76 x:0 0 0 2024-04-21T23:52:03.825 INFO:tasks.workunit.client.0.smithi110.stdout:5/381: dread d7/f58 [0,4194304] 0 2024-04-21T23:52:03.895 INFO:tasks.workunit.client.0.smithi110.stdout:4/335: symlink d1/d11/d12/d26/d52/l6d 0 2024-04-21T23:52:03.943 INFO:tasks.workunit.client.0.smithi110.stdout:7/383: dread - d10/d15/d22/f44 zero size 2024-04-21T23:52:04.130 INFO:tasks.workunit.client.0.smithi110.stdout:5/382: sync 2024-04-21T23:52:04.185 INFO:tasks.workunit.client.0.smithi110.stdout:0/379: mkdir d0/d27/d4b/d7f 0 2024-04-21T23:52:04.286 INFO:tasks.workunit.client.0.smithi110.stdout:1/339: write d1/d2/d1b/f35 [663525,6495] 0 2024-04-21T23:52:04.408 INFO:tasks.workunit.client.0.smithi110.stdout:9/376: rmdir d1/d29/d2a/d2b/d58 39 2024-04-21T23:52:04.786 INFO:tasks.workunit.client.0.smithi110.stdout:6/371: creat d16/d3d/d40/f77 x:0 0 0 2024-04-21T23:52:04.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/336: truncate d1/d11/d20/f2c 2088437 0 2024-04-21T23:52:04.866 INFO:tasks.workunit.client.0.smithi110.stdout:9/377: dread d1/d29/d2a/d3c/f53 [0,4194304] 0 2024-04-21T23:52:05.072 INFO:tasks.workunit.client.0.smithi110.stdout:7/384: rename d10/d2b to d10/d45/d51/d88 0 2024-04-21T23:52:05.168 INFO:tasks.workunit.client.0.smithi110.stdout:8/415: mknod d5/da/d17/c8e 0 2024-04-21T23:52:05.667 INFO:tasks.workunit.client.0.smithi110.stdout:3/362: symlink d6/d12/d16/l71 0 2024-04-21T23:52:05.874 INFO:tasks.workunit.client.0.smithi110.stdout:9/378: truncate d1/f5d 375903 0 2024-04-21T23:52:06.324 INFO:tasks.workunit.client.0.smithi110.stdout:7/385: fdatasync d10/d15/d22/f6b 0 2024-04-21T23:52:06.882 INFO:tasks.workunit.client.0.smithi110.stdout:6/372: symlink d16/d1d/l78 0 2024-04-21T23:52:07.002 INFO:tasks.workunit.client.0.smithi110.stdout:9/379: truncate d1/d19/d42/f6b 943892 0 2024-04-21T23:52:07.070 INFO:tasks.workunit.client.0.smithi110.stdout:6/373: sync 2024-04-21T23:52:07.212 INFO:tasks.workunit.client.0.smithi110.stdout:7/386: creat d10/d45/d51/d88/d46/d69/f89 x:0 0 0 2024-04-21T23:52:07.678 INFO:tasks.workunit.client.0.smithi110.stdout:2/372: getdents d9/d1a/d1d/d2b/d54 0 2024-04-21T23:52:07.986 INFO:tasks.workunit.client.0.smithi110.stdout:6/374: creat d16/d3d/d40/d46/f79 x:0 0 0 2024-04-21T23:52:08.006 INFO:tasks.workunit.client.0.smithi110.stdout:9/380: chown d1/d29/d2a/d6/f56 248372374 1 2024-04-21T23:52:08.207 INFO:tasks.workunit.client.0.smithi110.stdout:7/387: mkdir d10/d45/d60/d5e/d65/d8a 0 2024-04-21T23:52:08.378 INFO:tasks.workunit.client.0.smithi110.stdout:8/416: link d5/d24/f2f d5/d80/f8f 0 2024-04-21T23:52:08.522 INFO:tasks.workunit.client.0.smithi110.stdout:1/340: getdents d1/d2/d30 0 2024-04-21T23:52:08.825 INFO:tasks.workunit.client.0.smithi110.stdout:3/363: link d6/d12/d14/d4b/l54 d6/d12/d16/d5d/l72 0 2024-04-21T23:52:09.039 INFO:tasks.workunit.client.0.smithi110.stdout:6/375: fsync d16/d3d/d40/d46/f56 0 2024-04-21T23:52:09.304 INFO:tasks.workunit.client.0.smithi110.stdout:7/388: creat d10/d45/d60/d5e/f8b x:0 0 0 2024-04-21T23:52:09.327 INFO:tasks.workunit.client.0.smithi110.stdout:0/380: write d0/d27/d4b/f64 [882135,901] 0 2024-04-21T23:52:09.450 INFO:tasks.workunit.client.0.smithi110.stdout:5/383: dwrite d7/d9/f16 [0,4194304] 0 2024-04-21T23:52:09.823 INFO:tasks.workunit.client.0.smithi110.stdout:3/364: creat d6/d12/d16/d30/f73 x:0 0 0 2024-04-21T23:52:10.014 INFO:tasks.workunit.client.0.smithi110.stdout:6/376: mknod d16/d1e/d24/c7a 0 2024-04-21T23:52:10.289 INFO:tasks.workunit.client.0.smithi110.stdout:8/417: fsync d5/da/d17/f85 0 2024-04-21T23:52:10.351 INFO:tasks.workunit.client.0.smithi110.stdout:4/337: write d1/d11/d20/d23/d1c/d40/f63 [712319,111375] 0 2024-04-21T23:52:10.623 INFO:tasks.workunit.client.0.smithi110.stdout:1/341: mkdir d1/d1d/d70 0 2024-04-21T23:52:10.848 INFO:tasks.workunit.client.0.smithi110.stdout:0/381: mknod d0/d14/d23/d3b/c80 0 2024-04-21T23:52:11.225 INFO:tasks.workunit.client.0.smithi110.stdout:5/384: creat d7/d22/d5b/f6c x:0 0 0 2024-04-21T23:52:11.227 INFO:tasks.workunit.client.0.smithi110.stdout:2/373: link d9/d25/d1b/f62 d9/f76 0 2024-04-21T23:52:11.450 INFO:tasks.workunit.client.0.smithi110.stdout:3/365: dread d6/d12/d50/f64 [0,4194304] 0 2024-04-21T23:52:11.478 INFO:tasks.workunit.client.0.smithi110.stdout:3/366: chown d6/d12/l69 0 1 2024-04-21T23:52:11.633 INFO:tasks.workunit.client.0.smithi110.stdout:6/377: fsync d16/d1e/f57 0 2024-04-21T23:52:12.295 INFO:tasks.workunit.client.0.smithi110.stdout:0/382: mknod d0/d14/d23/d3b/c81 0 2024-04-21T23:52:12.539 INFO:tasks.workunit.client.0.smithi110.stdout:2/374: mkdir d9/d1a/d1d/d2b/d54/d77 0 2024-04-21T23:52:12.998 INFO:tasks.workunit.client.0.smithi110.stdout:6/378: mkdir d16/d1e/d24/d7b 0 2024-04-21T23:52:13.149 INFO:tasks.workunit.client.0.smithi110.stdout:0/383: creat d0/d27/f82 x:0 0 0 2024-04-21T23:52:13.400 INFO:tasks.workunit.client.0.smithi110.stdout:9/381: dwrite d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-21T23:52:13.518 INFO:tasks.workunit.client.0.smithi110.stdout:3/367: mknod d6/d12/d16/c74 0 2024-04-21T23:52:13.672 INFO:tasks.workunit.client.0.smithi110.stdout:4/338: fdatasync d1/d11/d20/f2c 0 2024-04-21T23:52:13.791 INFO:tasks.workunit.client.0.smithi110.stdout:6/379: truncate d16/d3d/d40/d46/f67 541844 0 2024-04-21T23:52:14.167 INFO:tasks.workunit.client.0.smithi110.stdout:9/382: rename d1/d19/d42/c70 to d1/d19/d42/c7d 0 2024-04-21T23:52:14.217 INFO:tasks.workunit.client.0.smithi110.stdout:9/383: stat d1/f15 0 2024-04-21T23:52:14.238 INFO:tasks.workunit.client.0.smithi110.stdout:0/384: dread d0/d27/f6b [0,4194304] 0 2024-04-21T23:52:14.370 INFO:tasks.workunit.client.0.smithi110.stdout:6/380: rmdir d16 39 2024-04-21T23:52:14.577 INFO:tasks.workunit.client.0.smithi110.stdout:4/339: creat d1/d11/d20/d50/f6e x:0 0 0 2024-04-21T23:52:15.097 INFO:tasks.workunit.client.0.smithi110.stdout:9/384: dread d1/d19/f13 [0,4194304] 0 2024-04-21T23:52:15.191 INFO:tasks.workunit.client.0.smithi110.stdout:4/340: creat d1/d11/d20/d23/d1c/f6f x:0 0 0 2024-04-21T23:52:15.202 INFO:tasks.workunit.client.0.smithi110.stdout:7/389: write d10/d15/d22/f44 [834511,123022] 0 2024-04-21T23:52:15.751 INFO:tasks.workunit.client.0.smithi110.stdout:9/385: fdatasync d1/d19/f13 0 2024-04-21T23:52:16.337 INFO:tasks.workunit.client.0.smithi110.stdout:5/385: write d7/d35/f4c [4978535,22648] 0 2024-04-21T23:52:16.341 INFO:tasks.workunit.client.0.smithi110.stdout:1/342: write d1/d2/d14/d16/d29/f32 [1128953,72088] 0 2024-04-21T23:52:16.597 INFO:tasks.workunit.client.0.smithi110.stdout:8/418: dwrite d5/f55 [0,4194304] 0 2024-04-21T23:52:17.028 INFO:tasks.workunit.client.0.smithi110.stdout:2/375: dwrite d9/d1a/d1d/d2b/d54/f70 [0,4194304] 0 2024-04-21T23:52:17.164 INFO:tasks.workunit.client.0.smithi110.stdout:9/386: fsync d1/d29/d2a/d3c/f53 0 2024-04-21T23:52:17.468 INFO:tasks.workunit.client.0.smithi110.stdout:8/419: fsync d5/ff 0 2024-04-21T23:52:17.517 INFO:tasks.workunit.client.0.smithi110.stdout:3/368: dwrite d6/f2d [0,4194304] 0 2024-04-21T23:52:18.044 INFO:tasks.workunit.client.0.smithi110.stdout:2/376: mkdir d9/d1a/d1d/d4a/d78 0 2024-04-21T23:52:18.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/387: mknod d1/d29/d59/c7e 0 2024-04-21T23:52:18.209 INFO:tasks.workunit.client.0.smithi110.stdout:0/385: dwrite d0/fc [0,4194304] 0 2024-04-21T23:52:18.594 INFO:tasks.workunit.client.0.smithi110.stdout:3/369: dread d6/d12/f3e [0,4194304] 0 2024-04-21T23:52:18.858 INFO:tasks.workunit.client.0.smithi110.stdout:8/420: creat d5/da/d17/d6c/d72/d73/f90 x:0 0 0 2024-04-21T23:52:18.888 INFO:tasks.workunit.client.0.smithi110.stdout:7/390: link d10/f1d d10/d43/f8c 0 2024-04-21T23:52:18.892 INFO:tasks.workunit.client.0.smithi110.stdout:3/370: dwrite d6/f2d [0,4194304] 0 2024-04-21T23:52:19.027 INFO:tasks.workunit.client.0.smithi110.stdout:4/341: getdents d1/d11/d20/d23/d1c/d47/d4f/d56 0 2024-04-21T23:52:19.368 INFO:tasks.workunit.client.0.smithi110.stdout:0/386: mkdir d0/d16/d42/d50/d83 0 2024-04-21T23:52:19.425 INFO:tasks.workunit.client.0.smithi110.stdout:9/388: truncate d1/d29/f6c 302522 0 2024-04-21T23:52:19.770 INFO:tasks.workunit.client.0.smithi110.stdout:7/391: fsync f6 0 2024-04-21T23:52:19.857 INFO:tasks.workunit.client.0.smithi110.stdout:6/381: dwrite d16/f63 [0,4194304] 0 2024-04-21T23:52:20.101 INFO:tasks.workunit.client.0.smithi110.stdout:3/371: chown d6/d12/d16/d5d/l72 193126452 1 2024-04-21T23:52:20.178 INFO:tasks.workunit.client.0.smithi110.stdout:5/386: dwrite d7/d9/f21 [0,4194304] 0 2024-04-21T23:52:20.203 INFO:tasks.workunit.client.0.smithi110.stdout:8/421: mkdir d5/da/d17/d6c/d72/d73/d78/d91 0 2024-04-21T23:52:20.326 INFO:tasks.workunit.client.0.smithi110.stdout:3/372: chown d6/d12/d16/f23 3813588 1 2024-04-21T23:52:20.409 INFO:tasks.workunit.client.0.smithi110.stdout:8/422: stat d5/da/d17/d6c/d72/d73/d78/d91 0 2024-04-21T23:52:20.468 INFO:tasks.workunit.client.0.smithi110.stdout:8/423: chown d5/c1c 40 1 2024-04-21T23:52:20.526 INFO:tasks.workunit.client.0.smithi110.stdout:5/387: dwrite d7/d9/f21 [0,4194304] 0 2024-04-21T23:52:20.656 INFO:tasks.workunit.client.0.smithi110.stdout:8/424: write d5/f55 [4869216,115806] 0 2024-04-21T23:52:20.731 INFO:tasks.workunit.client.0.smithi110.stdout:6/382: unlink d16/d3d/f2b 0 2024-04-21T23:52:20.789 INFO:tasks.workunit.client.0.smithi110.stdout:7/392: read - d10/d45/d60/d5e/d65/f76 zero size 2024-04-21T23:52:21.053 INFO:tasks.workunit.client.0.smithi110.stdout:1/343: getdents d1/d2/d14/d16/d27/d3e 0 2024-04-21T23:52:21.474 INFO:tasks.workunit.client.0.smithi110.stdout:8/425: fdatasync d5/d24/d33/d3d/f66 0 2024-04-21T23:52:21.599 INFO:tasks.workunit.client.0.smithi110.stdout:6/383: rmdir d16/d1d 39 2024-04-21T23:52:22.047 INFO:tasks.workunit.client.0.smithi110.stdout:9/389: rename d1/d19/d42/f55 to d1/d29/d2a/d2b/f7f 0 2024-04-21T23:52:22.060 INFO:tasks.workunit.client.0.smithi110.stdout:5/388: mkdir d7/d9/d17/d48/d69/d6d 0 2024-04-21T23:52:22.720 INFO:tasks.workunit.client.0.smithi110.stdout:3/373: link d6/d12/d14/f60 d6/d12/d50/f75 0 2024-04-21T23:52:22.769 INFO:tasks.workunit.client.0.smithi110.stdout:2/377: dwrite d9/d25/d1c/f28 [0,4194304] 0 2024-04-21T23:52:22.947 INFO:tasks.workunit.client.0.smithi110.stdout:1/344: rename d1/d2/d14/d6f to d1/d2/d14/d16/d29/d71 0 2024-04-21T23:52:22.997 INFO:tasks.workunit.client.0.smithi110.stdout:5/389: fdatasync d7/d9/f33 0 2024-04-21T23:52:23.163 INFO:tasks.workunit.client.0.smithi110.stdout:1/345: rename d1 to d1/d1d/d70/d72 22 2024-04-21T23:52:23.366 INFO:tasks.workunit.client.0.smithi110.stdout:4/342: dwrite d1/d11/f41 [4194304,4194304] 0 2024-04-21T23:52:23.453 INFO:tasks.workunit.client.0.smithi110.stdout:6/384: truncate d16/f17 313274 0 2024-04-21T23:52:23.898 INFO:tasks.workunit.client.0.smithi110.stdout:2/378: creat d9/d1a/d1d/d2b/d5b/f79 x:0 0 0 2024-04-21T23:52:24.114 INFO:tasks.workunit.client.0.smithi110.stdout:0/387: unlink d0/fb 0 2024-04-21T23:52:24.130 INFO:tasks.workunit.client.0.smithi110.stdout:5/390: dread - d7/d24/d37/f5f zero size 2024-04-21T23:52:24.196 INFO:tasks.workunit.client.0.smithi110.stdout:8/426: link d5/d24/d33/d3d/f47 d5/da/d17/d6c/d7d/f92 0 2024-04-21T23:52:24.455 INFO:tasks.workunit.client.0.smithi110.stdout:5/391: dread d7/d24/f36 [0,4194304] 0 2024-04-21T23:52:24.567 INFO:tasks.workunit.client.0.smithi110.stdout:7/393: write d10/d45/d51/d88/d46/d69/f89 [699469,123201] 0 2024-04-21T23:52:24.845 INFO:tasks.workunit.client.0.smithi110.stdout:4/343: creat d1/d11/d20/d50/f70 x:0 0 0 2024-04-21T23:52:24.990 INFO:tasks.workunit.client.0.smithi110.stdout:3/374: creat d6/d12/d16/d30/d67/f76 x:0 0 0 2024-04-21T23:52:25.800 INFO:tasks.workunit.client.0.smithi110.stdout:7/394: rmdir d10/d45/d60/d5e 39 2024-04-21T23:52:25.957 INFO:tasks.workunit.client.0.smithi110.stdout:9/390: dwrite d1/d29/d2a/d6/d1d/f24 [0,4194304] 0 2024-04-21T23:52:26.608 INFO:tasks.workunit.client.0.smithi110.stdout:7/395: symlink d10/d45/d51/d58/l8d 0 2024-04-21T23:52:26.846 INFO:tasks.workunit.client.0.smithi110.stdout:1/346: write d1/d2/d1b/fc [3220192,118267] 0 2024-04-21T23:52:26.935 INFO:tasks.workunit.client.0.smithi110.stdout:9/391: creat d1/d29/d4d/f80 x:0 0 0 2024-04-21T23:52:27.044 INFO:tasks.workunit.client.0.smithi110.stdout:7/396: creat d10/d45/d51/d88/f8e x:0 0 0 2024-04-21T23:52:27.903 INFO:tasks.workunit.client.0.smithi110.stdout:2/379: mkdir d9/d1a/d1d/d7a 0 2024-04-21T23:52:27.914 INFO:tasks.workunit.client.0.smithi110.stdout:5/392: write d7/d9/d17/f51 [5180712,47498] 0 2024-04-21T23:52:27.953 INFO:tasks.workunit.client.0.smithi110.stdout:6/385: write d16/d1d/d38/f4f [157429,70148] 0 2024-04-21T23:52:27.962 INFO:tasks.workunit.client.0.smithi110.stdout:8/427: truncate d5/f55 1737463 0 2024-04-21T23:52:28.028 INFO:tasks.workunit.client.0.smithi110.stdout:4/344: symlink d1/l71 0 2024-04-21T23:52:28.159 INFO:tasks.workunit.client.0.smithi110.stdout:9/392: fsync d1/d29/f2e 0 2024-04-21T23:52:28.231 INFO:tasks.workunit.client.0.smithi110.stdout:1/347: mknod d1/dd/d23/c73 0 2024-04-21T23:52:28.763 INFO:tasks.workunit.client.0.smithi110.stdout:0/388: dwrite d0/d2a/f4e [0,4194304] 0 2024-04-21T23:52:28.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:52:28.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:52:28.915 INFO:tasks.workunit.client.0.smithi110.stdout:3/375: dwrite d6/d12/d14/d4b/f5f [0,4194304] 0 2024-04-21T23:52:29.191 INFO:tasks.workunit.client.0.smithi110.stdout:2/380: mkdir d9/d1a/d7b 0 2024-04-21T23:52:29.259 INFO:tasks.workunit.client.0.smithi110.stdout:2/381: read - d9/d1a/d1d/d4a/d6b/d3a/f41 zero size 2024-04-21T23:52:29.293 INFO:tasks.workunit.client.0.smithi110.stdout:4/345: read d1/d11/d12/d26/f3f [439281,111710] 0 2024-04-21T23:52:29.302 INFO:tasks.workunit.client.0.smithi110.stdout:7/397: write d10/d15/d22/f79 [737245,42406] 0 2024-04-21T23:52:29.444 INFO:tasks.workunit.client.0.smithi110.stdout:1/348: creat d1/dd/d23/f74 x:0 0 0 2024-04-21T23:52:29.749 INFO:tasks.workunit.client.0.smithi110.stdout:9/393: creat d1/d29/d2a/d6/f81 x:0 0 0 2024-04-21T23:52:29.752 INFO:tasks.workunit.client.0.smithi110.stdout:5/393: truncate d7/d35/f4c 1775104 0 2024-04-21T23:52:29.796 INFO:tasks.workunit.client.0.smithi110.stdout:7/398: sync 2024-04-21T23:52:30.290 INFO:tasks.workunit.client.0.smithi110.stdout:3/376: dread d6/f3a [0,4194304] 0 2024-04-21T23:52:30.435 INFO:tasks.workunit.client.0.smithi110.stdout:3/377: sync 2024-04-21T23:52:30.477 INFO:tasks.workunit.client.0.smithi110.stdout:6/386: creat d16/d1d/d38/d48/d5e/d62/f7c x:0 0 0 2024-04-21T23:52:30.513 INFO:tasks.workunit.client.0.smithi110.stdout:6/387: chown d16/d1e/d24/d33/f44 101237 1 2024-04-21T23:52:30.560 INFO:tasks.workunit.client.0.smithi110.stdout:4/346: mknod d1/d35/d6b/c72 0 2024-04-21T23:52:30.744 INFO:tasks.workunit.client.0.smithi110.stdout:2/382: creat d9/d1a/d1d/d2b/d5b/f7c x:0 0 0 2024-04-21T23:52:30.845 INFO:tasks.workunit.client.0.smithi110.stdout:1/349: rename d1 to d1/d75 22 2024-04-21T23:52:30.973 INFO:tasks.workunit.client.0.smithi110.stdout:5/394: rmdir d7 39 2024-04-21T23:52:31.228 INFO:tasks.workunit.client.0.smithi110.stdout:9/394: creat d1/d19/d42/f82 x:0 0 0 2024-04-21T23:52:31.319 INFO:tasks.workunit.client.0.smithi110.stdout:7/399: fsync d10/d45/d51/d88/f7c 0 2024-04-21T23:52:31.924 INFO:tasks.workunit.client.0.smithi110.stdout:6/388: mknod d16/d1d/d5c/c7d 0 2024-04-21T23:52:31.996 INFO:tasks.workunit.client.0.smithi110.stdout:4/347: chown d1/d11/d20/c29 16038 1 2024-04-21T23:52:32.071 INFO:tasks.workunit.client.0.smithi110.stdout:9/395: creat d1/d29/d6f/f83 x:0 0 0 2024-04-21T23:52:32.165 INFO:tasks.workunit.client.0.smithi110.stdout:5/395: stat d7/d24/d31/f5e 0 2024-04-21T23:52:32.286 INFO:tasks.workunit.client.0.smithi110.stdout:2/383: dread d9/d1a/d1d/d2b/d54/f70 [0,4194304] 0 2024-04-21T23:52:32.425 INFO:tasks.workunit.client.0.smithi110.stdout:8/428: write d5/d80/f8f [3182223,128917] 0 2024-04-21T23:52:32.429 INFO:tasks.workunit.client.0.smithi110.stdout:0/389: write d0/d27/f4a [2912224,39836] 0 2024-04-21T23:52:33.768 INFO:tasks.workunit.client.0.smithi110.stdout:4/348: creat d1/d11/d20/d23/d1c/d40/f73 x:0 0 0 2024-04-21T23:52:34.215 INFO:tasks.workunit.client.0.smithi110.stdout:8/429: mknod d5/d4f/c93 0 2024-04-21T23:52:34.217 INFO:tasks.workunit.client.0.smithi110.stdout:0/390: creat d0/d56/f84 x:0 0 0 2024-04-21T23:52:34.228 INFO:tasks.workunit.client.0.smithi110.stdout:7/400: fdatasync d10/d45/d60/f78 0 2024-04-21T23:52:34.385 INFO:tasks.workunit.client.0.smithi110.stdout:4/349: dread d1/d11/d12/f65 [0,4194304] 0 2024-04-21T23:52:34.676 INFO:tasks.workunit.client.0.smithi110.stdout:7/401: dread d10/f1d [0,4194304] 0 2024-04-21T23:52:34.882 INFO:tasks.workunit.client.0.smithi110.stdout:1/350: write d1/d2/d1b/f13 [3063095,67332] 0 2024-04-21T23:52:34.895 INFO:tasks.workunit.client.0.smithi110.stdout:6/389: write d16/d1e/d24/f3c [640065,65022] 0 2024-04-21T23:52:34.907 INFO:tasks.workunit.client.0.smithi110.stdout:3/378: write d6/d12/d14/f60 [825205,104527] 0 2024-04-21T23:52:35.156 INFO:tasks.workunit.client.0.smithi110.stdout:8/430: creat d5/da/d17/d6c/d72/d73/d78/d91/f94 x:0 0 0 2024-04-21T23:52:35.338 INFO:tasks.workunit.client.0.smithi110.stdout:8/431: dread d5/d24/d33/d3d/f66 [0,4194304] 0 2024-04-21T23:52:35.398 INFO:tasks.workunit.client.0.smithi110.stdout:6/390: unlink c13 0 2024-04-21T23:52:35.697 INFO:tasks.workunit.client.0.smithi110.stdout:7/402: symlink d10/d45/d60/d5e/d65/l8f 0 2024-04-21T23:52:35.926 INFO:tasks.workunit.client.0.smithi110.stdout:5/396: dwrite d7/d9/f21 [0,4194304] 0 2024-04-21T23:52:36.130 INFO:tasks.workunit.client.0.smithi110.stdout:8/432: dread - d5/da/d17/d7c/f7e zero size 2024-04-21T23:52:36.180 INFO:tasks.workunit.client.0.smithi110.stdout:4/350: link d1/d11/c51 d1/d11/d12/d26/c74 0 2024-04-21T23:52:36.438 INFO:tasks.workunit.client.0.smithi110.stdout:7/403: fsync d10/d15/d22/d2c/f5d 0 2024-04-21T23:52:36.457 INFO:tasks.workunit.client.0.smithi110.stdout:5/397: dread d7/d24/f36 [0,4194304] 0 2024-04-21T23:52:36.505 INFO:tasks.workunit.client.0.smithi110.stdout:2/384: dwrite d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e [0,4194304] 0 2024-04-21T23:52:36.699 INFO:tasks.workunit.client.0.smithi110.stdout:3/379: rename d6/d12/f57 to d6/d12/d16/f77 0 2024-04-21T23:52:36.746 INFO:tasks.workunit.client.0.smithi110.stdout:8/433: unlink d5/f59 0 2024-04-21T23:52:37.680 INFO:tasks.workunit.client.0.smithi110.stdout:4/351: truncate d1/d11/d12/f19 136983 0 2024-04-21T23:52:37.804 INFO:tasks.workunit.client.0.smithi110.stdout:2/385: symlink d9/d1a/d1d/d2b/l7d 0 2024-04-21T23:52:37.843 INFO:tasks.workunit.client.0.smithi110.stdout:2/386: readlink d9/d25/d1b/d45/d50/d68/l71 0 2024-04-21T23:52:37.876 INFO:tasks.workunit.client.0.smithi110.stdout:2/387: chown d9/d1a/d1d/d2b/d5b/f7c 3 1 2024-04-21T23:52:38.140 INFO:tasks.workunit.client.0.smithi110.stdout:8/434: mkdir d5/da/d17/d6c/d95 0 2024-04-21T23:52:38.224 INFO:tasks.workunit.client.0.smithi110.stdout:1/351: write d1/d2/d1b/d10/f4d [946281,74586] 0 2024-04-21T23:52:38.661 INFO:tasks.workunit.client.0.smithi110.stdout:2/388: mkdir d9/d25/d1c/d7e 0 2024-04-21T23:52:39.039 INFO:tasks.workunit.client.0.smithi110.stdout:6/391: getdents d16/d1e/d24/d33 0 2024-04-21T23:52:39.140 INFO:tasks.workunit.client.0.smithi110.stdout:8/435: dread d5/da/d17/d6c/d7d/f92 [0,4194304] 0 2024-04-21T23:52:39.522 INFO:tasks.workunit.client.0.smithi110.stdout:0/391: rmdir d0/d2a 39 2024-04-21T23:52:39.680 INFO:tasks.workunit.client.0.smithi110.stdout:1/352: unlink d1/d2/d14/d16/d29/f42 0 2024-04-21T23:52:39.745 INFO:tasks.workunit.client.0.smithi110.stdout:1/353: chown d1/dd/d23/d48/d4e/c66 3 1 2024-04-21T23:52:40.028 INFO:tasks.workunit.client.0.smithi110.stdout:1/354: dread d1/d2/d1b/f13 [0,4194304] 0 2024-04-21T23:52:40.363 INFO:tasks.workunit.client.0.smithi110.stdout:6/392: fdatasync d16/f54 0 2024-04-21T23:52:40.858 INFO:tasks.workunit.client.0.smithi110.stdout:5/398: dwrite d7/f27 [4194304,4194304] 0 2024-04-21T23:52:40.976 INFO:tasks.workunit.client.0.smithi110.stdout:9/396: unlink d1/f5d 0 2024-04-21T23:52:41.394 INFO:tasks.workunit.client.0.smithi110.stdout:7/404: dwrite d10/d15/d22/f5a [0,4194304] 0 2024-04-21T23:52:41.550 INFO:tasks.workunit.client.0.smithi110.stdout:9/397: dread d1/d19/f13 [0,4194304] 0 2024-04-21T23:52:41.838 INFO:tasks.workunit.client.0.smithi110.stdout:1/355: creat d1/d2/d1b/d10/d5c/f76 x:0 0 0 2024-04-21T23:52:41.878 INFO:tasks.workunit.client.0.smithi110.stdout:3/380: dwrite d6/f2d [0,4194304] 0 2024-04-21T23:52:42.043 INFO:tasks.workunit.client.0.smithi110.stdout:3/381: readlink d6/d12/d50/l59 0 2024-04-21T23:52:42.730 INFO:tasks.workunit.client.0.smithi110.stdout:9/398: creat d1/d29/d2a/d6/d1d/f84 x:0 0 0 2024-04-21T23:52:42.845 INFO:tasks.workunit.client.0.smithi110.stdout:8/436: getdents d5/da/d17/d6c/d72/d73/d78/d8c 0 2024-04-21T23:52:42.993 INFO:tasks.workunit.client.0.smithi110.stdout:1/356: mkdir d1/d2/d1b/d10/d5c/d77 0 2024-04-21T23:52:43.165 INFO:tasks.workunit.client.0.smithi110.stdout:6/393: link d16/d1d/d38/c59 d16/d1d/d38/d48/d5e/c7e 0 2024-04-21T23:52:43.263 INFO:tasks.workunit.client.0.smithi110.stdout:1/357: chown d1/d2/d14/d16/d27/c6a 28297164 1 2024-04-21T23:52:43.343 INFO:tasks.workunit.client.0.smithi110.stdout:2/389: dwrite d9/f76 [4194304,4194304] 0 2024-04-21T23:52:43.520 INFO:tasks.workunit.client.0.smithi110.stdout:9/399: symlink d1/d29/d2a/d6/d1d/l85 0 2024-04-21T23:52:43.609 INFO:tasks.workunit.client.0.smithi110.stdout:0/392: write d0/d14/d23/f3a [3319115,78263] 0 2024-04-21T23:52:43.790 INFO:tasks.workunit.client.0.smithi110.stdout:3/382: truncate d6/d12/d14/d32/f3b 652645 0 2024-04-21T23:52:43.976 INFO:tasks.workunit.client.0.smithi110.stdout:2/390: mknod d9/d1a/d1d/d2b/c7f 0 2024-04-21T23:52:44.039 INFO:tasks.workunit.client.0.smithi110.stdout:2/391: write d9/d25/d1b/f62 [1308321,58691] 0 2024-04-21T23:52:44.081 INFO:tasks.workunit.client.0.smithi110.stdout:2/392: chown d9/d25/d1c/f28 22922 1 2024-04-21T23:52:44.507 INFO:tasks.workunit.client.0.smithi110.stdout:0/393: mknod d0/d27/d68/c85 0 2024-04-21T23:52:44.534 INFO:tasks.workunit.client.0.smithi110.stdout:4/352: write d1/d11/d12/f19 [21516,36969] 0 2024-04-21T23:52:44.952 INFO:tasks.workunit.client.0.smithi110.stdout:2/393: creat d9/d25/d1b/d45/f80 x:0 0 0 2024-04-21T23:52:45.169 INFO:tasks.workunit.client.0.smithi110.stdout:8/437: creat d5/d24/d33/f96 x:0 0 0 2024-04-21T23:52:45.376 INFO:tasks.workunit.client.0.smithi110.stdout:4/353: mknod d1/d11/d12/d26/d52/c75 0 2024-04-21T23:52:45.653 INFO:tasks.workunit.client.0.smithi110.stdout:5/399: write d7/d22/d5b/f6c [411577,121223] 0 2024-04-21T23:52:45.783 INFO:tasks.workunit.client.0.smithi110.stdout:8/438: rename d5/da/d17/f22 to d5/da/d17/d6c/d72/d73/d78/f97 0 2024-04-21T23:52:45.904 INFO:tasks.workunit.client.0.smithi110.stdout:0/394: mknod d0/d27/d4b/d7f/c86 0 2024-04-21T23:52:46.250 INFO:tasks.workunit.client.0.smithi110.stdout:2/394: fdatasync d9/d25/f33 0 2024-04-21T23:52:46.517 INFO:tasks.workunit.client.0.smithi110.stdout:7/405: write d10/d43/f8c [351919,54213] 0 2024-04-21T23:52:46.918 INFO:tasks.workunit.client.0.smithi110.stdout:8/439: mkdir d5/da/d17/d6c/d95/d98 0 2024-04-21T23:52:47.252 INFO:tasks.workunit.client.0.smithi110.stdout:8/440: symlink d5/da/d17/d6c/d7d/l99 0 2024-04-21T23:52:47.515 INFO:tasks.workunit.client.0.smithi110.stdout:1/358: write d1/f39 [4575494,13947] 0 2024-04-21T23:52:47.543 INFO:tasks.workunit.client.0.smithi110.stdout:6/394: dwrite f12 [0,4194304] 0 2024-04-21T23:52:48.197 INFO:tasks.workunit.client.0.smithi110.stdout:2/395: rename d9/d1a/d1d/d4a/d6b/d3a/l58 to d9/d25/l81 0 2024-04-21T23:52:48.250 INFO:tasks.workunit.client.0.smithi110.stdout:3/383: dwrite d6/d12/d3c/f68 [0,4194304] 0 2024-04-21T23:52:48.252 INFO:tasks.workunit.client.0.smithi110.stdout:8/441: fsync d5/da/f63 0 2024-04-21T23:52:48.420 INFO:tasks.workunit.client.0.smithi110.stdout:9/400: dwrite d1/d29/f6c [0,4194304] 0 2024-04-21T23:52:48.588 INFO:tasks.workunit.client.0.smithi110.stdout:6/395: dread - d16/d1e/d24/d66/f6e zero size 2024-04-21T23:52:48.785 INFO:tasks.workunit.client.0.smithi110.stdout:4/354: write f0 [961508,9941] 0 2024-04-21T23:52:48.796 INFO:tasks.workunit.client.0.smithi110.stdout:5/400: write f5 [764363,26733] 0 2024-04-21T23:52:48.972 INFO:tasks.workunit.client.0.smithi110.stdout:3/384: dread d6/d12/d3c/f68 [0,4194304] 0 2024-04-21T23:52:49.044 INFO:tasks.workunit.client.0.smithi110.stdout:1/359: mkdir d1/d2/d1b/d10/d5c/d77/d78 0 2024-04-21T23:52:49.148 INFO:tasks.workunit.client.0.smithi110.stdout:7/406: rename d10/d43/c77 to d10/d45/d51/d88/d46/c90 0 2024-04-21T23:52:49.219 INFO:tasks.workunit.client.0.smithi110.stdout:0/395: dwrite d0/f1e [0,4194304] 0 2024-04-21T23:52:50.123 INFO:tasks.workunit.client.0.smithi110.stdout:9/401: truncate d1/d29/d4d/f68 1827785 0 2024-04-21T23:52:50.699 INFO:tasks.workunit.client.0.smithi110.stdout:7/407: creat d10/d43/f91 x:0 0 0 2024-04-21T23:52:50.854 INFO:tasks.workunit.client.0.smithi110.stdout:0/396: read - d0/d27/f82 zero size 2024-04-21T23:52:50.921 INFO:tasks.workunit.client.0.smithi110.stdout:8/442: write d5/d24/f2f [4925651,30695] 0 2024-04-21T23:52:51.056 INFO:tasks.workunit.client.0.smithi110.stdout:4/355: rmdir d1/d35 39 2024-04-21T23:52:51.491 INFO:tasks.workunit.client.0.smithi110.stdout:9/402: mknod d1/d29/d59/c86 0 2024-04-21T23:52:51.547 INFO:tasks.workunit.client.0.smithi110.stdout:5/401: fdatasync d7/d9/d17/f2c 0 2024-04-21T23:52:52.203 INFO:tasks.workunit.client.0.smithi110.stdout:2/396: dwrite d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e [0,4194304] 0 2024-04-21T23:52:52.380 INFO:tasks.workunit.client.0.smithi110.stdout:0/397: mknod d0/d16/d42/d50/c87 0 2024-04-21T23:52:52.406 INFO:tasks.workunit.client.0.smithi110.stdout:8/443: creat d5/da/d17/d6c/d7d/f9a x:0 0 0 2024-04-21T23:52:52.443 INFO:tasks.workunit.client.0.smithi110.stdout:6/396: dwrite d16/d1e/d24/d66/f6e [0,4194304] 0 2024-04-21T23:52:52.595 INFO:tasks.workunit.client.0.smithi110.stdout:9/403: dread - d1/d29/f34 zero size 2024-04-21T23:52:52.744 INFO:tasks.workunit.client.0.smithi110.stdout:3/385: write d6/d12/d50/f6c [991828,39214] 0 2024-04-21T23:52:52.938 INFO:tasks.workunit.client.0.smithi110.stdout:7/408: truncate d10/d45/d51/d88/d46/f86 2399567 0 2024-04-21T23:52:53.154 INFO:tasks.workunit.client.0.smithi110.stdout:2/397: mkdir d9/d25/d1c/d82 0 2024-04-21T23:52:53.279 INFO:tasks.workunit.client.0.smithi110.stdout:0/398: mknod d0/d27/c88 0 2024-04-21T23:52:53.730 INFO:tasks.workunit.client.0.smithi110.stdout:1/360: write d1/d2/d1b/d10/f12 [5346263,101710] 0 2024-04-21T23:52:54.025 INFO:tasks.workunit.client.0.smithi110.stdout:7/409: fsync f9 0 2024-04-21T23:52:54.054 INFO:tasks.workunit.client.0.smithi110.stdout:7/410: readlink d10/d27/l63 0 2024-04-21T23:52:54.214 INFO:tasks.workunit.client.0.smithi110.stdout:2/398: rename d9/d1a/d1d/d2b/d5b/f6c to d9/d25/d1b/d60/f83 0 2024-04-21T23:52:54.385 INFO:tasks.workunit.client.0.smithi110.stdout:8/444: mknod d5/d24/d33/c9b 0 2024-04-21T23:52:55.027 INFO:tasks.workunit.client.0.smithi110.stdout:4/356: write d1/f39 [684180,8117] 0 2024-04-21T23:52:55.394 INFO:tasks.workunit.client.0.smithi110.stdout:4/357: readlink d1/d11/d12/l36 0 2024-04-21T23:52:55.887 INFO:tasks.workunit.client.0.smithi110.stdout:7/411: fdatasync d10/d45/d51/d88/f7c 0 2024-04-21T23:52:55.893 INFO:tasks.workunit.client.0.smithi110.stdout:6/397: dwrite d16/d1e/f57 [0,4194304] 0 2024-04-21T23:52:56.048 INFO:tasks.workunit.client.0.smithi110.stdout:0/399: write d0/d27/d4b/f64 [1880193,17376] 0 2024-04-21T23:52:56.111 INFO:tasks.workunit.client.0.smithi110.stdout:2/399: creat d9/d1a/d1d/d2b/d54/f84 x:0 0 0 2024-04-21T23:52:56.127 INFO:tasks.workunit.client.0.smithi110.stdout:5/402: dwrite d7/d9/f3d [0,4194304] 0 2024-04-21T23:52:56.272 INFO:tasks.workunit.client.0.smithi110.stdout:8/445: truncate d5/fe 3677739 0 2024-04-21T23:52:56.300 INFO:tasks.workunit.client.0.smithi110.stdout:9/404: dwrite d1/d29/d2a/d6/d1d/f7c [0,4194304] 0 2024-04-21T23:52:56.302 INFO:tasks.workunit.client.0.smithi110.stdout:3/386: mkdir d6/d78 0 2024-04-21T23:52:56.413 INFO:tasks.workunit.client.0.smithi110.stdout:0/400: chown d0/f2c 8 1 2024-04-21T23:52:56.430 INFO:tasks.workunit.client.0.smithi110.stdout:5/403: chown d7/d24/d31/f45 24654 1 2024-04-21T23:52:56.441 INFO:tasks.workunit.client.0.smithi110.stdout:7/412: chown d10/d45/d51/d88/f54 30 1 2024-04-21T23:52:56.472 INFO:tasks.workunit.client.0.smithi110.stdout:9/405: chown d1/f7 70221334 1 2024-04-21T23:52:56.509 INFO:tasks.workunit.client.0.smithi110.stdout:8/446: write d5/d80/f8f [5033329,5366] 0 2024-04-21T23:52:56.565 INFO:tasks.workunit.client.0.smithi110.stdout:8/447: stat d5/l34 0 2024-04-21T23:52:56.612 INFO:tasks.workunit.client.0.smithi110.stdout:1/361: creat d1/d1d/d4a/f79 x:0 0 0 2024-04-21T23:52:57.519 INFO:tasks.workunit.client.0.smithi110.stdout:3/387: creat d6/d12/d14/d3f/f79 x:0 0 0 2024-04-21T23:52:57.794 INFO:tasks.workunit.client.0.smithi110.stdout:0/401: creat d0/d16/d42/d50/f89 x:0 0 0 2024-04-21T23:52:57.801 INFO:tasks.workunit.client.0.smithi110.stdout:9/406: dread - d1/d29/d4d/f80 zero size 2024-04-21T23:52:57.970 INFO:tasks.workunit.client.0.smithi110.stdout:8/448: chown d5/da/d17/f5d 0 1 2024-04-21T23:52:58.338 INFO:tasks.workunit.client.0.smithi110.stdout:6/398: mknod d16/d1d/c7f 0 2024-04-21T23:52:58.506 INFO:tasks.workunit.client.0.smithi110.stdout:2/400: mknod d9/d1a/d1d/d2b/d54/d77/c85 0 2024-04-21T23:52:58.644 INFO:tasks.workunit.client.0.smithi110.stdout:3/388: fdatasync d6/f3a 0 2024-04-21T23:52:58.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:52:58.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:52:59.021 INFO:tasks.workunit.client.0.smithi110.stdout:0/402: rename d0/l6 to d0/d25/d5a/l8a 0 2024-04-21T23:52:59.705 INFO:tasks.workunit.client.0.smithi110.stdout:2/401: truncate d9/d25/d1c/f34 40521 0 2024-04-21T23:53:00.197 INFO:tasks.workunit.client.0.smithi110.stdout:4/358: write d1/d11/d20/f2c [1020545,92144] 0 2024-04-21T23:53:00.365 INFO:tasks.workunit.client.0.smithi110.stdout:6/399: symlink d16/d1e/d24/d7b/l80 0 2024-04-21T23:53:00.484 INFO:tasks.workunit.client.0.smithi110.stdout:3/389: mkdir d6/d12/d16/d6f/d7a 0 2024-04-21T23:53:00.641 INFO:tasks.workunit.client.0.smithi110.stdout:0/403: symlink d0/d14/d23/d6d/l8b 0 2024-04-21T23:53:00.718 INFO:tasks.workunit.client.0.smithi110.stdout:9/407: rmdir d1/d29/d2a 39 2024-04-21T23:53:00.763 INFO:tasks.workunit.client.0.smithi110.stdout:9/408: read d1/d29/f2e [650024,91213] 0 2024-04-21T23:53:01.017 INFO:tasks.workunit.client.0.smithi110.stdout:2/402: creat d9/d1a/d1d/d4a/d78/f86 x:0 0 0 2024-04-21T23:53:01.533 INFO:tasks.workunit.client.0.smithi110.stdout:7/413: dwrite d10/d45/d51/d88/d39/f4e [0,4194304] 0 2024-04-21T23:53:01.759 INFO:tasks.workunit.client.0.smithi110.stdout:5/404: write d7/d35/f4c [70190,74042] 0 2024-04-21T23:53:01.852 INFO:tasks.workunit.client.0.smithi110.stdout:3/390: rename d6/d12/c62 to d6/d12/c7b 0 2024-04-21T23:53:02.038 INFO:tasks.workunit.client.0.smithi110.stdout:7/414: readlink d10/d45/d51/d88/d39/d7f/d80/d53/l56 0 2024-04-21T23:53:02.059 INFO:tasks.workunit.client.0.smithi110.stdout:5/405: fsync d7/d9/f21 0 2024-04-21T23:53:02.156 INFO:tasks.workunit.client.0.smithi110.stdout:8/449: rename d5/d4f/f52 to d5/f9c 0 2024-04-21T23:53:03.306 INFO:tasks.workunit.client.0.smithi110.stdout:5/406: mknod d7/d9/d17/d48/d69/c6e 0 2024-04-21T23:53:03.616 INFO:tasks.workunit.client.0.smithi110.stdout:8/450: dread - d5/da/d17/d6c/d7d/f9a zero size 2024-04-21T23:53:04.061 INFO:tasks.workunit.client.0.smithi110.stdout:5/407: mkdir d7/d22/d5b/d6f 0 2024-04-21T23:53:04.275 INFO:tasks.workunit.client.0.smithi110.stdout:4/359: rename d1/d11/d12/d26/c74 to d1/d11/d20/d23/d1c/d47/d4f/c76 0 2024-04-21T23:53:04.491 INFO:tasks.workunit.client.0.smithi110.stdout:5/408: creat d7/d24/d49/d64/f70 x:0 0 0 2024-04-21T23:53:04.559 INFO:tasks.workunit.client.0.smithi110.stdout:6/400: dwrite f10 [0,4194304] 0 2024-04-21T23:53:04.734 INFO:tasks.workunit.client.0.smithi110.stdout:0/404: write d0/d14/f32 [321377,122359] 0 2024-04-21T23:53:04.792 INFO:tasks.workunit.client.0.smithi110.stdout:4/360: rmdir d1/d11/d20/d23 39 2024-04-21T23:53:04.841 INFO:tasks.workunit.client.0.smithi110.stdout:9/409: write d1/f7 [5281339,33208] 0 2024-04-21T23:53:05.023 INFO:tasks.workunit.client.0.smithi110.stdout:2/403: rename d9/d25/c18 to d9/d1a/d1d/d7a/c87 0 2024-04-21T23:53:05.448 INFO:tasks.workunit.client.0.smithi110.stdout:4/361: dread d1/fe [0,4194304] 0 2024-04-21T23:53:05.566 INFO:tasks.workunit.client.0.smithi110.stdout:2/404: symlink d9/d1a/d1d/d4e/l88 0 2024-04-21T23:53:05.884 INFO:tasks.workunit.client.0.smithi110.stdout:3/391: dwrite d6/d12/d16/d30/f73 [0,4194304] 0 2024-04-21T23:53:06.019 INFO:tasks.workunit.client.0.smithi110.stdout:7/415: write d10/d45/f4f [344912,77062] 0 2024-04-21T23:53:06.235 INFO:tasks.workunit.client.0.smithi110.stdout:1/362: rename d1/ff to d1/f7a 0 2024-04-21T23:53:06.563 INFO:tasks.workunit.client.0.smithi110.stdout:2/405: creat d9/d25/d1b/d45/d50/f89 x:0 0 0 2024-04-21T23:53:07.142 INFO:tasks.workunit.client.0.smithi110.stdout:3/392: symlink d6/d12/d16/d30/l7c 0 2024-04-21T23:53:07.737 INFO:tasks.workunit.client.0.smithi110.stdout:2/406: truncate d9/d25/d1c/f3c 830593 0 2024-04-21T23:53:07.755 INFO:tasks.workunit.client.0.smithi110.stdout:4/362: creat d1/d11/d20/d23/d1c/d47/d4f/d6a/f77 x:0 0 0 2024-04-21T23:53:07.876 INFO:tasks.workunit.client.0.smithi110.stdout:3/393: dread - d6/f6a zero size 2024-04-21T23:53:08.085 INFO:tasks.workunit.client.0.smithi110.stdout:4/363: fdatasync d1/d11/d12/d26/f38 0 2024-04-21T23:53:08.233 INFO:tasks.workunit.client.0.smithi110.stdout:2/407: creat d9/d25/d1b/d45/d4d/f8a x:0 0 0 2024-04-21T23:53:08.360 INFO:tasks.workunit.client.0.smithi110.stdout:3/394: fsync d6/d12/d14/d32/f37 0 2024-04-21T23:53:08.435 INFO:tasks.workunit.client.0.smithi110.stdout:9/410: creat d1/f87 x:0 0 0 2024-04-21T23:53:08.551 INFO:tasks.workunit.client.0.smithi110.stdout:3/395: sync 2024-04-21T23:53:08.932 INFO:tasks.workunit.client.0.smithi110.stdout:2/408: symlink d9/d1a/d1d/d4e/l8b 0 2024-04-21T23:53:08.983 INFO:tasks.workunit.client.0.smithi110.stdout:9/411: dread - d1/d19/d42/f82 zero size 2024-04-21T23:53:09.040 INFO:tasks.workunit.client.0.smithi110.stdout:3/396: dread - d6/d12/d14/d4b/f63 zero size 2024-04-21T23:53:09.115 INFO:tasks.workunit.client.0.smithi110.stdout:4/364: mknod d1/d11/d20/c78 0 2024-04-21T23:53:09.216 INFO:tasks.workunit.client.0.smithi110.stdout:2/409: unlink d9/d1a/d1d/d2b/c4b 0 2024-04-21T23:53:09.241 INFO:tasks.workunit.client.0.smithi110.stdout:2/410: readlink d9/d1a/d1d/d4e/l88 0 2024-04-21T23:53:09.769 INFO:tasks.workunit.client.0.smithi110.stdout:2/411: creat d9/d1a/d1d/d2b/d54/f8c x:0 0 0 2024-04-21T23:53:09.802 INFO:tasks.workunit.client.0.smithi110.stdout:2/412: dread - d9/d1a/d1d/f36 zero size 2024-04-21T23:53:09.826 INFO:tasks.workunit.client.0.smithi110.stdout:0/405: rmdir d0/d16 39 2024-04-21T23:53:09.867 INFO:tasks.workunit.client.0.smithi110.stdout:2/413: stat d9/d1a/d1d/d2b/d54/l66 0 2024-04-21T23:53:10.397 INFO:tasks.workunit.client.0.smithi110.stdout:9/412: rmdir d1/d29/d2a/d2b/d58 39 2024-04-21T23:53:10.418 INFO:tasks.workunit.client.0.smithi110.stdout:9/413: dread - d1/f87 zero size 2024-04-21T23:53:10.644 INFO:tasks.workunit.client.0.smithi110.stdout:7/416: write d10/d45/d51/d88/d46/d69/f89 [1512272,7313] 0 2024-04-21T23:53:10.995 INFO:tasks.workunit.client.0.smithi110.stdout:1/363: dwrite d1/d2/d14/d16/f50 [0,4194304] 0 2024-04-21T23:53:11.119 INFO:tasks.workunit.client.0.smithi110.stdout:1/364: stat d1/d2 0 2024-04-21T23:53:11.201 INFO:tasks.workunit.client.0.smithi110.stdout:9/414: creat d1/d29/d59/f88 x:0 0 0 2024-04-21T23:53:11.235 INFO:tasks.workunit.client.0.smithi110.stdout:2/414: fsync d9/d25/d1c/f34 0 2024-04-21T23:53:11.347 INFO:tasks.workunit.client.0.smithi110.stdout:7/417: creat d10/d45/d51/d88/d39/f92 x:0 0 0 2024-04-21T23:53:11.387 INFO:tasks.workunit.client.0.smithi110.stdout:7/418: readlink d10/d45/d51/d88/d46/l6c 0 2024-04-21T23:53:11.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/365: sync 2024-04-21T23:53:11.841 INFO:tasks.workunit.client.0.smithi110.stdout:9/415: creat d1/d29/d2a/d6/d1d/f89 x:0 0 0 2024-04-21T23:53:11.916 INFO:tasks.workunit.client.0.smithi110.stdout:2/415: dread - d9/d25/d1b/d45/d4d/f74 zero size 2024-04-21T23:53:11.951 INFO:tasks.workunit.client.0.smithi110.stdout:2/416: chown d9/d25/d1b/l6d 1 1 2024-04-21T23:53:12.117 INFO:tasks.workunit.client.0.smithi110.stdout:7/419: mkdir d10/d45/d51/d88/d93 0 2024-04-21T23:53:12.380 INFO:tasks.workunit.client.0.smithi110.stdout:7/420: unlink d10/d45/d51/d88/d39/l3a 0 2024-04-21T23:53:12.538 INFO:tasks.workunit.client.0.smithi110.stdout:2/417: fsync d9/d1a/f63 0 2024-04-21T23:53:12.791 INFO:tasks.workunit.client.0.smithi110.stdout:4/365: getdents d1/d11/d20 0 2024-04-21T23:53:12.811 INFO:tasks.workunit.client.0.smithi110.stdout:4/366: stat d1/d11/l4a 0 2024-04-21T23:53:12.912 INFO:tasks.workunit.client.0.smithi110.stdout:7/421: symlink d10/d45/d60/d5e/l94 0 2024-04-21T23:53:12.943 INFO:tasks.workunit.client.0.smithi110.stdout:7/422: readlink d10/d45/d51/d58/l83 0 2024-04-21T23:53:13.037 INFO:tasks.workunit.client.0.smithi110.stdout:8/451: rename d5/c62 to d5/da/d17/d7c/c9d 0 2024-04-21T23:53:13.045 INFO:tasks.workunit.client.0.smithi110.stdout:2/418: fdatasync d9/d1a/d1d/d4a/d6b/d3a/f41 0 2024-04-21T23:53:13.214 INFO:tasks.workunit.client.0.smithi110.stdout:9/416: getdents d1/d29/d2a/dc/d30 0 2024-04-21T23:53:13.339 INFO:tasks.workunit.client.0.smithi110.stdout:3/397: write d6/d12/d14/d32/f70 [781984,53512] 0 2024-04-21T23:53:13.561 INFO:tasks.workunit.client.0.smithi110.stdout:2/419: mkdir d9/d1a/d1d/d2b/d8d 0 2024-04-21T23:53:13.743 INFO:tasks.workunit.client.0.smithi110.stdout:9/417: creat d1/d29/d6f/f8a x:0 0 0 2024-04-21T23:53:13.767 INFO:tasks.workunit.client.0.smithi110.stdout:7/423: mkdir d10/d15/d95 0 2024-04-21T23:53:13.851 INFO:tasks.workunit.client.0.smithi110.stdout:0/406: dwrite d0/f1e [0,4194304] 0 2024-04-21T23:53:13.970 INFO:tasks.workunit.client.0.smithi110.stdout:5/409: symlink d7/l71 0 2024-04-21T23:53:14.064 INFO:tasks.workunit.client.0.smithi110.stdout:2/420: fdatasync d9/d25/d1b/d60/f67 0 2024-04-21T23:53:14.146 INFO:tasks.workunit.client.0.smithi110.stdout:3/398: creat d6/d12/d16/d5d/f7d x:0 0 0 2024-04-21T23:53:14.162 INFO:tasks.workunit.client.0.smithi110.stdout:5/410: sync 2024-04-21T23:53:14.194 INFO:tasks.workunit.client.0.smithi110.stdout:5/411: chown d7/d24/f53 7 1 2024-04-21T23:53:14.216 INFO:tasks.workunit.client.0.smithi110.stdout:5/412: chown d7/d24/d49/d64/f70 147075 1 2024-04-21T23:53:14.243 INFO:tasks.workunit.client.0.smithi110.stdout:6/401: rename d16/d1e/d24/d33/f55 to d16/d3d/f81 0 2024-04-21T23:53:14.312 INFO:tasks.workunit.client.0.smithi110.stdout:6/402: stat d16/d1e/d24/d33/f68 0 2024-04-21T23:53:14.540 INFO:tasks.workunit.client.0.smithi110.stdout:7/424: mknod d10/d45/d51/d88/c96 0 2024-04-21T23:53:14.876 INFO:tasks.workunit.client.0.smithi110.stdout:2/421: mkdir d9/d25/d1b/d45/d8e 0 2024-04-21T23:53:14.967 INFO:tasks.workunit.client.0.smithi110.stdout:2/422: sync 2024-04-21T23:53:15.249 INFO:tasks.workunit.client.0.smithi110.stdout:1/366: rename d1/d1d/d4a/c4f to d1/d2/d14/d16/d29/d71/c7b 0 2024-04-21T23:53:15.452 INFO:tasks.workunit.client.0.smithi110.stdout:5/413: truncate d7/d9/d17/f18 9424527 0 2024-04-21T23:53:15.472 INFO:tasks.workunit.client.0.smithi110.stdout:5/414: chown d7/d24/d3a 62505 1 2024-04-21T23:53:15.836 INFO:tasks.workunit.client.0.smithi110.stdout:2/423: rmdir d9/d25/d1b/d45/d4d 39 2024-04-21T23:53:16.117 INFO:tasks.workunit.client.0.smithi110.stdout:1/367: fsync d1/d1d/d4a/f79 0 2024-04-21T23:53:16.424 INFO:tasks.workunit.client.0.smithi110.stdout:5/415: truncate d7/d24/f56 1784492 0 2024-04-21T23:53:16.663 INFO:tasks.workunit.client.0.smithi110.stdout:1/368: mknod d1/dd/d23/c7c 0 2024-04-21T23:53:17.079 INFO:tasks.workunit.client.0.smithi110.stdout:8/452: write d5/d24/d33/d3d/f66 [3952633,95819] 0 2024-04-21T23:53:17.292 INFO:tasks.workunit.client.0.smithi110.stdout:5/416: truncate d7/f27 8754629 0 2024-04-21T23:53:17.523 INFO:tasks.workunit.client.0.smithi110.stdout:8/453: mkdir d5/d24/d33/d3d/d5c/d6a/d9e 0 2024-04-21T23:53:18.103 INFO:tasks.workunit.client.0.smithi110.stdout:8/454: creat d5/da/d17/d6c/d72/d73/d78/f9f x:0 0 0 2024-04-21T23:53:18.563 INFO:tasks.workunit.client.0.smithi110.stdout:9/418: write d1/d29/d6f/f83 [985064,107347] 0 2024-04-21T23:53:18.611 INFO:tasks.workunit.client.0.smithi110.stdout:3/399: creat d6/d12/d14/f7e x:0 0 0 2024-04-21T23:53:18.706 INFO:tasks.workunit.client.0.smithi110.stdout:4/367: rename d1/d11/d20/c29 to d1/d11/d12/d26/d52/c79 0 2024-04-21T23:53:18.725 INFO:tasks.workunit.client.0.smithi110.stdout:3/400: sync 2024-04-21T23:53:18.732 INFO:tasks.workunit.client.0.smithi110.stdout:5/417: creat d7/f72 x:0 0 0 2024-04-21T23:53:19.029 INFO:tasks.workunit.client.0.smithi110.stdout:9/419: chown d1/d29/d2a/dc/d30/c69 1449183 1 2024-04-21T23:53:19.081 INFO:tasks.workunit.client.0.smithi110.stdout:0/407: dwrite d0/d25/d5a/d63/f77 [0,4194304] 0 2024-04-21T23:53:19.096 INFO:tasks.workunit.client.0.smithi110.stdout:3/401: chown d6/d12/d16/l22 3 1 2024-04-21T23:53:19.467 INFO:tasks.workunit.client.0.smithi110.stdout:7/425: dwrite d10/d45/d51/d88/d46/f86 [0,4194304] 0 2024-04-21T23:53:19.643 INFO:tasks.workunit.client.0.smithi110.stdout:2/424: rename d9/d1a/d1d/d4e/l88 to d9/d25/d1b/d45/d50/l8f 0 2024-04-21T23:53:19.822 INFO:tasks.workunit.client.0.smithi110.stdout:5/418: dread d7/d22/d5b/f6c [0,4194304] 0 2024-04-21T23:53:19.950 INFO:tasks.workunit.client.0.smithi110.stdout:0/408: dread - d0/f41 zero size 2024-04-21T23:53:21.128 INFO:tasks.workunit.client.0.smithi110.stdout:6/403: write d16/d3d/f81 [501281,107540] 0 2024-04-21T23:53:21.579 INFO:tasks.workunit.client.0.smithi110.stdout:3/402: mknod d6/d78/c7f 0 2024-04-21T23:53:22.133 INFO:tasks.workunit.client.0.smithi110.stdout:8/455: dwrite d5/fe [0,4194304] 0 2024-04-21T23:53:22.296 INFO:tasks.workunit.client.0.smithi110.stdout:1/369: rename d1/d2/d14/d16/d29/d71/c7b to d1/d2/d1b/d10/d5c/d77/d78/c7d 0 2024-04-21T23:53:22.310 INFO:tasks.workunit.client.0.smithi110.stdout:6/404: fdatasync f3 0 2024-04-21T23:53:22.739 INFO:tasks.workunit.client.0.smithi110.stdout:7/426: write d10/d15/d22/f79 [772508,59173] 0 2024-04-21T23:53:22.957 INFO:tasks.workunit.client.0.smithi110.stdout:9/420: dwrite d1/d29/d2a/d2b/d58/f63 [0,4194304] 0 2024-04-21T23:53:23.259 INFO:tasks.workunit.client.0.smithi110.stdout:8/456: mkdir d5/da/d17/d6c/d72/da0 0 2024-04-21T23:53:23.470 INFO:tasks.workunit.client.0.smithi110.stdout:4/368: rename d1/d11/d12/d26/d52 to d1/d11/d20/d23/d1c/d47/d4f/d56/d7a 0 2024-04-21T23:53:23.580 INFO:tasks.workunit.client.0.smithi110.stdout:5/419: write d7/f27 [6073055,82450] 0 2024-04-21T23:53:23.711 INFO:tasks.workunit.client.0.smithi110.stdout:3/403: write d6/d12/d14/d3f/f79 [985258,89358] 0 2024-04-21T23:53:24.038 INFO:tasks.workunit.client.0.smithi110.stdout:9/421: mknod d1/d29/d2a/dc/d30/c8b 0 2024-04-21T23:53:24.117 INFO:tasks.workunit.client.0.smithi110.stdout:8/457: fdatasync d5/d24/f56 0 2024-04-21T23:53:24.279 INFO:tasks.workunit.client.0.smithi110.stdout:0/409: rmdir d0/d27 39 2024-04-21T23:53:24.388 INFO:tasks.workunit.client.0.smithi110.stdout:4/369: mknod d1/d11/d12/d26/c7b 0 2024-04-21T23:53:24.420 INFO:tasks.workunit.client.0.smithi110.stdout:2/425: link d9/d25/d1b/d45/d50/l5a d9/d1a/d1d/d2b/l90 0 2024-04-21T23:53:24.489 INFO:tasks.workunit.client.0.smithi110.stdout:2/426: stat d9/d25/d1b/d60/f67 0 2024-04-21T23:53:24.506 INFO:tasks.workunit.client.0.smithi110.stdout:2/427: chown d9/f15 921194 1 2024-04-21T23:53:24.545 INFO:tasks.workunit.client.0.smithi110.stdout:5/420: mknod d7/d24/d31/c73 0 2024-04-21T23:53:24.573 INFO:tasks.workunit.client.0.smithi110.stdout:2/428: chown d9/d1a/d1d/d4a/d78/f86 54266534 1 2024-04-21T23:53:24.652 INFO:tasks.workunit.client.0.smithi110.stdout:3/404: readlink d6/d12/d14/d3f/l48 0 2024-04-21T23:53:24.674 INFO:tasks.workunit.client.0.smithi110.stdout:1/370: write d1/f39 [4169732,10522] 0 2024-04-21T23:53:24.835 INFO:tasks.workunit.client.0.smithi110.stdout:7/427: symlink d10/d15/d22/l97 0 2024-04-21T23:53:24.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/422: creat d1/d29/d2a/d2b/d58/f8c x:0 0 0 2024-04-21T23:53:25.043 INFO:tasks.workunit.client.0.smithi110.stdout:6/405: write d16/f63 [2137650,59930] 0 2024-04-21T23:53:25.151 INFO:tasks.workunit.client.0.smithi110.stdout:8/458: symlink d5/da/la1 0 2024-04-21T23:53:26.249 INFO:tasks.workunit.client.0.smithi110.stdout:5/421: fdatasync d7/d22/d5b/f6c 0 2024-04-21T23:53:26.787 INFO:tasks.workunit.client.0.smithi110.stdout:7/428: unlink d10/d45/d51/d88/d46/d69/f89 0 2024-04-21T23:53:26.845 INFO:tasks.workunit.client.0.smithi110.stdout:3/405: dwrite d6/d12/d14/f7e [0,4194304] 0 2024-04-21T23:53:27.655 INFO:tasks.workunit.client.0.smithi110.stdout:4/370: write d1/fd [4447046,83659] 0 2024-04-21T23:53:28.338 INFO:tasks.workunit.client.0.smithi110.stdout:3/406: rename d6/f38 to d6/d12/d50/f80 0 2024-04-21T23:53:28.396 INFO:tasks.workunit.client.0.smithi110.stdout:2/429: dwrite d9/d1a/d1d/d2b/d54/f84 [0,4194304] 0 2024-04-21T23:53:28.409 INFO:tasks.workunit.client.0.smithi110.stdout:1/371: write d1/d1d/d57/f62 [190458,61511] 0 2024-04-21T23:53:28.869 INFO:tasks.workunit.client.0.smithi110.stdout:9/423: rmdir d1/d19/d42/d5f 0 2024-04-21T23:53:28.879 INFO:tasks.workunit.client.0.smithi110.stdout:8/459: rmdir d5/d24/d33/d3d/d5c/d6a/d9e 0 2024-04-21T23:53:28.984 INFO:tasks.workunit.client.0.smithi110.stdout:3/407: read d6/d12/d16/d30/f73 [3518887,92802] 0 2024-04-21T23:53:29.092 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:53:29.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:53:29.260 INFO:tasks.workunit.client.0.smithi110.stdout:8/460: symlink d5/d24/la2 0 2024-04-21T23:53:29.316 INFO:tasks.workunit.client.0.smithi110.stdout:5/422: getdents d7/d22 0 2024-04-21T23:53:29.647 INFO:tasks.workunit.client.0.smithi110.stdout:1/372: mknod d1/d1d/d70/c7e 0 2024-04-21T23:53:29.826 INFO:tasks.workunit.client.0.smithi110.stdout:6/406: dwrite d16/d1e/f2a [0,4194304] 0 2024-04-21T23:53:29.958 INFO:tasks.workunit.client.0.smithi110.stdout:7/429: rename d10/d45/d60/d5e/l94 to d10/d45/d51/d88/d39/d7f/d80/l98 0 2024-04-21T23:53:29.981 INFO:tasks.workunit.client.0.smithi110.stdout:4/371: write f0 [9346200,11016] 0 2024-04-21T23:53:30.791 INFO:tasks.workunit.client.0.smithi110.stdout:1/373: mkdir d1/dd/d23/d48/d4e/d7f 0 2024-04-21T23:53:30.858 INFO:tasks.workunit.client.0.smithi110.stdout:2/430: write d9/d25/d1b/d45/d4d/f52 [921358,94061] 0 2024-04-21T23:53:30.919 INFO:tasks.workunit.client.0.smithi110.stdout:5/423: creat d7/d9/d17/d48/d69/d6d/f74 x:0 0 0 2024-04-21T23:53:31.121 INFO:tasks.workunit.client.0.smithi110.stdout:0/410: rename d0/d2a/c65 to d0/d16/d42/d50/d83/c8c 0 2024-04-21T23:53:31.246 INFO:tasks.workunit.client.0.smithi110.stdout:6/407: creat d16/d3d/d40/f82 x:0 0 0 2024-04-21T23:53:31.386 INFO:tasks.workunit.client.0.smithi110.stdout:8/461: write d5/d24/d33/d3d/d5c/f8b [850772,48708] 0 2024-04-21T23:53:31.497 INFO:tasks.workunit.client.0.smithi110.stdout:7/430: unlink d10/d45/d51/d88/d39/d7f/d80/d53/c64 0 2024-04-21T23:53:31.572 INFO:tasks.workunit.client.0.smithi110.stdout:3/408: dwrite d6/d12/d50/f66 [0,4194304] 0 2024-04-21T23:53:31.583 INFO:tasks.workunit.client.0.smithi110.stdout:4/372: dread d1/d11/d12/f19 [0,4194304] 0 2024-04-21T23:53:31.762 INFO:tasks.workunit.client.0.smithi110.stdout:7/431: readlink d10/d45/d51/d58/l8d 0 2024-04-21T23:53:31.901 INFO:tasks.workunit.client.0.smithi110.stdout:3/409: dread d6/d12/d50/f64 [0,4194304] 0 2024-04-21T23:53:32.090 INFO:tasks.workunit.client.0.smithi110.stdout:2/431: mkdir d9/d1a/d1d/d7a/d91 0 2024-04-21T23:53:32.250 INFO:tasks.workunit.client.0.smithi110.stdout:5/424: rmdir d7/d24/d3a/d54 39 2024-04-21T23:53:32.263 INFO:tasks.workunit.client.0.smithi110.stdout:1/374: dread d1/f40 [0,4194304] 0 2024-04-21T23:53:32.478 INFO:tasks.workunit.client.0.smithi110.stdout:0/411: rmdir d0/d14 39 2024-04-21T23:53:32.803 INFO:tasks.workunit.client.0.smithi110.stdout:8/462: dread d5/d6f/f89 [0,4194304] 0 2024-04-21T23:53:33.252 INFO:tasks.workunit.client.0.smithi110.stdout:2/432: creat d9/d1a/d1d/d2b/d5b/f92 x:0 0 0 2024-04-21T23:53:33.333 INFO:tasks.workunit.client.0.smithi110.stdout:5/425: fdatasync d7/d24/d49/d64/f70 0 2024-04-21T23:53:33.375 INFO:tasks.workunit.client.0.smithi110.stdout:3/410: dread d6/d12/d50/f75 [0,4194304] 0 2024-04-21T23:53:33.541 INFO:tasks.workunit.client.0.smithi110.stdout:1/375: truncate d1/d1d/d4a/f79 381831 0 2024-04-21T23:53:33.815 INFO:tasks.workunit.client.0.smithi110.stdout:6/408: symlink d16/d3d/l83 0 2024-04-21T23:53:33.828 INFO:tasks.workunit.client.0.smithi110.stdout:3/411: sync 2024-04-21T23:53:34.664 INFO:tasks.workunit.client.0.smithi110.stdout:5/426: creat d7/d24/d49/d61/f75 x:0 0 0 2024-04-21T23:53:34.766 INFO:tasks.workunit.client.0.smithi110.stdout:5/427: sync 2024-04-21T23:53:35.018 INFO:tasks.workunit.client.0.smithi110.stdout:9/424: rename d1/d29/d2a/d3c/f53 to d1/d29/d2a/d2b/f8d 0 2024-04-21T23:53:35.060 INFO:tasks.workunit.client.0.smithi110.stdout:7/432: dwrite d10/d45/d51/d88/d39/f92 [0,4194304] 0 2024-04-21T23:53:35.295 INFO:tasks.workunit.client.0.smithi110.stdout:6/409: mknod d16/d1e/d24/d66/c84 0 2024-04-21T23:53:35.737 INFO:tasks.workunit.client.0.smithi110.stdout:2/433: getdents d9/d1a/d7b 0 2024-04-21T23:53:35.827 INFO:tasks.workunit.client.0.smithi110.stdout:2/434: dread d9/d1a/f63 [0,4194304] 0 2024-04-21T23:53:36.057 INFO:tasks.workunit.client.0.smithi110.stdout:0/412: mknod d0/d14/c8d 0 2024-04-21T23:53:36.622 INFO:tasks.workunit.client.0.smithi110.stdout:7/433: truncate f6 169283 0 2024-04-21T23:53:36.663 INFO:tasks.workunit.client.0.smithi110.stdout:9/425: truncate d1/d29/d59/f88 231095 0 2024-04-21T23:53:36.785 INFO:tasks.workunit.client.0.smithi110.stdout:3/412: symlink d6/l81 0 2024-04-21T23:53:36.935 INFO:tasks.workunit.client.0.smithi110.stdout:6/410: rmdir d16/d1e/d24/d7b 39 2024-04-21T23:53:37.037 INFO:tasks.workunit.client.0.smithi110.stdout:8/463: write d5/d24/d33/f4d [1216878,91630] 0 2024-04-21T23:53:37.173 INFO:tasks.workunit.client.0.smithi110.stdout:9/426: dread d1/d29/d2a/dc/fd [0,4194304] 0 2024-04-21T23:53:37.244 INFO:tasks.workunit.client.0.smithi110.stdout:4/373: getdents d1/d11/d20/d23/d1c/d47/d4f/d6a 0 2024-04-21T23:53:37.498 INFO:tasks.workunit.client.0.smithi110.stdout:0/413: mknod d0/d2a/c8e 0 2024-04-21T23:53:37.570 INFO:tasks.workunit.client.0.smithi110.stdout:0/414: dread d0/f21 [0,4194304] 0 2024-04-21T23:53:38.565 INFO:tasks.workunit.client.0.smithi110.stdout:3/413: dread d6/f34 [0,4194304] 0 2024-04-21T23:53:38.596 INFO:tasks.workunit.client.0.smithi110.stdout:3/414: readlink d6/d12/d14/d4b/l54 0 2024-04-21T23:53:38.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/411: rmdir d16/d1e/d24 39 2024-04-21T23:53:38.719 INFO:tasks.workunit.client.0.smithi110.stdout:8/464: symlink d5/d24/d33/d3d/d5c/d6a/la3 0 2024-04-21T23:53:39.005 INFO:tasks.workunit.client.0.smithi110.stdout:4/374: rmdir d1/d11/d20 39 2024-04-21T23:53:39.096 INFO:tasks.workunit.client.0.smithi110.stdout:1/376: getdents d1/d2/d1b/d10/d5c 0 2024-04-21T23:53:39.129 INFO:tasks.workunit.client.0.smithi110.stdout:1/377: stat d1/d2/d14/d16/d27/f6b 0 2024-04-21T23:53:39.598 INFO:tasks.workunit.client.0.smithi110.stdout:3/415: dread d6/d12/f2c [0,4194304] 0 2024-04-21T23:53:39.864 INFO:tasks.workunit.client.0.smithi110.stdout:4/375: truncate d1/d11/d12/d26/f38 5042114 0 2024-04-21T23:53:40.035 INFO:tasks.workunit.client.0.smithi110.stdout:6/412: fsync d16/f17 0 2024-04-21T23:53:40.110 INFO:tasks.workunit.client.0.smithi110.stdout:6/413: dread d16/f17 [0,4194304] 0 2024-04-21T23:53:40.384 INFO:tasks.workunit.client.0.smithi110.stdout:7/434: dwrite d10/d15/f21 [0,4194304] 0 2024-04-21T23:53:40.756 INFO:tasks.workunit.client.0.smithi110.stdout:5/428: rename d7/l8 to d7/d22/d5b/d6f/l76 0 2024-04-21T23:53:41.033 INFO:tasks.workunit.client.0.smithi110.stdout:6/414: unlink d16/d1d/l52 0 2024-04-21T23:53:41.207 INFO:tasks.workunit.client.0.smithi110.stdout:9/427: link d1/d29/d6f/f75 d1/d29/d4d/f8e 0 2024-04-21T23:53:41.382 INFO:tasks.workunit.client.0.smithi110.stdout:7/435: mkdir d10/d45/d51/d88/d46/d69/d99 0 2024-04-21T23:53:41.525 INFO:tasks.workunit.client.0.smithi110.stdout:2/435: rename d9/d25/d1b/f3b to d9/d25/d1c/d7e/f93 0 2024-04-21T23:53:41.617 INFO:tasks.workunit.client.0.smithi110.stdout:7/436: sync 2024-04-21T23:53:41.658 INFO:tasks.workunit.client.0.smithi110.stdout:5/429: symlink d7/d22/d5b/l77 0 2024-04-21T23:53:42.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/428: fdatasync d1/d29/d2a/d6/fe 0 2024-04-21T23:53:42.277 INFO:tasks.workunit.client.0.smithi110.stdout:2/436: mkdir d9/d25/d1b/d45/d50/d94 0 2024-04-21T23:53:42.296 INFO:tasks.workunit.client.0.smithi110.stdout:8/465: write d5/d6f/f89 [1015224,128691] 0 2024-04-21T23:53:42.534 INFO:tasks.workunit.client.0.smithi110.stdout:5/430: mknod d7/d9/d17/d48/c78 0 2024-04-21T23:53:42.542 INFO:tasks.workunit.client.0.smithi110.stdout:1/378: link d1/d2/l5 d1/dd/d23/d48/d4e/d7f/l80 0 2024-04-21T23:53:42.630 INFO:tasks.workunit.client.0.smithi110.stdout:3/416: write d6/d12/d14/d4b/f63 [532775,11140] 0 2024-04-21T23:53:42.684 INFO:tasks.workunit.client.0.smithi110.stdout:6/415: fdatasync d16/d1e/d24/f3c 0 2024-04-21T23:53:42.747 INFO:tasks.workunit.client.0.smithi110.stdout:3/417: dread d6/d12/d14/d32/f33 [0,4194304] 0 2024-04-21T23:53:43.110 INFO:tasks.workunit.client.0.smithi110.stdout:6/416: dread d16/f54 [0,4194304] 0 2024-04-21T23:53:43.471 INFO:tasks.workunit.client.0.smithi110.stdout:2/437: creat d9/d25/d1c/f95 x:0 0 0 2024-04-21T23:53:43.482 INFO:tasks.workunit.client.0.smithi110.stdout:8/466: mknod d5/da/d17/d6c/d72/ca4 0 2024-04-21T23:53:43.631 INFO:tasks.workunit.client.0.smithi110.stdout:1/379: creat d1/d1d/d57/f81 x:0 0 0 2024-04-21T23:53:43.652 INFO:tasks.workunit.client.0.smithi110.stdout:3/418: mknod d6/d12/d16/d5d/c82 0 2024-04-21T23:53:43.794 INFO:tasks.workunit.client.0.smithi110.stdout:4/376: dwrite d1/f3 [0,4194304] 0 2024-04-21T23:53:43.799 INFO:tasks.workunit.client.0.smithi110.stdout:0/415: rename d0/d25/f55 to d0/d14/f8f 0 2024-04-21T23:53:44.049 INFO:tasks.workunit.client.0.smithi110.stdout:8/467: creat d5/d4f/d79/fa5 x:0 0 0 2024-04-21T23:53:44.310 INFO:tasks.workunit.client.0.smithi110.stdout:5/431: dread d7/d24/d3a/d40/f41 [0,4194304] 0 2024-04-21T23:53:44.350 INFO:tasks.workunit.client.0.smithi110.stdout:6/417: rename d16/d1d/d5c to d16/d1e/d24/d33/d85 0 2024-04-21T23:53:44.894 INFO:tasks.workunit.client.0.smithi110.stdout:9/429: write d1/d29/d2a/d6/d1d/f7c [4658329,53594] 0 2024-04-21T23:53:44.901 INFO:tasks.workunit.client.0.smithi110.stdout:7/437: write d10/d45/d51/d88/f6d [1399307,121806] 0 2024-04-21T23:53:44.925 INFO:tasks.workunit.client.0.smithi110.stdout:3/419: read - d6/d12/d16/d5d/f7d zero size 2024-04-21T23:53:45.236 INFO:tasks.workunit.client.0.smithi110.stdout:2/438: symlink d9/d25/d1b/d45/d50/d94/l96 0 2024-04-21T23:53:45.255 INFO:tasks.workunit.client.0.smithi110.stdout:4/377: read - d1/d11/d12/f68 zero size 2024-04-21T23:53:45.297 INFO:tasks.workunit.client.0.smithi110.stdout:8/468: creat d5/da/d17/d6c/d95/fa6 x:0 0 0 2024-04-21T23:53:45.308 INFO:tasks.workunit.client.0.smithi110.stdout:5/432: fsync d7/d9/f21 0 2024-04-21T23:53:45.317 INFO:tasks.workunit.client.0.smithi110.stdout:1/380: symlink d1/d2/d14/d16/l82 0 2024-04-21T23:53:45.388 INFO:tasks.workunit.client.0.smithi110.stdout:2/439: chown d9/d1a/d1d/d7a/d91 0 1 2024-04-21T23:53:45.413 INFO:tasks.workunit.client.0.smithi110.stdout:0/416: rename d0/d14/d23/f45 to d0/d16/d5d/f90 0 2024-04-21T23:53:45.458 INFO:tasks.workunit.client.0.smithi110.stdout:4/378: read d1/d11/d12/f19 [130854,99817] 0 2024-04-21T23:53:45.530 INFO:tasks.workunit.client.0.smithi110.stdout:6/418: mkdir d16/d1d/d38/d48/d5e/d6a/d70/d86 0 2024-04-21T23:53:45.600 INFO:tasks.workunit.client.0.smithi110.stdout:9/430: mknod d1/d29/d6f/c8f 0 2024-04-21T23:53:45.943 INFO:tasks.workunit.client.0.smithi110.stdout:7/438: dread - d10/d45/d60/d5e/f8b zero size 2024-04-21T23:53:46.067 INFO:tasks.workunit.client.0.smithi110.stdout:3/420: symlink d6/d12/d14/d3f/l83 0 2024-04-21T23:53:46.367 INFO:tasks.workunit.client.0.smithi110.stdout:5/433: unlink d7/d24/d3a/l5a 0 2024-04-21T23:53:46.904 INFO:tasks.workunit.client.0.smithi110.stdout:6/419: unlink d16/d1e/d24/f3c 0 2024-04-21T23:53:47.107 INFO:tasks.workunit.client.0.smithi110.stdout:9/431: fsync d1/d29/d2a/d6/d1d/f84 0 2024-04-21T23:53:47.261 INFO:tasks.workunit.client.0.smithi110.stdout:7/439: fsync d10/d45/d51/d88/f7c 0 2024-04-21T23:53:47.457 INFO:tasks.workunit.client.0.smithi110.stdout:7/440: sync 2024-04-21T23:53:47.480 INFO:tasks.workunit.client.0.smithi110.stdout:0/417: dread d0/f2c [0,4194304] 0 2024-04-21T23:53:47.490 INFO:tasks.workunit.client.0.smithi110.stdout:2/440: dread d9/f49 [0,4194304] 0 2024-04-21T23:53:47.567 INFO:tasks.workunit.client.0.smithi110.stdout:0/418: chown d0/d16/f18 461 1 2024-04-21T23:53:47.674 INFO:tasks.workunit.client.0.smithi110.stdout:0/419: sync 2024-04-21T23:53:47.710 INFO:tasks.workunit.client.0.smithi110.stdout:5/434: rename d7/d24/d31/c73 to d7/d22/d5b/d6f/c79 0 2024-04-21T23:53:48.316 INFO:tasks.workunit.client.0.smithi110.stdout:6/420: mknod d16/d1e/d24/d33/c87 0 2024-04-21T23:53:48.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/441: dread - d9/d25/d1b/d45/d4d/f73 zero size 2024-04-21T23:53:48.682 INFO:tasks.workunit.client.0.smithi110.stdout:2/442: readlink d9/d1a/d1d/d4a/l6f 0 2024-04-21T23:53:48.703 INFO:tasks.workunit.client.0.smithi110.stdout:2/443: readlink d9/d25/d1b/l6d 0 2024-04-21T23:53:48.768 INFO:tasks.workunit.client.0.smithi110.stdout:1/381: creat d1/f83 x:0 0 0 2024-04-21T23:53:48.873 INFO:tasks.workunit.client.0.smithi110.stdout:9/432: rename d1/d19/f48 to d1/d29/d2a/dc/f90 0 2024-04-21T23:53:48.992 INFO:tasks.workunit.client.0.smithi110.stdout:5/435: read d7/d24/d31/f5e [653898,76549] 0 2024-04-21T23:53:49.093 INFO:tasks.workunit.client.0.smithi110.stdout:0/420: truncate d0/d16/d5d/f5e 563201 0 2024-04-21T23:53:49.249 INFO:tasks.workunit.client.0.smithi110.stdout:8/469: write d5/d24/d33/d3d/f47 [4501914,45767] 0 2024-04-21T23:53:49.466 INFO:tasks.workunit.client.0.smithi110.stdout:6/421: mknod d16/d1e/d24/d33/d85/c88 0 2024-04-21T23:53:49.597 INFO:tasks.workunit.client.0.smithi110.stdout:2/444: truncate d9/d25/d1b/d45/f48 662372 0 2024-04-21T23:53:49.641 INFO:tasks.workunit.client.0.smithi110.stdout:6/422: sync 2024-04-21T23:53:49.662 INFO:tasks.workunit.client.0.smithi110.stdout:6/423: chown d16/d3d/f2d 168 1 2024-04-21T23:53:49.783 INFO:tasks.workunit.client.0.smithi110.stdout:1/382: symlink d1/d1d/d70/l84 0 2024-04-21T23:53:49.827 INFO:tasks.workunit.client.0.smithi110.stdout:1/383: readlink d1/d2/d14/d16/d29/l2a 0 2024-04-21T23:53:50.006 INFO:tasks.workunit.client.0.smithi110.stdout:5/436: unlink d7/d24/d37/f5c 0 2024-04-21T23:53:50.175 INFO:tasks.workunit.client.0.smithi110.stdout:3/421: write d6/d12/d16/f5e [630316,71593] 0 2024-04-21T23:53:50.667 INFO:tasks.workunit.client.0.smithi110.stdout:0/421: symlink d0/d16/d42/d50/d83/l91 0 2024-04-21T23:53:50.920 INFO:tasks.workunit.client.0.smithi110.stdout:4/379: dwrite d1/d11/d20/d23/ff [0,4194304] 0 2024-04-21T23:53:51.063 INFO:tasks.workunit.client.0.smithi110.stdout:6/424: creat d16/d3d/d40/d46/f89 x:0 0 0 2024-04-21T23:53:51.224 INFO:tasks.workunit.client.0.smithi110.stdout:9/433: creat d1/d29/d2a/d2b/d58/d7b/f91 x:0 0 0 2024-04-21T23:53:51.263 INFO:tasks.workunit.client.0.smithi110.stdout:9/434: chown d1/d29/d2a/c5 40 1 2024-04-21T23:53:51.457 INFO:tasks.workunit.client.0.smithi110.stdout:5/437: mknod d7/d9/d17/d48/d69/d6d/c7a 0 2024-04-21T23:53:51.458 INFO:tasks.workunit.client.0.smithi110.stdout:1/384: dread d1/d2/d1b/d10/f12 [4194304,4194304] 0 2024-04-21T23:53:51.829 INFO:tasks.workunit.client.0.smithi110.stdout:3/422: rename d6/d12/d14/d32/f33 to d6/d12/d14/d32/f84 0 2024-04-21T23:53:52.141 INFO:tasks.workunit.client.0.smithi110.stdout:4/380: mkdir d1/d11/d20/d23/d3c/d7c 0 2024-04-21T23:53:52.180 INFO:tasks.workunit.client.0.smithi110.stdout:7/441: dwrite d10/d45/f52 [4194304,4194304] 0 2024-04-21T23:53:52.756 INFO:tasks.workunit.client.0.smithi110.stdout:1/385: rename d1/d2/d14/l36 to d1/d2/d14/l85 0 2024-04-21T23:53:53.093 INFO:tasks.workunit.client.0.smithi110.stdout:3/423: mknod d6/d12/d14/d3f/c85 0 2024-04-21T23:53:53.555 INFO:tasks.workunit.client.0.smithi110.stdout:7/442: rmdir d10/d15/d22/d2c 39 2024-04-21T23:53:53.855 INFO:tasks.workunit.client.0.smithi110.stdout:1/386: mkdir d1/dd/d23/d48/d4e/d86 0 2024-04-21T23:53:53.930 INFO:tasks.workunit.client.0.smithi110.stdout:9/435: dread d1/d19/f4b [0,4194304] 0 2024-04-21T23:53:54.167 INFO:tasks.workunit.client.0.smithi110.stdout:8/470: write d5/f2a [1690594,43091] 0 2024-04-21T23:53:54.373 INFO:tasks.workunit.client.0.smithi110.stdout:6/425: getdents d16/d1d/d38 0 2024-04-21T23:53:54.403 INFO:tasks.workunit.client.0.smithi110.stdout:1/387: dread - d1/d1d/d57/f81 zero size 2024-04-21T23:53:54.549 INFO:tasks.workunit.client.0.smithi110.stdout:9/436: creat d1/d29/d2a/dc/d30/f92 x:0 0 0 2024-04-21T23:53:54.678 INFO:tasks.workunit.client.0.smithi110.stdout:3/424: mknod d6/d12/d3c/d65/c86 0 2024-04-21T23:53:54.789 INFO:tasks.workunit.client.0.smithi110.stdout:7/443: symlink d10/d45/d51/d88/d39/d7f/d80/l9a 0 2024-04-21T23:53:55.216 INFO:tasks.workunit.client.0.smithi110.stdout:9/437: rmdir d1/d29/d2a/d2b/d58 39 2024-04-21T23:53:55.295 INFO:tasks.workunit.client.0.smithi110.stdout:3/425: mknod d6/d12/d14/d3f/c87 0 2024-04-21T23:53:55.492 INFO:tasks.workunit.client.0.smithi110.stdout:7/444: mkdir d10/d45/d9b 0 2024-04-21T23:53:55.673 INFO:tasks.workunit.client.0.smithi110.stdout:1/388: getdents d1/d2/d14/d16/d27/d3e 0 2024-04-21T23:53:55.777 INFO:tasks.workunit.client.0.smithi110.stdout:9/438: fsync d1/d29/d2a/d6/f77 0 2024-04-21T23:53:55.889 INFO:tasks.workunit.client.0.smithi110.stdout:2/445: write d9/f10 [6464,16534] 0 2024-04-21T23:53:56.152 INFO:tasks.workunit.client.0.smithi110.stdout:0/422: dwrite d0/d25/f79 [0,4194304] 0 2024-04-21T23:53:56.320 INFO:tasks.workunit.client.0.smithi110.stdout:3/426: unlink d6/d12/d50/f75 0 2024-04-21T23:53:56.783 INFO:tasks.workunit.client.0.smithi110.stdout:5/438: dwrite d7/d9/d17/f2c [0,4194304] 0 2024-04-21T23:53:56.914 INFO:tasks.workunit.client.0.smithi110.stdout:5/439: stat d7/d24/d49/d61 0 2024-04-21T23:53:57.080 INFO:tasks.workunit.client.0.smithi110.stdout:2/446: rmdir d9/d1a/d1d/d2b/d54 39 2024-04-21T23:53:57.144 INFO:tasks.workunit.client.0.smithi110.stdout:6/426: rename d16/d1e/d24/l50 to d16/l8a 0 2024-04-21T23:53:57.221 INFO:tasks.workunit.client.0.smithi110.stdout:6/427: chown d16/d3d 13047 1 2024-04-21T23:53:57.251 INFO:tasks.workunit.client.0.smithi110.stdout:6/428: chown d16/d1d/f5a 141970797 1 2024-04-21T23:53:57.510 INFO:tasks.workunit.client.0.smithi110.stdout:7/445: link d10/d45/d51/d88/d39/d7f/d80/l9a d10/d45/d51/d88/d46/d69/d75/l9c 0 2024-04-21T23:53:57.521 INFO:tasks.workunit.client.0.smithi110.stdout:5/440: dread d7/d24/f53 [0,4194304] 0 2024-04-21T23:53:57.570 INFO:tasks.workunit.client.0.smithi110.stdout:5/441: stat d7/d24/f36 0 2024-04-21T23:53:57.723 INFO:tasks.workunit.client.0.smithi110.stdout:0/423: symlink d0/d27/d4b/d7f/l92 0 2024-04-21T23:53:58.131 INFO:tasks.workunit.client.0.smithi110.stdout:1/389: rename d1/d2/d14/d16/d29/c2b to d1/d2/d1b/d10/d5c/d77/d78/c87 0 2024-04-21T23:53:58.222 INFO:tasks.workunit.client.0.smithi110.stdout:6/429: symlink d16/d3d/d40/l8b 0 2024-04-21T23:53:58.415 INFO:tasks.workunit.client.0.smithi110.stdout:4/381: dwrite d1/d11/d12/d26/f3f [0,4194304] 0 2024-04-21T23:53:58.415 INFO:tasks.workunit.client.0.smithi110.stdout:1/390: sync 2024-04-21T23:53:58.510 INFO:tasks.workunit.client.0.smithi110.stdout:5/442: creat d7/d35/f7b x:0 0 0 2024-04-21T23:53:58.567 INFO:tasks.workunit.client.0.smithi110.stdout:5/443: chown d7/d24/d37/d38 5 1 2024-04-21T23:53:58.636 INFO:tasks.workunit.client.0.smithi110.stdout:7/446: symlink d10/d45/d51/d88/d39/d7f/d80/d53/l9d 0 2024-04-21T23:53:58.788 INFO:tasks.workunit.client.0.smithi110.stdout:0/424: rmdir d0/d16/d42/d50/d83 39 2024-04-21T23:53:58.996 INFO:tasks.workunit.client.0.smithi110.stdout:0/425: dread d0/d16/f18 [0,4194304] 0 2024-04-21T23:53:59.031 INFO:tasks.workunit.client.0.smithi110.stdout:0/426: chown d0/d27/c39 0 1 2024-04-21T23:53:59.056 INFO:tasks.workunit.client.0.smithi110.stdout:0/427: chown d0/d27/c88 2282 1 2024-04-21T23:53:59.272 INFO:tasks.workunit.client.0.smithi110.stdout:9/439: rename d1/d29/d2a/d6/f81 to d1/d29/d59/f93 0 2024-04-21T23:53:59.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:53:59.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:53:59.310 INFO:tasks.workunit.client.0.smithi110.stdout:9/440: readlink d1/d29/d2a/dc/l28 0 2024-04-21T23:53:59.716 INFO:tasks.workunit.client.0.smithi110.stdout:0/428: mkdir d0/d16/d93 0 2024-04-21T23:53:59.872 INFO:tasks.workunit.client.0.smithi110.stdout:8/471: write d5/da/d17/d6c/d72/d73/d78/f9f [954865,28955] 0 2024-04-21T23:54:00.070 INFO:tasks.workunit.client.0.smithi110.stdout:7/447: mknod d10/d45/d51/d88/c9e 0 2024-04-21T23:54:00.452 INFO:tasks.workunit.client.0.smithi110.stdout:8/472: dread d5/f3f [0,4194304] 0 2024-04-21T23:54:00.568 INFO:tasks.workunit.client.0.smithi110.stdout:7/448: mknod d10/d45/d51/d88/d46/d69/c9f 0 2024-04-21T23:54:00.984 INFO:tasks.workunit.client.0.smithi110.stdout:8/473: dread d5/d24/f49 [0,4194304] 0 2024-04-21T23:54:01.319 INFO:tasks.workunit.client.0.smithi110.stdout:4/382: truncate d1/d11/d20/d23/ff 3268062 0 2024-04-21T23:54:01.404 INFO:tasks.workunit.client.0.smithi110.stdout:5/444: write d7/d9/d17/f2c [4613692,39929] 0 2024-04-21T23:54:01.415 INFO:tasks.workunit.client.0.smithi110.stdout:3/427: write d6/d12/f3e [592883,35318] 0 2024-04-21T23:54:01.542 INFO:tasks.workunit.client.0.smithi110.stdout:1/391: symlink d1/l88 0 2024-04-21T23:54:01.594 INFO:tasks.workunit.client.0.smithi110.stdout:2/447: write d9/d25/f33 [5272091,45319] 0 2024-04-21T23:54:01.728 INFO:tasks.workunit.client.0.smithi110.stdout:7/449: dread d10/d45/d51/d88/f54 [0,4194304] 0 2024-04-21T23:54:01.729 INFO:tasks.workunit.client.0.smithi110.stdout:8/474: creat d5/da/d17/d6c/d7d/fa7 x:0 0 0 2024-04-21T23:54:01.742 INFO:tasks.workunit.client.0.smithi110.stdout:0/429: link d0/d27/f48 d0/d16/d42/d50/f94 0 2024-04-21T23:54:01.868 INFO:tasks.workunit.client.0.smithi110.stdout:0/430: dread d0/d14/f5f [0,4194304] 0 2024-04-21T23:54:02.326 INFO:tasks.workunit.client.0.smithi110.stdout:2/448: dread - d9/d1a/d1d/d2b/d5b/f7c zero size 2024-04-21T23:54:02.360 INFO:tasks.workunit.client.0.smithi110.stdout:2/449: chown d9/d1a/d1d/f75 3 1 2024-04-21T23:54:02.546 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:01:42.808 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.563 INFO:tasks.workunit.client.0.smithi110.stdout:7/450: creat d10/d45/d51/d88/d46/fa0 x:0 0 0 2024-04-21T23:54:02.568 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:01:42.830 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.569 INFO:tasks.workunit.client.0.smithi110.stdout:8/475: read - d5/da/f63 zero size 2024-04-21T23:54:02.601 INFO:tasks.workunit.client.0.smithi110.stdout:8/476: readlink d5/l5e 0 2024-04-21T23:54:02.602 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:01:42.800 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.605 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:01:42.802 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.610 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:01:42.808 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.619 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:01:42.816 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.652 INFO:tasks.workunit.client.0.smithi110.stdout:8/477: chown d5/da/d17/f5d 12858443 1 2024-04-21T23:54:02.688 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:01:42.950 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.696 INFO:tasks.workunit.client.0.smithi110.stdout:4/383: truncate d1/d11/f66 360676 0 2024-04-21T23:54:02.714 INFO:tasks.workunit.client.0.smithi110.stdout:4/384: chown d1/d11/d20/d23/c1d 10 1 2024-04-21T23:54:02.727 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:01:42.925 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.742 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:01:42.940 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:54:02.884 INFO:tasks.workunit.client.0.smithi110.stdout:6/430: dwrite d16/f54 [0,4194304] 0 2024-04-21T23:54:03.053 INFO:tasks.workunit.client.0.smithi110.stdout:7/451: dread - d10/d45/d51/f85 zero size 2024-04-21T23:54:03.067 INFO:tasks.workunit.client.0.smithi110.stdout:6/431: dread d16/d1d/d38/f45 [0,4194304] 0 2024-04-21T23:54:03.146 INFO:tasks.workunit.client.0.smithi110.stdout:6/432: dread d16/d1d/d38/f45 [0,4194304] 0 2024-04-21T23:54:03.334 INFO:tasks.workunit.client.0.smithi110.stdout:0/431: truncate d0/d16/d5d/f90 2749369 0 2024-04-21T23:54:03.615 INFO:tasks.workunit.client.0.smithi110.stdout:9/441: dwrite d1/d19/f32 [0,4194304] 0 2024-04-21T23:54:03.853 INFO:tasks.workunit.client.0.smithi110.stdout:8/478: mkdir d5/d24/d33/d3d/d82/da8 0 2024-04-21T23:54:04.087 INFO:tasks.workunit.client.0.smithi110.stdout:6/433: mknod d16/d3d/d40/d46/d5f/c8c 0 2024-04-21T23:54:04.309 INFO:tasks.workunit.client.0.smithi110.stdout:1/392: write d1/d2/d1b/fc [4548387,27525] 0 2024-04-21T23:54:04.332 INFO:tasks.workunit.client.0.smithi110.stdout:3/428: write d6/d12/d14/d3f/f79 [2014653,79769] 0 2024-04-21T23:54:04.400 INFO:tasks.workunit.client.0.smithi110.stdout:8/479: creat d5/d24/d33/d3d/d5c/fa9 x:0 0 0 2024-04-21T23:54:04.455 INFO:tasks.workunit.client.0.smithi110.stdout:5/445: dwrite d7/d9/f21 [0,4194304] 0 2024-04-21T23:54:04.627 INFO:tasks.workunit.client.0.smithi110.stdout:6/434: creat d16/d1d/d38/d48/d5e/d62/f8d x:0 0 0 2024-04-21T23:54:04.654 INFO:tasks.workunit.client.0.smithi110.stdout:4/385: getdents d1/d11/d20/d23 0 2024-04-21T23:54:04.722 INFO:tasks.workunit.client.0.smithi110.stdout:4/386: chown d1/fe 419 1 2024-04-21T23:54:05.162 INFO:tasks.workunit.client.0.smithi110.stdout:8/480: mkdir d5/da/d17/d6c/d95/daa 0 2024-04-21T23:54:05.316 INFO:tasks.workunit.client.0.smithi110.stdout:2/450: write d9/d25/d1b/d45/d4d/f64 [11153465,2149] 0 2024-04-21T23:54:05.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/387: mknod d1/d11/d20/d23/d1c/d47/d4f/d56/d7a/c7d 0 2024-04-21T23:54:05.795 INFO:tasks.workunit.client.0.smithi110.stdout:8/481: mknod d5/da/cab 0 2024-04-21T23:54:06.048 INFO:tasks.workunit.client.0.smithi110.stdout:3/429: rename d6/d12/f3e to d6/d78/f88 0 2024-04-21T23:54:06.173 INFO:tasks.workunit.client.0.smithi110.stdout:2/451: creat d9/d1a/d1d/d4a/d6b/d3a/d5c/f97 x:0 0 0 2024-04-21T23:54:06.902 INFO:tasks.workunit.client.0.smithi110.stdout:7/452: dwrite d10/d45/d60/d5e/d65/f76 [0,4194304] 0 2024-04-21T23:54:06.987 INFO:tasks.workunit.client.0.smithi110.stdout:8/482: fsync d5/da/d17/d6c/d95/fa6 0 2024-04-21T23:54:07.031 INFO:tasks.workunit.client.0.smithi110.stdout:2/452: creat d9/d1a/d1d/d4a/d6b/f98 x:0 0 0 2024-04-21T23:54:07.361 INFO:tasks.workunit.client.0.smithi110.stdout:6/435: getdents d16/d3d/d40 0 2024-04-21T23:54:07.481 INFO:tasks.workunit.client.0.smithi110.stdout:9/442: write d1/d29/d2a/d2b/d57/f5c [3226090,30838] 0 2024-04-21T23:54:07.573 INFO:tasks.workunit.client.0.smithi110.stdout:0/432: dwrite d0/d14/f32 [0,4194304] 0 2024-04-21T23:54:07.771 INFO:tasks.workunit.client.0.smithi110.stdout:8/483: mkdir d5/da/dac 0 2024-04-21T23:54:07.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/453: mknod d10/d45/d51/d88/d39/ca1 0 2024-04-21T23:54:07.861 INFO:tasks.workunit.client.0.smithi110.stdout:2/453: rmdir d9/d25/d1b/d45/d50 39 2024-04-21T23:54:07.938 INFO:tasks.workunit.client.0.smithi110.stdout:2/454: write d9/d1a/d1d/d4a/d6b/f98 [382072,113084] 0 2024-04-21T23:54:08.061 INFO:tasks.workunit.client.0.smithi110.stdout:4/388: mkdir d1/d11/d20/d58/d7e 0 2024-04-21T23:54:08.157 INFO:tasks.workunit.client.0.smithi110.stdout:6/436: mkdir d16/d1d/d38/d8e 0 2024-04-21T23:54:08.213 INFO:tasks.workunit.client.0.smithi110.stdout:5/446: write d7/d24/d49/d64/f70 [702807,35175] 0 2024-04-21T23:54:08.620 INFO:tasks.workunit.client.0.smithi110.stdout:9/443: creat d1/d29/d2a/d6/d1d/f94 x:0 0 0 2024-04-21T23:54:09.052 INFO:tasks.workunit.client.0.smithi110.stdout:7/454: dread d10/d15/d22/f79 [0,4194304] 0 2024-04-21T23:54:09.209 INFO:tasks.workunit.client.0.smithi110.stdout:6/437: dread - d16/d3d/d40/d46/f76 zero size 2024-04-21T23:54:09.340 INFO:tasks.workunit.client.0.smithi110.stdout:4/389: dread d1/fe [0,4194304] 0 2024-04-21T23:54:09.798 INFO:tasks.workunit.client.0.smithi110.stdout:1/393: creat d1/f89 x:0 0 0 2024-04-21T23:54:10.028 INFO:tasks.workunit.client.0.smithi110.stdout:0/433: rename d0/d27/l73 to d0/d25/l95 0 2024-04-21T23:54:10.279 INFO:tasks.workunit.client.0.smithi110.stdout:3/430: write d6/d12/d50/f6c [669507,34558] 0 2024-04-21T23:54:11.072 INFO:tasks.workunit.client.0.smithi110.stdout:1/394: readlink d1/d2/d14/d16/l49 0 2024-04-21T23:54:11.250 INFO:tasks.workunit.client.0.smithi110.stdout:0/434: fdatasync d0/d25/f79 0 2024-04-21T23:54:11.316 INFO:tasks.workunit.client.0.smithi110.stdout:0/435: write d0/d14/f32 [1055302,37593] 0 2024-04-21T23:54:11.380 INFO:tasks.workunit.client.0.smithi110.stdout:0/436: dread d0/d16/d42/f52 [0,4194304] 0 2024-04-21T23:54:11.407 INFO:tasks.workunit.client.0.smithi110.stdout:0/437: chown d0/d56 725839 1 2024-04-21T23:54:11.455 INFO:tasks.workunit.client.0.smithi110.stdout:3/431: rmdir d6/d12/d3c/d65 39 2024-04-21T23:54:11.780 INFO:tasks.workunit.client.0.smithi110.stdout:4/390: dread - d1/d11/d20/d50/f6e zero size 2024-04-21T23:54:11.819 INFO:tasks.workunit.client.0.smithi110.stdout:4/391: read d1/d11/d12/f19 [67918,1497] 0 2024-04-21T23:54:12.172 INFO:tasks.workunit.client.0.smithi110.stdout:8/484: getdents d5/da/d17/d6c/d72/d73/d78 0 2024-04-21T23:54:12.424 INFO:tasks.workunit.client.0.smithi110.stdout:1/395: fsync d1/d2/d1b/d10/f4d 0 2024-04-21T23:54:12.546 INFO:tasks.workunit.client.0.smithi110.stdout:2/455: dwrite d9/d25/f46 [4194304,4194304] 0 2024-04-21T23:54:13.006 INFO:tasks.workunit.client.0.smithi110.stdout:5/447: dwrite d7/d9/d17/d48/f63 [0,4194304] 0 2024-04-21T23:54:13.181 INFO:tasks.workunit.client.0.smithi110.stdout:4/392: dread - d1/d11/f69 zero size 2024-04-21T23:54:13.195 INFO:tasks.workunit.client.0.smithi110.stdout:2/456: sync 2024-04-21T23:54:13.253 INFO:tasks.workunit.client.0.smithi110.stdout:8/485: fsync d5/d24/d33/d3d/f64 0 2024-04-21T23:54:13.324 INFO:tasks.workunit.client.0.smithi110.stdout:4/393: sync 2024-04-21T23:54:13.839 INFO:tasks.workunit.client.0.smithi110.stdout:9/444: write d1/d29/d6f/f8a [638263,76225] 0 2024-04-21T23:54:14.167 INFO:tasks.workunit.client.0.smithi110.stdout:0/438: creat d0/d16/d42/d50/d83/f96 x:0 0 0 2024-04-21T23:54:14.172 INFO:tasks.workunit.client.0.smithi110.stdout:7/455: dwrite d10/d45/d51/d88/d39/f5b [0,4194304] 0 2024-04-21T23:54:14.307 INFO:tasks.workunit.client.0.smithi110.stdout:6/438: getdents d16/d3d/d40/d46/d5f 0 2024-04-21T23:54:14.347 INFO:tasks.workunit.client.0.smithi110.stdout:6/439: readlink d16/d1d/l78 0 2024-04-21T23:54:14.348 INFO:tasks.workunit.client.0.smithi110.stdout:7/456: dread - d10/d45/d51/d88/f7c zero size 2024-04-21T23:54:15.688 INFO:tasks.workunit.client.0.smithi110.stdout:0/439: creat d0/d56/f97 x:0 0 0 2024-04-21T23:54:16.139 INFO:tasks.workunit.client.0.smithi110.stdout:2/457: creat d9/d1a/d1d/d2b/d54/d77/f99 x:0 0 0 2024-04-21T23:54:16.507 INFO:tasks.workunit.client.0.smithi110.stdout:0/440: symlink d0/d2a/l98 0 2024-04-21T23:54:17.050 INFO:tasks.workunit.client.0.smithi110.stdout:2/458: creat d9/d1a/d1d/d4e/f9a x:0 0 0 2024-04-21T23:54:18.067 INFO:tasks.workunit.client.0.smithi110.stdout:2/459: fdatasync d9/d25/d1b/d45/f48 0 2024-04-21T23:54:18.080 INFO:tasks.workunit.client.0.smithi110.stdout:4/394: link d1/d11/d20/d23/d3c/l44 d1/d11/d20/l7f 0 2024-04-21T23:54:18.088 INFO:tasks.workunit.client.0.smithi110.stdout:1/396: write d1/d2/d14/d16/d29/f32 [1823071,15671] 0 2024-04-21T23:54:18.206 INFO:tasks.workunit.client.0.smithi110.stdout:8/486: write d5/da/d17/d6c/d72/d73/d78/f9f [643751,77973] 0 2024-04-21T23:54:18.460 INFO:tasks.workunit.client.0.smithi110.stdout:1/397: dread d1/d2/d1b/d10/f12 [0,4194304] 0 2024-04-21T23:54:18.465 INFO:tasks.workunit.client.0.smithi110.stdout:8/487: sync 2024-04-21T23:54:18.546 INFO:tasks.workunit.client.0.smithi110.stdout:8/488: read d5/f54 [1444609,42008] 0 2024-04-21T23:54:18.911 INFO:tasks.workunit.client.0.smithi110.stdout:7/457: write d10/d45/d60/d5e/d65/f7a [425687,3636] 0 2024-04-21T23:54:18.915 INFO:tasks.workunit.client.0.smithi110.stdout:0/441: symlink d0/d16/l99 0 2024-04-21T23:54:18.944 INFO:tasks.workunit.client.0.smithi110.stdout:9/445: write d1/d29/d2a/d2b/f7f [940915,52459] 0 2024-04-21T23:54:18.956 INFO:tasks.workunit.client.0.smithi110.stdout:6/440: write d16/d1d/d38/f4f [147359,73918] 0 2024-04-21T23:54:19.203 INFO:tasks.workunit.client.0.smithi110.stdout:1/398: unlink d1/d1d/d4a/f59 0 2024-04-21T23:54:19.323 INFO:tasks.workunit.client.0.smithi110.stdout:3/432: creat d6/f89 x:0 0 0 2024-04-21T23:54:19.406 INFO:tasks.workunit.client.0.smithi110.stdout:8/489: fdatasync d5/d4f/d79/fa5 0 2024-04-21T23:54:19.438 INFO:tasks.workunit.client.0.smithi110.stdout:5/448: dwrite d7/d9/f3b [8388608,4194304] 0 2024-04-21T23:54:19.648 INFO:tasks.workunit.client.0.smithi110.stdout:2/460: creat d9/d1a/d1d/d2b/f9b x:0 0 0 2024-04-21T23:54:19.787 INFO:tasks.workunit.client.0.smithi110.stdout:0/442: creat d0/d27/f9a x:0 0 0 2024-04-21T23:54:20.047 INFO:tasks.workunit.client.0.smithi110.stdout:1/399: readlink d1/d2/d14/l85 0 2024-04-21T23:54:20.524 INFO:tasks.workunit.client.0.smithi110.stdout:8/490: rename d5/d24/f56 to d5/da/d17/d6c/fad 0 2024-04-21T23:54:20.624 INFO:tasks.workunit.client.0.smithi110.stdout:4/395: dwrite d1/f39 [0,4194304] 0 2024-04-21T23:54:21.291 INFO:tasks.workunit.client.0.smithi110.stdout:6/441: unlink d16/d1d/d38/f45 0 2024-04-21T23:54:21.300 INFO:tasks.workunit.client.0.smithi110.stdout:0/443: unlink d0/d27/d4b/f6c 0 2024-04-21T23:54:21.340 INFO:tasks.workunit.client.0.smithi110.stdout:0/444: chown d0/d16/l78 133201 1 2024-04-21T23:54:21.512 INFO:tasks.workunit.client.0.smithi110.stdout:9/446: creat d1/d29/d2a/d2b/d58/f95 x:0 0 0 2024-04-21T23:54:21.624 INFO:tasks.workunit.client.0.smithi110.stdout:1/400: fsync d1/dd/d23/f3d 0 2024-04-21T23:54:21.634 INFO:tasks.workunit.client.0.smithi110.stdout:7/458: write d10/d45/d51/d88/f74 [162637,96095] 0 2024-04-21T23:54:21.735 INFO:tasks.workunit.client.0.smithi110.stdout:3/433: symlink d6/d12/l8a 0 2024-04-21T23:54:22.677 INFO:tasks.workunit.client.0.smithi110.stdout:5/449: dwrite d7/d22/d5b/f6c [0,4194304] 0 2024-04-21T23:54:22.697 INFO:tasks.workunit.client.0.smithi110.stdout:0/445: mknod d0/d27/c9b 0 2024-04-21T23:54:22.804 INFO:tasks.workunit.client.0.smithi110.stdout:9/447: rmdir d1/d29 39 2024-04-21T23:54:22.918 INFO:tasks.workunit.client.0.smithi110.stdout:5/450: read d7/d9/d17/f18 [10642765,53281] 0 2024-04-21T23:54:22.919 INFO:tasks.workunit.client.0.smithi110.stdout:0/446: chown d0/d16/c38 1011 1 2024-04-21T23:54:23.784 INFO:tasks.workunit.client.0.smithi110.stdout:8/491: mknod d5/d24/d33/d3d/d82/da8/cae 0 2024-04-21T23:54:24.282 INFO:tasks.workunit.client.0.smithi110.stdout:6/442: truncate d16/d1e/f6c 60977 0 2024-04-21T23:54:24.687 INFO:tasks.workunit.client.0.smithi110.stdout:4/396: write d1/d11/d20/d50/f70 [255212,1576] 0 2024-04-21T23:54:24.778 INFO:tasks.workunit.client.0.smithi110.stdout:2/461: dwrite d9/d25/d1c/f3c [0,4194304] 0 2024-04-21T23:54:24.904 INFO:tasks.workunit.client.0.smithi110.stdout:0/447: truncate d0/d27/d4b/f54 3544952 0 2024-04-21T23:54:25.292 INFO:tasks.workunit.client.0.smithi110.stdout:8/492: unlink d5/da/d17/d6c/d72/ca4 0 2024-04-21T23:54:25.511 INFO:tasks.workunit.client.0.smithi110.stdout:7/459: write d10/d45/d60/f78 [2210999,11176] 0 2024-04-21T23:54:25.556 INFO:tasks.workunit.client.0.smithi110.stdout:1/401: dwrite d1/d2/d1b/f13 [0,4194304] 0 2024-04-21T23:54:26.971 INFO:tasks.workunit.client.0.smithi110.stdout:2/462: rmdir d9/d1a/d1d/d4a/d6b/d3a 39 2024-04-21T23:54:27.206 INFO:tasks.workunit.client.0.smithi110.stdout:4/397: rename d1/d11/d20/d23/d1c/d47/c46 to d1/d11/d20/d50/c80 0 2024-04-21T23:54:27.395 INFO:tasks.workunit.client.0.smithi110.stdout:8/493: fsync d5/d4f/f5f 0 2024-04-21T23:54:27.474 INFO:tasks.workunit.client.0.smithi110.stdout:6/443: symlink d16/d1e/l8f 0 2024-04-21T23:54:27.504 INFO:tasks.workunit.client.0.smithi110.stdout:6/444: read - d16/d3d/d40/f82 zero size 2024-04-21T23:54:28.025 INFO:tasks.workunit.client.0.smithi110.stdout:3/434: dwrite d6/d12/d14/d3f/f61 [0,4194304] 0 2024-04-21T23:54:28.790 INFO:tasks.workunit.client.0.smithi110.stdout:1/402: mkdir d1/d2/d14/d65/d8a 0 2024-04-21T23:54:29.003 INFO:tasks.workunit.client.0.smithi110.stdout:7/460: mknod d10/d45/d60/d5e/d65/d8a/ca2 0 2024-04-21T23:54:29.128 INFO:tasks.workunit.client.0.smithi110.stdout:5/451: getdents d7/d24/d31 0 2024-04-21T23:54:29.357 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:54:29.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:54:29.718 INFO:tasks.workunit.client.0.smithi110.stdout:8/494: creat d5/d74/faf x:0 0 0 2024-04-21T23:54:30.092 INFO:tasks.workunit.client.0.smithi110.stdout:2/463: rename d9/d25/d1b/d60/f72 to d9/d1a/d1d/d2b/f9c 0 2024-04-21T23:54:30.183 INFO:tasks.workunit.client.0.smithi110.stdout:4/398: link d1/d11/d20/d23/d1c/f6f d1/d11/d20/d23/d1c/f81 0 2024-04-21T23:54:30.206 INFO:tasks.workunit.client.0.smithi110.stdout:0/448: dwrite d0/d16/d42/f61 [0,4194304] 0 2024-04-21T23:54:30.400 INFO:tasks.workunit.client.0.smithi110.stdout:6/445: truncate d16/d1d/f2f 1001670 0 2024-04-21T23:54:30.923 INFO:tasks.workunit.client.0.smithi110.stdout:5/452: mknod d7/d22/d5b/d68/c7c 0 2024-04-21T23:54:31.189 INFO:tasks.workunit.client.0.smithi110.stdout:3/435: rename d6/f34 to d6/d78/f8b 0 2024-04-21T23:54:31.218 INFO:tasks.workunit.client.0.smithi110.stdout:9/448: write d1/d29/d2a/dc/f90 [1937195,123748] 0 2024-04-21T23:54:31.337 INFO:tasks.workunit.client.0.smithi110.stdout:0/449: truncate d0/d14/d23/f3a 3213423 0 2024-04-21T23:54:31.371 INFO:tasks.workunit.client.0.smithi110.stdout:3/436: chown d6/d12/d14/l21 206643 1 2024-04-21T23:54:31.700 INFO:tasks.workunit.client.0.smithi110.stdout:2/464: creat d9/d25/d1c/d82/f9d x:0 0 0 2024-04-21T23:54:31.737 INFO:tasks.workunit.client.0.smithi110.stdout:2/465: stat d9/d25/d1b/d45/f80 0 2024-04-21T23:54:31.934 INFO:tasks.workunit.client.0.smithi110.stdout:7/461: rename d10/d45/d9b to d10/d45/d60/d5e/d65/da3 0 2024-04-21T23:54:32.471 INFO:tasks.workunit.client.0.smithi110.stdout:6/446: mkdir d16/d1e/d24/d90 0 2024-04-21T23:54:32.508 INFO:tasks.workunit.client.0.smithi110.stdout:0/450: symlink d0/d56/l9c 0 2024-04-21T23:54:32.537 INFO:tasks.workunit.client.0.smithi110.stdout:0/451: chown d0/d16/d93 1573 1 2024-04-21T23:54:33.027 INFO:tasks.workunit.client.0.smithi110.stdout:8/495: rename d5/da/d17/f7a to d5/d24/d33/d3d/d5c/fb0 0 2024-04-21T23:54:33.420 INFO:tasks.workunit.client.0.smithi110.stdout:0/452: symlink d0/d27/l9d 0 2024-04-21T23:54:33.672 INFO:tasks.workunit.client.0.smithi110.stdout:3/437: mknod d6/d12/d16/d6f/d7a/c8c 0 2024-04-21T23:54:33.703 INFO:tasks.workunit.client.0.smithi110.stdout:1/403: write d1/f26 [305065,89338] 0 2024-04-21T23:54:33.829 INFO:tasks.workunit.client.0.smithi110.stdout:8/496: creat d5/d74/fb1 x:0 0 0 2024-04-21T23:54:34.460 INFO:tasks.workunit.client.0.smithi110.stdout:1/404: mkdir d1/d2/d30/d8b 0 2024-04-21T23:54:34.801 INFO:tasks.workunit.client.0.smithi110.stdout:7/462: rmdir d10/d45/d51/d88/d39 39 2024-04-21T23:54:34.807 INFO:tasks.workunit.client.0.smithi110.stdout:9/449: link d1/d29/d2a/d3c/c51 d1/d29/d4d/c96 0 2024-04-21T23:54:34.883 INFO:tasks.workunit.client.0.smithi110.stdout:7/463: stat d10/d45/d51/d58/l8d 0 2024-04-21T23:54:35.011 INFO:tasks.workunit.client.0.smithi110.stdout:2/466: getdents d9/d25/d1b 0 2024-04-21T23:54:35.448 INFO:tasks.workunit.client.0.smithi110.stdout:0/453: creat d0/d14/d23/f9e x:0 0 0 2024-04-21T23:54:35.488 INFO:tasks.workunit.client.0.smithi110.stdout:4/399: dwrite f0 [0,4194304] 0 2024-04-21T23:54:35.617 INFO:tasks.workunit.client.0.smithi110.stdout:9/450: mkdir d1/d29/d2a/d2b/d57/d97 0 2024-04-21T23:54:36.062 INFO:tasks.workunit.client.0.smithi110.stdout:5/453: mknod d7/c7d 0 2024-04-21T23:54:36.244 INFO:tasks.workunit.client.0.smithi110.stdout:4/400: mknod d1/d11/d20/d23/d1c/d47/c82 0 2024-04-21T23:54:36.515 INFO:tasks.workunit.client.0.smithi110.stdout:0/454: truncate d0/d16/d5d/f5e 1066432 0 2024-04-21T23:54:36.631 INFO:tasks.workunit.client.0.smithi110.stdout:5/454: symlink d7/d9/d17/l7e 0 2024-04-21T23:54:36.650 INFO:tasks.workunit.client.0.smithi110.stdout:5/455: stat d7/d9/f3b 0 2024-04-21T23:54:36.987 INFO:tasks.workunit.client.0.smithi110.stdout:9/451: mkdir d1/d29/d2a/dc/d30/d79/d98 0 2024-04-21T23:54:37.214 INFO:tasks.workunit.client.0.smithi110.stdout:7/464: unlink d10/f5f 0 2024-04-21T23:54:37.523 INFO:tasks.workunit.client.0.smithi110.stdout:4/401: mkdir d1/d11/d20/d23/d3c/d83 0 2024-04-21T23:54:37.681 INFO:tasks.workunit.client.0.smithi110.stdout:9/452: mkdir d1/d29/d59/d99 0 2024-04-21T23:54:37.970 INFO:tasks.workunit.client.0.smithi110.stdout:7/465: unlink d10/l24 0 2024-04-21T23:54:38.348 INFO:tasks.workunit.client.0.smithi110.stdout:9/453: creat d1/d29/d2a/dc/d30/f9a x:0 0 0 2024-04-21T23:54:38.424 INFO:tasks.workunit.client.0.smithi110.stdout:6/447: write d16/d3d/d40/d46/f67 [129522,94675] 0 2024-04-21T23:54:38.896 INFO:tasks.workunit.client.0.smithi110.stdout:3/438: write d6/d12/d14/d3f/f49 [1307671,118683] 0 2024-04-21T23:54:39.420 INFO:tasks.workunit.client.0.smithi110.stdout:2/467: write d9/f15 [4388970,4641] 0 2024-04-21T23:54:39.622 INFO:tasks.workunit.client.0.smithi110.stdout:2/468: stat d9/f15 0 2024-04-21T23:54:39.657 INFO:tasks.workunit.client.0.smithi110.stdout:6/448: mknod d16/d1d/d38/d48/d5e/c91 0 2024-04-21T23:54:39.717 INFO:tasks.workunit.client.0.smithi110.stdout:1/405: dwrite d1/d2/d14/d16/f50 [0,4194304] 0 2024-04-21T23:54:39.884 INFO:tasks.workunit.client.0.smithi110.stdout:8/497: dwrite d5/da/d17/d6c/d72/d73/d78/d8c/f83 [0,4194304] 0 2024-04-21T23:54:39.974 INFO:tasks.workunit.client.0.smithi110.stdout:2/469: chown d9/d25/d1c 1571645 1 2024-04-21T23:54:40.010 INFO:tasks.workunit.client.0.smithi110.stdout:6/449: readlink d16/d3d/d40/l69 0 2024-04-21T23:54:40.553 INFO:tasks.workunit.client.0.smithi110.stdout:8/498: truncate d5/d4f/d79/fa5 848962 0 2024-04-21T23:54:40.928 INFO:tasks.workunit.client.0.smithi110.stdout:5/456: dwrite d7/d9/d17/f18 [4194304,4194304] 0 2024-04-21T23:54:41.064 INFO:tasks.workunit.client.0.smithi110.stdout:7/466: symlink d10/d45/d60/la4 0 2024-04-21T23:54:41.425 INFO:tasks.workunit.client.0.smithi110.stdout:9/454: dwrite d1/d29/d2a/d6/d1d/f7c [0,4194304] 0 2024-04-21T23:54:41.561 INFO:tasks.workunit.client.0.smithi110.stdout:5/457: unlink d7/d9/d17/d48/d69/c6e 0 2024-04-21T23:54:41.583 INFO:tasks.workunit.client.0.smithi110.stdout:3/439: write d6/d12/d16/f5e [1566459,45074] 0 2024-04-21T23:54:41.616 INFO:tasks.workunit.client.0.smithi110.stdout:8/499: truncate d5/d24/d33/d3d/d5c/fb0 9293259 0 2024-04-21T23:54:41.804 INFO:tasks.workunit.client.0.smithi110.stdout:2/470: getdents d9/d1a/d1d/d2b/d5b 0 2024-04-21T23:54:41.942 INFO:tasks.workunit.client.0.smithi110.stdout:9/455: dread - d1/f87 zero size 2024-04-21T23:54:42.113 INFO:tasks.workunit.client.0.smithi110.stdout:8/500: unlink d5/da/l1e 0 2024-04-21T23:54:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:9/456: creat d1/d29/d2a/d2b/d57/f9b x:0 0 0 2024-04-21T23:54:42.688 INFO:tasks.workunit.client.0.smithi110.stdout:9/457: chown d1/d29/l49 15 1 2024-04-21T23:54:42.710 INFO:tasks.workunit.client.0.smithi110.stdout:0/455: dread d0/d14/d23/f3a [0,4194304] 0 2024-04-21T23:54:42.961 INFO:tasks.workunit.client.0.smithi110.stdout:3/440: mkdir d6/d12/d3c/d8d 0 2024-04-21T23:54:42.995 INFO:tasks.workunit.client.0.smithi110.stdout:6/450: write d16/f63 [1473018,61643] 0 2024-04-21T23:54:43.235 INFO:tasks.workunit.client.0.smithi110.stdout:2/471: rmdir d9/d25/d1b/d45/d50/d94 39 2024-04-21T23:54:43.350 INFO:tasks.workunit.client.0.smithi110.stdout:1/406: dwrite d1/dd/d23/f54 [0,4194304] 0 2024-04-21T23:54:43.530 INFO:tasks.workunit.client.0.smithi110.stdout:9/458: mknod d1/d29/d2a/dc/c9c 0 2024-04-21T23:54:43.550 INFO:tasks.workunit.client.0.smithi110.stdout:0/456: dread - d0/d14/f6e zero size 2024-04-21T23:54:43.791 INFO:tasks.workunit.client.0.smithi110.stdout:6/451: creat d16/d1d/d38/d48/d5e/d6a/f92 x:0 0 0 2024-04-21T23:54:43.908 INFO:tasks.workunit.client.0.smithi110.stdout:7/467: getdents d10/d45/d51/d88/d39 0 2024-04-21T23:54:43.949 INFO:tasks.workunit.client.0.smithi110.stdout:2/472: readlink d9/d25/d1c/l2a 0 2024-04-21T23:54:43.995 INFO:tasks.workunit.client.0.smithi110.stdout:2/473: chown d9/d25/d1b/d45/d4d 46585 1 2024-04-21T23:54:44.691 INFO:tasks.workunit.client.0.smithi110.stdout:4/402: rename d1/d11/l4a to d1/d11/d12/l84 0 2024-04-21T23:54:44.715 INFO:tasks.workunit.client.0.smithi110.stdout:0/457: fsync d0/d27/f82 0 2024-04-21T23:54:44.763 INFO:tasks.workunit.client.0.smithi110.stdout:9/459: chown d1/d29/d59/f88 232 1 2024-04-21T23:54:45.041 INFO:tasks.workunit.client.0.smithi110.stdout:7/468: creat d10/d45/d60/d5e/d65/d8a/fa5 x:0 0 0 2024-04-21T23:54:45.090 INFO:tasks.workunit.client.0.smithi110.stdout:5/458: write d7/d24/d37/d38/f4d [9488962,47331] 0 2024-04-21T23:54:45.885 INFO:tasks.workunit.client.0.smithi110.stdout:0/458: mknod d0/d25/d5a/d63/c9f 0 2024-04-21T23:54:45.955 INFO:tasks.workunit.client.0.smithi110.stdout:4/403: truncate d1/d11/d12/f68 908502 0 2024-04-21T23:54:46.381 INFO:tasks.workunit.client.0.smithi110.stdout:8/501: write d5/f55 [3030,130996] 0 2024-04-21T23:54:46.466 INFO:tasks.workunit.client.0.smithi110.stdout:7/469: dread d10/d15/d22/f42 [0,4194304] 0 2024-04-21T23:54:46.777 INFO:tasks.workunit.client.0.smithi110.stdout:3/441: dwrite d6/f89 [0,4194304] 0 2024-04-21T23:54:46.894 INFO:tasks.workunit.client.0.smithi110.stdout:2/474: rename d9/d25/c59 to d9/d1a/d1d/d2b/d54/d77/c9e 0 2024-04-21T23:54:46.987 INFO:tasks.workunit.client.0.smithi110.stdout:1/407: write d1/d2/d14/d16/d29/f32 [63347,90106] 0 2024-04-21T23:54:47.327 INFO:tasks.workunit.client.0.smithi110.stdout:6/452: dwrite ff [0,4194304] 0 2024-04-21T23:54:47.498 INFO:tasks.workunit.client.0.smithi110.stdout:8/502: creat d5/da/d17/d6c/d72/d73/d78/d8c/fb2 x:0 0 0 2024-04-21T23:54:47.708 INFO:tasks.workunit.client.0.smithi110.stdout:0/459: mkdir d0/d27/d4b/da0 0 2024-04-21T23:54:47.718 INFO:tasks.workunit.client.0.smithi110.stdout:6/453: dwrite ff [0,4194304] 0 2024-04-21T23:54:47.850 INFO:tasks.workunit.client.0.smithi110.stdout:8/503: sync 2024-04-21T23:54:47.896 INFO:tasks.workunit.client.0.smithi110.stdout:6/454: read d16/f63 [3024946,118681] 0 2024-04-21T23:54:48.023 INFO:tasks.workunit.client.0.smithi110.stdout:2/475: dread d9/d25/f46 [4194304,4194304] 0 2024-04-21T23:54:48.044 INFO:tasks.workunit.client.0.smithi110.stdout:3/442: creat d6/d12/d16/d6f/f8e x:0 0 0 2024-04-21T23:54:48.238 INFO:tasks.workunit.client.0.smithi110.stdout:1/408: dread - d1/d1d/f68 zero size 2024-04-21T23:54:48.267 INFO:tasks.workunit.client.0.smithi110.stdout:2/476: dread d9/d1a/f1e [0,4194304] 0 2024-04-21T23:54:48.757 INFO:tasks.workunit.client.0.smithi110.stdout:0/460: fsync d0/d27/d4b/f4f 0 2024-04-21T23:54:48.858 INFO:tasks.workunit.client.0.smithi110.stdout:3/443: fsync d6/d12/d14/f25 0 2024-04-21T23:54:49.238 INFO:tasks.workunit.client.0.smithi110.stdout:3/444: chown d6/d12/d16/l52 531435 1 2024-04-21T23:54:49.274 INFO:tasks.workunit.client.0.smithi110.stdout:5/459: dwrite f5 [0,4194304] 0 2024-04-21T23:54:49.349 INFO:tasks.workunit.client.0.smithi110.stdout:9/460: dwrite d1/d29/d2a/d6/d1d/f94 [0,4194304] 0 2024-04-21T23:54:49.482 INFO:tasks.workunit.client.0.smithi110.stdout:4/404: write d1/d11/f41 [7450191,6400] 0 2024-04-21T23:54:49.618 INFO:tasks.workunit.client.0.smithi110.stdout:6/455: rmdir d16/d1e/d24/d7b 39 2024-04-21T23:54:49.889 INFO:tasks.workunit.client.0.smithi110.stdout:0/461: mknod d0/d14/d23/d6d/ca1 0 2024-04-21T23:54:50.621 INFO:tasks.workunit.client.0.smithi110.stdout:9/461: mkdir d1/d29/d2a/d9d 0 2024-04-21T23:54:50.729 INFO:tasks.workunit.client.0.smithi110.stdout:3/445: truncate d6/d12/d50/f6c 362085 0 2024-04-21T23:54:50.912 INFO:tasks.workunit.client.0.smithi110.stdout:0/462: truncate d0/d56/f97 423399 0 2024-04-21T23:54:51.230 INFO:tasks.workunit.client.0.smithi110.stdout:5/460: mkdir d7/d24/d3a/d7f 0 2024-04-21T23:54:51.581 INFO:tasks.workunit.client.0.smithi110.stdout:4/405: symlink d1/d35/l85 0 2024-04-21T23:54:51.603 INFO:tasks.workunit.client.0.smithi110.stdout:3/446: fdatasync d6/d12/f29 0 2024-04-21T23:54:51.615 INFO:tasks.workunit.client.0.smithi110.stdout:1/409: write d1/d2/d1b/d10/d5c/f76 [149231,91632] 0 2024-04-21T23:54:51.719 INFO:tasks.workunit.client.0.smithi110.stdout:3/447: chown d6/d12/d14/c4c 340783 1 2024-04-21T23:54:51.885 INFO:tasks.workunit.client.0.smithi110.stdout:2/477: getdents d9/d25/d1b/d45/d50/d68 0 2024-04-21T23:54:51.922 INFO:tasks.workunit.client.0.smithi110.stdout:7/470: link d10/d45/d60/d5e/d65/f7a d10/d45/fa6 0 2024-04-21T23:54:52.103 INFO:tasks.workunit.client.0.smithi110.stdout:9/462: mknod d1/d29/c9e 0 2024-04-21T23:54:52.357 INFO:tasks.workunit.client.0.smithi110.stdout:5/461: dread d7/d9/d17/f1c [0,4194304] 0 2024-04-21T23:54:52.641 INFO:tasks.workunit.client.0.smithi110.stdout:2/478: fdatasync f1 0 2024-04-21T23:54:52.665 INFO:tasks.workunit.client.0.smithi110.stdout:2/479: readlink d9/l23 0 2024-04-21T23:54:52.793 INFO:tasks.workunit.client.0.smithi110.stdout:7/471: mknod d10/d27/ca7 0 2024-04-21T23:54:52.904 INFO:tasks.workunit.client.0.smithi110.stdout:9/463: fdatasync d1/d29/d59/f6d 0 2024-04-21T23:54:53.121 INFO:tasks.workunit.client.0.smithi110.stdout:6/456: link d16/l29 d16/d3d/d40/d46/l93 0 2024-04-21T23:54:53.158 INFO:tasks.workunit.client.0.smithi110.stdout:6/457: chown d16/d3d/d40/d46/l73 211654184 1 2024-04-21T23:54:53.275 INFO:tasks.workunit.client.0.smithi110.stdout:5/462: unlink d7/d24/d3a/d40/f41 0 2024-04-21T23:54:53.966 INFO:tasks.workunit.client.0.smithi110.stdout:2/480: creat d9/d25/d1c/d82/f9f x:0 0 0 2024-04-21T23:54:54.337 INFO:tasks.workunit.client.0.smithi110.stdout:9/464: fdatasync d1/d29/d6f/f83 0 2024-04-21T23:54:54.505 INFO:tasks.workunit.client.0.smithi110.stdout:6/458: mkdir d16/d1d/d38/d48/d5e/d62/d94 0 2024-04-21T23:54:55.392 INFO:tasks.workunit.client.0.smithi110.stdout:0/463: write d0/d14/d23/f9e [512049,87488] 0 2024-04-21T23:54:55.422 INFO:tasks.workunit.client.0.smithi110.stdout:6/459: rmdir d16/d1e/d24/d66 39 2024-04-21T23:54:55.968 INFO:tasks.workunit.client.0.smithi110.stdout:7/472: creat d10/d45/d51/d88/d39/d7f/d80/fa8 x:0 0 0 2024-04-21T23:54:55.973 INFO:tasks.workunit.client.0.smithi110.stdout:1/410: write d1/f40 [5714890,90203] 0 2024-04-21T23:54:56.047 INFO:tasks.workunit.client.0.smithi110.stdout:8/504: rename d5/da/d17/d6c/d7d/fa7 to d5/fb3 0 2024-04-21T23:54:56.109 INFO:tasks.workunit.client.0.smithi110.stdout:1/411: chown d1/dd/d23/d48/l5a 148712 1 2024-04-21T23:54:56.562 INFO:tasks.workunit.client.0.smithi110.stdout:6/460: dread d16/d1d/d38/f4f [0,4194304] 0 2024-04-21T23:54:56.704 INFO:tasks.workunit.client.0.smithi110.stdout:8/505: unlink d5/f39 0 2024-04-21T23:54:56.781 INFO:tasks.workunit.client.0.smithi110.stdout:6/461: sync 2024-04-21T23:54:56.904 INFO:tasks.workunit.client.0.smithi110.stdout:1/412: fdatasync d1/d2/d14/d16/d29/f41 0 2024-04-21T23:54:57.072 INFO:tasks.workunit.client.0.smithi110.stdout:4/406: rename d1/d11/d20/c59 to d1/d11/d20/d50/c86 0 2024-04-21T23:54:57.089 INFO:tasks.workunit.client.0.smithi110.stdout:1/413: rename d1/d2 to d1/d2/d1b/d10/d5c/d77/d8c 22 2024-04-21T23:54:57.196 INFO:tasks.workunit.client.0.smithi110.stdout:7/473: truncate d10/d45/d60/d5e/d65/f7a 728083 0 2024-04-21T23:54:57.687 INFO:tasks.workunit.client.0.smithi110.stdout:4/407: symlink d1/d11/d20/d23/d1c/d47/d4f/d56/l87 0 2024-04-21T23:54:57.941 INFO:tasks.workunit.client.0.smithi110.stdout:2/481: write d9/d25/d1b/f62 [4012956,12883] 0 2024-04-21T23:54:58.048 INFO:tasks.workunit.client.0.smithi110.stdout:5/463: dwrite d7/d24/d3a/d40/f57 [0,4194304] 0 2024-04-21T23:54:58.278 INFO:tasks.workunit.client.0.smithi110.stdout:6/462: symlink d16/d1d/d38/l95 0 2024-04-21T23:54:58.410 INFO:tasks.workunit.client.0.smithi110.stdout:0/464: getdents d0/d16/d5d 0 2024-04-21T23:54:58.637 INFO:tasks.workunit.client.0.smithi110.stdout:9/465: dwrite d1/d29/d2a/d6/d1d/f5e [0,4194304] 0 2024-04-21T23:54:58.804 INFO:tasks.workunit.client.0.smithi110.stdout:4/408: creat d1/d11/d12/d26/f88 x:0 0 0 2024-04-21T23:54:58.860 INFO:tasks.workunit.client.0.smithi110.stdout:9/466: chown d1/d29/d2a/dc/f67 6717275 1 2024-04-21T23:54:59.407 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:54:59.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:54:59.454 INFO:tasks.workunit.client.0.smithi110.stdout:6/463: dread d16/f1b [0,4194304] 0 2024-04-21T23:54:59.828 INFO:tasks.workunit.client.0.smithi110.stdout:4/409: truncate d1/d11/d20/d23/d1c/d40/f63 3784786 0 2024-04-21T23:54:59.905 INFO:tasks.workunit.client.0.smithi110.stdout:7/474: link d10/d45/d60/d5e/d65/c67 d10/d45/d51/d88/d39/ca9 0 2024-04-21T23:54:59.947 INFO:tasks.workunit.client.0.smithi110.stdout:7/475: stat d10/d45/d51/d88/d39/d7f/d80/l68 0 2024-04-21T23:55:00.058 INFO:tasks.workunit.client.0.smithi110.stdout:2/482: unlink d9/d25/c22 0 2024-04-21T23:55:00.659 INFO:tasks.workunit.client.0.smithi110.stdout:8/506: write d5/da/d17/d6c/d95/fa6 [206824,30699] 0 2024-04-21T23:55:00.912 INFO:tasks.workunit.client.0.smithi110.stdout:7/476: creat d10/d45/d51/d88/d46/faa x:0 0 0 2024-04-21T23:55:00.988 INFO:tasks.workunit.client.0.smithi110.stdout:2/483: mkdir d9/d25/d1c/da0 0 2024-04-21T23:55:01.011 INFO:tasks.workunit.client.0.smithi110.stdout:1/414: write d1/d2/d14/d16/d29/f32 [2129146,9405] 0 2024-04-21T23:55:01.261 INFO:tasks.workunit.client.0.smithi110.stdout:8/507: creat d5/d4f/d79/fb4 x:0 0 0 2024-04-21T23:55:01.570 INFO:tasks.workunit.client.0.smithi110.stdout:4/410: rename d1/d11/d20/c78 to d1/d11/d20/d23/d1c/d47/d4f/d6a/c89 0 2024-04-21T23:55:01.858 INFO:tasks.workunit.client.0.smithi110.stdout:2/484: read - d9/d1a/d1d/f75 zero size 2024-04-21T23:55:01.996 INFO:tasks.workunit.client.0.smithi110.stdout:8/508: creat d5/da/d17/d6c/fb5 x:0 0 0 2024-04-21T23:55:02.191 INFO:tasks.workunit.client.0.smithi110.stdout:3/448: creat d6/d12/f8f x:0 0 0 2024-04-21T23:55:02.275 INFO:tasks.workunit.client.0.smithi110.stdout:8/509: sync 2024-04-21T23:55:02.506 INFO:tasks.workunit.client.0.smithi110.stdout:2/485: truncate d9/d25/d1b/d45/d4d/f73 291984 0 2024-04-21T23:55:02.546 INFO:tasks.workunit.client.0.smithi110.stdout:5/464: write d7/d24/d49/d61/f75 [769295,76308] 0 2024-04-21T23:55:02.666 INFO:tasks.workunit.client.0.smithi110.stdout:3/449: fdatasync d6/d12/d14/d4b/f63 0 2024-04-21T23:55:02.893 INFO:tasks.workunit.client.0.smithi110.stdout:4/411: creat d1/d11/f8a x:0 0 0 2024-04-21T23:55:02.912 INFO:tasks.workunit.client.0.smithi110.stdout:9/467: write d1/d29/d2a/d2b/d58/d7b/f91 [801445,43575] 0 2024-04-21T23:55:03.170 INFO:tasks.workunit.client.0.smithi110.stdout:9/468: dread d1/d29/d2a/d6/d1d/f5e [0,4194304] 0 2024-04-21T23:55:03.183 INFO:tasks.workunit.client.0.smithi110.stdout:5/465: read d7/d9/f21 [1935677,19506] 0 2024-04-21T23:55:03.467 INFO:tasks.workunit.client.0.smithi110.stdout:6/464: write d16/d3d/f43 [915309,112494] 0 2024-04-21T23:55:03.536 INFO:tasks.workunit.client.0.smithi110.stdout:0/465: write d0/d14/f8f [9419517,63955] 0 2024-04-21T23:55:03.612 INFO:tasks.workunit.client.0.smithi110.stdout:3/450: stat d6/d12/d16/c1e 0 2024-04-21T23:55:03.644 INFO:tasks.workunit.client.0.smithi110.stdout:3/451: dread - d6/d12/d14/f2e zero size 2024-04-21T23:55:04.254 INFO:tasks.workunit.client.0.smithi110.stdout:9/469: dread - d1/d29/d2a/dc/d30/f92 zero size 2024-04-21T23:55:04.326 INFO:tasks.workunit.client.0.smithi110.stdout:6/465: mkdir d16/d3d/d40/d96 0 2024-04-21T23:55:04.420 INFO:tasks.workunit.client.0.smithi110.stdout:0/466: dread - d0/d16/d42/d50/f89 zero size 2024-04-21T23:55:04.452 INFO:tasks.workunit.client.0.smithi110.stdout:0/467: chown d0/d14/d23/f3a 5697 1 2024-04-21T23:55:04.538 INFO:tasks.workunit.client.0.smithi110.stdout:3/452: read d6/d12/d14/d32/f4e [11133401,8205] 0 2024-04-21T23:55:05.066 INFO:tasks.workunit.client.0.smithi110.stdout:7/477: write d10/d45/d51/d88/f74 [354163,111221] 0 2024-04-21T23:55:05.155 INFO:tasks.workunit.client.0.smithi110.stdout:4/412: rename d1/d11/d20/d23/d1c/c22 to d1/d11/d12/d26/d5f/c8b 0 2024-04-21T23:55:05.424 INFO:tasks.workunit.client.0.smithi110.stdout:0/468: creat d0/d16/d42/d50/d83/fa2 x:0 0 0 2024-04-21T23:55:05.573 INFO:tasks.workunit.client.0.smithi110.stdout:6/466: dread d16/d3d/d40/d46/f67 [0,4194304] 0 2024-04-21T23:55:05.623 INFO:tasks.workunit.client.0.smithi110.stdout:1/415: dwrite d1/f83 [0,4194304] 0 2024-04-21T23:55:05.969 INFO:tasks.workunit.client.0.smithi110.stdout:9/470: symlink d1/d29/d2a/dc/d30/d79/d98/l9f 0 2024-04-21T23:55:06.448 INFO:tasks.workunit.client.0.smithi110.stdout:8/510: write d5/d24/d33/f96 [493585,126470] 0 2024-04-21T23:55:06.623 INFO:tasks.workunit.client.0.smithi110.stdout:2/486: write d9/d1a/d1d/d2b/f56 [2049205,23880] 0 2024-04-21T23:55:06.659 INFO:tasks.workunit.client.0.smithi110.stdout:1/416: chown d1/d2/l5 253 1 2024-04-21T23:55:06.701 INFO:tasks.workunit.client.0.smithi110.stdout:2/487: chown d9/d25/f2f 4754427 1 2024-04-21T23:55:06.957 INFO:tasks.workunit.client.0.smithi110.stdout:9/471: unlink d1/d29/d2a/d2b/d58/f8c 0 2024-04-21T23:55:06.990 INFO:tasks.workunit.client.0.smithi110.stdout:9/472: chown d1/d29/d2a/d6/l47 1583 1 2024-04-21T23:55:07.112 INFO:tasks.workunit.client.0.smithi110.stdout:0/469: unlink d0/c59 0 2024-04-21T23:55:07.225 INFO:tasks.workunit.client.0.smithi110.stdout:7/478: creat d10/fab x:0 0 0 2024-04-21T23:55:07.323 INFO:tasks.workunit.client.0.smithi110.stdout:8/511: symlink d5/d24/lb6 0 2024-04-21T23:55:07.792 INFO:tasks.workunit.client.0.smithi110.stdout:5/466: write d7/f72 [27594,96394] 0 2024-04-21T23:55:07.799 INFO:tasks.workunit.client.0.smithi110.stdout:2/488: fsync d9/d25/d1b/d45/f48 0 2024-04-21T23:55:07.972 INFO:tasks.workunit.client.0.smithi110.stdout:9/473: rmdir d1/d29/d2a/d2b/d58 39 2024-04-21T23:55:07.989 INFO:tasks.workunit.client.0.smithi110.stdout:9/474: stat d1/d29/c9e 0 2024-04-21T23:55:08.149 INFO:tasks.workunit.client.0.smithi110.stdout:7/479: creat d10/d45/d60/d5e/d65/da3/fac x:0 0 0 2024-04-21T23:55:08.338 INFO:tasks.workunit.client.0.smithi110.stdout:7/480: sync 2024-04-21T23:55:08.376 INFO:tasks.workunit.client.0.smithi110.stdout:7/481: stat d10/d45/d51/d88/d46/d69/c9f 0 2024-04-21T23:55:08.399 INFO:tasks.workunit.client.0.smithi110.stdout:7/482: stat d10/d15/d22/f79 0 2024-04-21T23:55:08.414 INFO:tasks.workunit.client.0.smithi110.stdout:1/417: truncate d1/f7a 1427841 0 2024-04-21T23:55:08.443 INFO:tasks.workunit.client.0.smithi110.stdout:1/418: readlink d1/l6c 0 2024-04-21T23:55:08.674 INFO:tasks.workunit.client.0.smithi110.stdout:9/475: creat d1/d29/d2a/dc/d30/fa0 x:0 0 0 2024-04-21T23:55:09.008 INFO:tasks.workunit.client.0.smithi110.stdout:6/467: getdents d16/d1d/d38/d48/d5e/d62 0 2024-04-21T23:55:09.083 INFO:tasks.workunit.client.0.smithi110.stdout:5/467: dread d7/d9/f3b [0,4194304] 0 2024-04-21T23:55:09.149 INFO:tasks.workunit.client.0.smithi110.stdout:1/419: rename d1/d2/d14/d16/d29/d71 to d1/dd/d23/d48/d4e/d7f/d8d 0 2024-04-21T23:55:09.405 INFO:tasks.workunit.client.0.smithi110.stdout:9/476: dread d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-21T23:55:09.457 INFO:tasks.workunit.client.0.smithi110.stdout:6/468: dread d16/f1b [0,4194304] 0 2024-04-21T23:55:09.949 INFO:tasks.workunit.client.0.smithi110.stdout:4/413: dwrite d1/d11/d20/d23/d1c/d40/f73 [0,4194304] 0 2024-04-21T23:55:10.375 INFO:tasks.workunit.client.0.smithi110.stdout:3/453: dwrite d6/d12/d16/d30/f35 [0,4194304] 0 2024-04-21T23:55:10.697 INFO:tasks.workunit.client.0.smithi110.stdout:1/420: fsync d1/d2/d1b/f9 0 2024-04-21T23:55:10.841 INFO:tasks.workunit.client.0.smithi110.stdout:6/469: mkdir d16/d3d/d97 0 2024-04-21T23:55:11.940 INFO:tasks.workunit.client.0.smithi110.stdout:3/454: truncate d6/d12/d14/d32/f84 702496 0 2024-04-21T23:55:11.946 INFO:tasks.workunit.client.0.smithi110.stdout:6/470: dread d16/d1e/d24/d33/f39 [0,4194304] 0 2024-04-21T23:55:12.023 INFO:tasks.workunit.client.0.smithi110.stdout:0/470: dwrite d0/d16/f58 [0,4194304] 0 2024-04-21T23:55:12.148 INFO:tasks.workunit.client.0.smithi110.stdout:2/489: write d9/d25/d1b/d60/f67 [582218,18542] 0 2024-04-21T23:55:12.229 INFO:tasks.workunit.client.0.smithi110.stdout:0/471: dread d0/d14/f5f [0,4194304] 0 2024-04-21T23:55:12.255 INFO:tasks.workunit.client.0.smithi110.stdout:0/472: chown d0/d27/f6b 1 1 2024-04-21T23:55:12.340 INFO:tasks.workunit.client.0.smithi110.stdout:8/512: write d5/d24/f2c [522053,43283] 0 2024-04-21T23:55:12.385 INFO:tasks.workunit.client.0.smithi110.stdout:7/483: write d10/d45/f52 [2598109,79288] 0 2024-04-21T23:55:12.575 INFO:tasks.workunit.client.0.smithi110.stdout:9/477: write d1/d29/d59/f88 [907858,22480] 0 2024-04-21T23:55:12.609 INFO:tasks.workunit.client.0.smithi110.stdout:7/484: chown d10/d15/d22/f5a 238834813 1 2024-04-21T23:55:12.671 INFO:tasks.workunit.client.0.smithi110.stdout:5/468: dwrite d7/d9/d17/f51 [0,4194304] 0 2024-04-21T23:55:12.821 INFO:tasks.workunit.client.0.smithi110.stdout:1/421: write d1/d2/d1b/d10/f12 [5795118,29319] 0 2024-04-21T23:55:12.830 INFO:tasks.workunit.client.0.smithi110.stdout:4/414: write d1/f8 [3092561,41465] 0 2024-04-21T23:55:12.874 INFO:tasks.workunit.client.0.smithi110.stdout:1/422: readlink d1/l88 0 2024-04-21T23:55:13.224 INFO:tasks.workunit.client.0.smithi110.stdout:0/473: mkdir d0/d56/da3 0 2024-04-21T23:55:13.236 INFO:tasks.workunit.client.0.smithi110.stdout:2/490: chown d9/d1a/d1d/d2b/d54/d77/c9e 453198721 1 2024-04-21T23:55:13.273 INFO:tasks.workunit.client.0.smithi110.stdout:0/474: chown d0/d16/c66 2 1 2024-04-21T23:55:13.711 INFO:tasks.workunit.client.0.smithi110.stdout:5/469: mknod d7/d24/d49/d64/c80 0 2024-04-21T23:55:13.973 INFO:tasks.workunit.client.0.smithi110.stdout:5/470: dread d7/d24/f36 [0,4194304] 0 2024-04-21T23:55:14.131 INFO:tasks.workunit.client.0.smithi110.stdout:4/415: dread d1/d11/d12/d26/f3f [0,4194304] 0 2024-04-21T23:55:14.299 INFO:tasks.workunit.client.0.smithi110.stdout:3/455: unlink d6/d12/d14/d32/f84 0 2024-04-21T23:55:14.755 INFO:tasks.workunit.client.0.smithi110.stdout:2/491: rmdir d9/d1a/d1d/d4a/d6b 39 2024-04-21T23:55:15.070 INFO:tasks.workunit.client.0.smithi110.stdout:8/513: dwrite d5/da/d17/d60/f6e [0,4194304] 0 2024-04-21T23:55:15.185 INFO:tasks.workunit.client.0.smithi110.stdout:7/485: symlink d10/d45/d51/d88/d46/d69/d75/lad 0 2024-04-21T23:55:15.219 INFO:tasks.workunit.client.0.smithi110.stdout:1/423: mkdir d1/d2/d1b/d8e 0 2024-04-21T23:55:15.574 INFO:tasks.workunit.client.0.smithi110.stdout:9/478: dwrite d1/d29/d2a/d6/d1d/f7c [0,4194304] 0 2024-04-21T23:55:15.894 INFO:tasks.workunit.client.0.smithi110.stdout:6/471: creat d16/d1d/d38/f98 x:0 0 0 2024-04-21T23:55:15.924 INFO:tasks.workunit.client.0.smithi110.stdout:6/472: read f9 [166710,45268] 0 2024-04-21T23:55:16.283 INFO:tasks.workunit.client.0.smithi110.stdout:8/514: mknod d5/d24/cb7 0 2024-04-21T23:55:17.026 INFO:tasks.workunit.client.0.smithi110.stdout:9/479: unlink d1/d29/d2a/d6/d1d/f5e 0 2024-04-21T23:55:17.190 INFO:tasks.workunit.client.0.smithi110.stdout:6/473: mknod d16/d1d/d38/d48/d5e/d6a/d70/c99 0 2024-04-21T23:55:17.305 INFO:tasks.workunit.client.0.smithi110.stdout:0/475: dwrite d0/f2c [0,4194304] 0 2024-04-21T23:55:17.519 INFO:tasks.workunit.client.0.smithi110.stdout:4/416: rmdir d1/d11/d20/d23/d3c/d83 0 2024-04-21T23:55:17.745 INFO:tasks.workunit.client.0.smithi110.stdout:5/471: dwrite d7/d9/d17/d48/d69/d6d/f74 [0,4194304] 0 2024-04-21T23:55:17.862 INFO:tasks.workunit.client.0.smithi110.stdout:2/492: write d9/d1a/f26 [1232200,118678] 0 2024-04-21T23:55:17.961 INFO:tasks.workunit.client.0.smithi110.stdout:2/493: rename d9/d1a/d1d/d2b/d8d to d9/d1a/d1d/d2b/d8d/da1 22 2024-04-21T23:55:18.387 INFO:tasks.workunit.client.0.smithi110.stdout:0/476: dread d0/d27/d4b/f64 [0,4194304] 0 2024-04-21T23:55:18.501 INFO:tasks.workunit.client.0.smithi110.stdout:9/480: symlink d1/d29/d2a/d9d/la1 0 2024-04-21T23:55:18.520 INFO:tasks.workunit.client.0.smithi110.stdout:1/424: write d1/f40 [6442107,66334] 0 2024-04-21T23:55:18.581 INFO:tasks.workunit.client.0.smithi110.stdout:1/425: stat d1/d2/d30/l55 0 2024-04-21T23:55:19.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/456: link d6/l10 d6/d12/l90 0 2024-04-21T23:55:19.233 INFO:tasks.workunit.client.0.smithi110.stdout:2/494: creat d9/d25/d1c/d7e/fa2 x:0 0 0 2024-04-21T23:55:19.605 INFO:tasks.workunit.client.0.smithi110.stdout:8/515: write d5/d4f/f5f [253192,75033] 0 2024-04-21T23:55:20.024 INFO:tasks.workunit.client.0.smithi110.stdout:6/474: write d16/d1e/f2a [548680,96825] 0 2024-04-21T23:55:20.260 INFO:tasks.workunit.client.0.smithi110.stdout:1/426: symlink d1/d2/d14/d16/d29/l8f 0 2024-04-21T23:55:20.362 INFO:tasks.workunit.client.0.smithi110.stdout:7/486: link d10/d45/d51/d88/d39/c4a d10/d45/cae 0 2024-04-21T23:55:20.697 INFO:tasks.workunit.client.0.smithi110.stdout:7/487: sync 2024-04-21T23:55:20.894 INFO:tasks.workunit.client.0.smithi110.stdout:8/516: mkdir d5/d24/d33/d3d/db8 0 2024-04-21T23:55:20.907 INFO:tasks.workunit.client.0.smithi110.stdout:4/417: write d1/d11/d20/d23/d1c/d40/f5a [4139563,120531] 0 2024-04-21T23:55:20.924 INFO:tasks.workunit.client.0.smithi110.stdout:2/495: dread - d9/d1a/d1d/d4e/f9a zero size 2024-04-21T23:55:21.020 INFO:tasks.workunit.client.0.smithi110.stdout:4/418: stat d1/d11/d20/d23/d1c/d47/d4f/d56/d7a 0 2024-04-21T23:55:21.119 INFO:tasks.workunit.client.0.smithi110.stdout:0/477: mkdir d0/d27/d4b/da0/da4 0 2024-04-21T23:55:21.245 INFO:tasks.workunit.client.0.smithi110.stdout:0/478: dread d0/d16/f18 [0,4194304] 0 2024-04-21T23:55:21.769 INFO:tasks.workunit.client.0.smithi110.stdout:3/457: mkdir d6/d12/d3c/d65/d91 0 2024-04-21T23:55:21.788 INFO:tasks.workunit.client.0.smithi110.stdout:5/472: write d7/d9/f3b [13170379,56034] 0 2024-04-21T23:55:21.818 INFO:tasks.workunit.client.0.smithi110.stdout:7/488: truncate d10/d45/d51/f85 389525 0 2024-04-21T23:55:21.975 INFO:tasks.workunit.client.0.smithi110.stdout:8/517: mknod d5/da/d17/d7c/cb9 0 2024-04-21T23:55:21.992 INFO:tasks.workunit.client.0.smithi110.stdout:2/496: read - d9/d25/d1b/d45/f80 zero size 2024-04-21T23:55:22.037 INFO:tasks.workunit.client.0.smithi110.stdout:8/518: readlink d5/da/d17/l37 0 2024-04-21T23:55:22.136 INFO:tasks.workunit.client.0.smithi110.stdout:4/419: write d1/f8 [525903,58803] 0 2024-04-21T23:55:22.238 INFO:tasks.workunit.client.0.smithi110.stdout:0/479: creat d0/d25/fa5 x:0 0 0 2024-04-21T23:55:22.668 INFO:tasks.workunit.client.0.smithi110.stdout:1/427: mknod d1/d2/d30/d8b/c90 0 2024-04-21T23:55:23.233 INFO:tasks.workunit.client.0.smithi110.stdout:2/497: unlink d9/d1a/f2d 0 2024-04-21T23:55:23.485 INFO:tasks.workunit.client.0.smithi110.stdout:4/420: rmdir d1/d11/d20/d23/d1c/d47/d4f/d6a 39 2024-04-21T23:55:24.121 INFO:tasks.workunit.client.0.smithi110.stdout:7/489: creat d10/d15/d22/d2c/faf x:0 0 0 2024-04-21T23:55:24.646 INFO:tasks.workunit.client.0.smithi110.stdout:6/475: write d16/d1e/d24/d33/f34 [2598041,57310] 0 2024-04-21T23:55:24.660 INFO:tasks.workunit.client.0.smithi110.stdout:4/421: symlink d1/d11/d20/d58/l8c 0 2024-04-21T23:55:24.696 INFO:tasks.workunit.client.0.smithi110.stdout:0/480: getdents d0/d56/da3 0 2024-04-21T23:55:24.789 INFO:tasks.workunit.client.0.smithi110.stdout:9/481: write d1/d29/d2a/d2b/d58/d7b/f91 [441677,121465] 0 2024-04-21T23:55:24.896 INFO:tasks.workunit.client.0.smithi110.stdout:5/473: rmdir d7/d24/d3a/d7f 0 2024-04-21T23:55:25.168 INFO:tasks.workunit.client.0.smithi110.stdout:2/498: creat d9/d1a/d1d/d7a/d91/fa3 x:0 0 0 2024-04-21T23:55:25.211 INFO:tasks.workunit.client.0.smithi110.stdout:2/499: read d9/d25/f5e [624172,124878] 0 2024-04-21T23:55:25.681 INFO:tasks.workunit.client.0.smithi110.stdout:6/476: fsync d16/d1e/d24/f4e 0 2024-04-21T23:55:26.460 INFO:tasks.workunit.client.0.smithi110.stdout:1/428: rmdir d1/d2/d1b/d8e 0 2024-04-21T23:55:26.596 INFO:tasks.workunit.client.0.smithi110.stdout:6/477: fsync f15 0 2024-04-21T23:55:26.724 INFO:tasks.workunit.client.0.smithi110.stdout:4/422: rename d1/d11/d20/d23/d1c/f81 to d1/d11/d20/d23/d1c/d40/f8d 0 2024-04-21T23:55:26.948 INFO:tasks.workunit.client.0.smithi110.stdout:3/458: dwrite d6/d12/d14/d3f/f79 [0,4194304] 0 2024-04-21T23:55:26.959 INFO:tasks.workunit.client.0.smithi110.stdout:5/474: truncate d7/d35/f4c 2364155 0 2024-04-21T23:55:26.971 INFO:tasks.workunit.client.0.smithi110.stdout:7/490: link d10/d45/d60/d5e/d65/f76 d10/d15/d22/d2c/fb0 0 2024-04-21T23:55:27.188 INFO:tasks.workunit.client.0.smithi110.stdout:4/423: dread d1/fd [0,4194304] 0 2024-04-21T23:55:27.208 INFO:tasks.workunit.client.0.smithi110.stdout:1/429: fsync d1/dd/d23/f54 0 2024-04-21T23:55:27.446 INFO:tasks.workunit.client.0.smithi110.stdout:8/519: dwrite d5/f2a [0,4194304] 0 2024-04-21T23:55:27.574 INFO:tasks.workunit.client.0.smithi110.stdout:1/430: chown d1/d2/d1b/d10/f4d 196808346 1 2024-04-21T23:55:27.779 INFO:tasks.workunit.client.0.smithi110.stdout:5/475: creat d7/d24/d31/f81 x:0 0 0 2024-04-21T23:55:27.858 INFO:tasks.workunit.client.0.smithi110.stdout:3/459: creat d6/d12/d16/d30/d67/f92 x:0 0 0 2024-04-21T23:55:27.966 INFO:tasks.workunit.client.0.smithi110.stdout:7/491: rmdir d10/d45/d51/d88/d46/d69 39 2024-04-21T23:55:28.558 INFO:tasks.workunit.client.0.smithi110.stdout:4/424: mknod d1/d11/d20/d23/d1c/d40/c8e 0 2024-04-21T23:55:28.638 INFO:tasks.workunit.client.0.smithi110.stdout:2/500: getdents d9/d25/d1c/d82 0 2024-04-21T23:55:28.657 INFO:tasks.workunit.client.0.smithi110.stdout:1/431: dread - d1/d2/d14/f64 zero size 2024-04-21T23:55:28.766 INFO:tasks.workunit.client.0.smithi110.stdout:8/520: mknod d5/d24/d33/d3d/d5c/d6a/cba 0 2024-04-21T23:55:29.294 INFO:tasks.workunit.client.0.smithi110.stdout:7/492: fsync d10/d45/d51/d88/f7c 0 2024-04-21T23:55:29.338 INFO:tasks.workunit.client.0.smithi110.stdout:9/482: write d1/d29/d2a/dc/f67 [48953,47173] 0 2024-04-21T23:55:29.403 INFO:tasks.workunit.client.0.smithi110.stdout:6/478: rmdir d16/d3d/d40/d96 0 2024-04-21T23:55:29.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:55:29.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:55:29.642 INFO:tasks.workunit.client.0.smithi110.stdout:4/425: rmdir d1/d11/d20/d23/d1c/d47/d4f/d56 39 2024-04-21T23:55:29.833 INFO:tasks.workunit.client.0.smithi110.stdout:1/432: read d1/d1d/d4a/f79 [282283,122863] 0 2024-04-21T23:55:30.060 INFO:tasks.workunit.client.0.smithi110.stdout:8/521: rename d5/d24/d33/d3d/d5c/l81 to d5/d24/d33/d3d/d82/da8/lbb 0 2024-04-21T23:55:30.187 INFO:tasks.workunit.client.0.smithi110.stdout:3/460: truncate d6/d12/f2c 551527 0 2024-04-21T23:55:30.208 INFO:tasks.workunit.client.0.smithi110.stdout:3/461: readlink d6/d12/l43 0 2024-04-21T23:55:30.841 INFO:tasks.workunit.client.0.smithi110.stdout:2/501: truncate d9/d25/d1b/d60/f83 746923 0 2024-04-21T23:55:30.886 INFO:tasks.workunit.client.0.smithi110.stdout:2/502: readlink d9/d25/d1b/d45/d50/l5a 0 2024-04-21T23:55:31.075 INFO:tasks.workunit.client.0.smithi110.stdout:8/522: mkdir d5/d24/d33/d84/dbc 0 2024-04-21T23:55:31.651 INFO:tasks.workunit.client.0.smithi110.stdout:6/479: mkdir d16/d3d/d9a 0 2024-04-21T23:55:32.085 INFO:tasks.workunit.client.0.smithi110.stdout:2/503: rename d9/d25/d1c/d7e to d9/d25/d1b/d45/d50/d68/da4 0 2024-04-21T23:55:32.421 INFO:tasks.workunit.client.0.smithi110.stdout:5/476: write d7/f58 [2629355,98506] 0 2024-04-21T23:55:32.582 INFO:tasks.workunit.client.0.smithi110.stdout:4/426: creat d1/f8f x:0 0 0 2024-04-21T23:55:32.664 INFO:tasks.workunit.client.0.smithi110.stdout:8/523: rename d5/d24/d33/d3d/c4b to d5/da/cbd 0 2024-04-21T23:55:32.968 INFO:tasks.workunit.client.0.smithi110.stdout:9/483: getdents d1/d29/d2a/dc 0 2024-04-21T23:55:33.824 INFO:tasks.workunit.client.0.smithi110.stdout:3/462: getdents d6/d12/d16/d30/d67 0 2024-04-21T23:55:33.873 INFO:tasks.workunit.client.0.smithi110.stdout:7/493: write d10/d45/d51/d88/f8e [652721,48274] 0 2024-04-21T23:55:34.059 INFO:tasks.workunit.client.0.smithi110.stdout:9/484: dread d1/d19/f32 [0,4194304] 0 2024-04-21T23:55:34.540 INFO:tasks.workunit.client.0.smithi110.stdout:5/477: creat d7/d24/d3a/f82 x:0 0 0 2024-04-21T23:55:34.545 INFO:tasks.workunit.client.0.smithi110.stdout:0/481: rmdir d0/d27 39 2024-04-21T23:55:34.574 INFO:tasks.workunit.client.0.smithi110.stdout:3/463: creat d6/d12/d16/d30/d67/f93 x:0 0 0 2024-04-21T23:55:34.655 INFO:tasks.workunit.client.0.smithi110.stdout:0/482: chown d0/d2a/c8e 217 1 2024-04-21T23:55:34.735 INFO:tasks.workunit.client.0.smithi110.stdout:0/483: chown d0/d56/c7c 0 1 2024-04-21T23:55:34.743 INFO:tasks.workunit.client.0.smithi110.stdout:1/433: write d1/f39 [5216884,125934] 0 2024-04-21T23:55:34.999 INFO:tasks.workunit.client.0.smithi110.stdout:2/504: rename d9/d25/f33 to d9/d1a/d1d/fa5 0 2024-04-21T23:55:35.506 INFO:tasks.workunit.client.0.smithi110.stdout:0/484: dread d0/d27/d4b/f4f [0,4194304] 0 2024-04-21T23:55:35.684 INFO:tasks.workunit.client.0.smithi110.stdout:9/485: mknod d1/d29/ca2 0 2024-04-21T23:55:35.991 INFO:tasks.workunit.client.0.smithi110.stdout:2/505: creat d9/d1a/d1d/d2b/d54/d77/fa6 x:0 0 0 2024-04-21T23:55:36.078 INFO:tasks.workunit.client.0.smithi110.stdout:6/480: write d16/d3d/f81 [1081401,53463] 0 2024-04-21T23:55:36.304 INFO:tasks.workunit.client.0.smithi110.stdout:7/494: rename d10/d45/d51/d88/d46/d69/d99 to d10/d45/d51/db1 0 2024-04-21T23:55:36.457 INFO:tasks.workunit.client.0.smithi110.stdout:2/506: dread f1 [0,4194304] 0 2024-04-21T23:55:36.745 INFO:tasks.workunit.client.0.smithi110.stdout:1/434: rename d1/dd/d23/d48/d4e/d7f to d1/d1d/d57/d91 0 2024-04-21T23:55:36.962 INFO:tasks.workunit.client.0.smithi110.stdout:0/485: fsync d0/f17 0 2024-04-21T23:55:37.171 INFO:tasks.workunit.client.0.smithi110.stdout:9/486: getdents d1/d52/d76 0 2024-04-21T23:55:37.231 INFO:tasks.workunit.client.0.smithi110.stdout:4/427: dwrite d1/d11/d20/d50/f6e [0,4194304] 0 2024-04-21T23:55:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:7/495: chown d10/d45/d51/d88/d39/c4a 410452257 1 2024-04-21T23:55:37.260 INFO:tasks.workunit.client.0.smithi110.stdout:2/507: mknod d9/d1a/d1d/d7a/d91/ca7 0 2024-04-21T23:55:37.358 INFO:tasks.workunit.client.0.smithi110.stdout:1/435: fsync d1/d2/d30/f47 0 2024-04-21T23:55:37.506 INFO:tasks.workunit.client.0.smithi110.stdout:1/436: readlink d1/d1d/d57/d91/l80 0 2024-04-21T23:55:37.593 INFO:tasks.workunit.client.0.smithi110.stdout:0/486: creat d0/d16/fa6 x:0 0 0 2024-04-21T23:55:37.624 INFO:tasks.workunit.client.0.smithi110.stdout:2/508: dread d9/d1a/f1e [0,4194304] 0 2024-04-21T23:55:37.680 INFO:tasks.workunit.client.0.smithi110.stdout:8/524: dwrite d5/d24/d33/d3d/f47 [0,4194304] 0 2024-04-21T23:55:37.874 INFO:tasks.workunit.client.0.smithi110.stdout:1/437: sync 2024-04-21T23:55:37.882 INFO:tasks.workunit.client.0.smithi110.stdout:0/487: chown d0/d16/d42/d50 4 1 2024-04-21T23:55:37.944 INFO:tasks.workunit.client.0.smithi110.stdout:7/496: fsync d10/d43/f8c 0 2024-04-21T23:55:38.375 INFO:tasks.workunit.client.0.smithi110.stdout:5/478: write d7/d9/f3b [3949419,72141] 0 2024-04-21T23:55:38.510 INFO:tasks.workunit.client.0.smithi110.stdout:5/479: stat d7/d9/d17/d48/d69/d6d/c7a 0 2024-04-21T23:55:39.047 INFO:tasks.workunit.client.0.smithi110.stdout:3/464: dwrite d6/d12/d16/f5e [0,4194304] 0 2024-04-21T23:55:39.323 INFO:tasks.workunit.client.0.smithi110.stdout:8/525: fsync d5/da/d17/d6c/fad 0 2024-04-21T23:55:39.403 INFO:tasks.workunit.client.0.smithi110.stdout:0/488: mknod d0/d27/d4b/da0/da4/ca7 0 2024-04-21T23:55:39.454 INFO:tasks.workunit.client.0.smithi110.stdout:2/509: dread d9/d25/d1b/d45/d4d/f64 [0,4194304] 0 2024-04-21T23:55:39.716 INFO:tasks.workunit.client.0.smithi110.stdout:5/480: creat d7/d24/d49/d64/f83 x:0 0 0 2024-04-21T23:55:39.729 INFO:tasks.workunit.client.0.smithi110.stdout:0/489: readlink d0/d27/d68/d7d/l7e 0 2024-04-21T23:55:39.814 INFO:tasks.workunit.client.0.smithi110.stdout:7/497: dread d10/d45/d51/d88/d46/f86 [0,4194304] 0 2024-04-21T23:55:40.608 INFO:tasks.workunit.client.0.smithi110.stdout:6/481: dwrite d16/d1e/d24/f4e [4194304,4194304] 0 2024-04-21T23:55:40.738 INFO:tasks.workunit.client.0.smithi110.stdout:9/487: dwrite d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-21T23:55:40.888 INFO:tasks.workunit.client.0.smithi110.stdout:5/481: stat d7/d9/fd 0 2024-04-21T23:55:41.149 INFO:tasks.workunit.client.0.smithi110.stdout:0/490: mkdir d0/d14/d23/d6d/da8 0 2024-04-21T23:55:41.255 INFO:tasks.workunit.client.0.smithi110.stdout:7/498: mknod d10/d45/d60/d5e/d65/da3/cb2 0 2024-04-21T23:55:41.297 INFO:tasks.workunit.client.0.smithi110.stdout:1/438: getdents d1/d1d/d57/d91/d8d 0 2024-04-21T23:55:41.344 INFO:tasks.workunit.client.0.smithi110.stdout:3/465: symlink d6/d12/d16/l94 0 2024-04-21T23:55:41.429 INFO:tasks.workunit.client.0.smithi110.stdout:2/510: symlink d9/d1a/d1d/d2b/la8 0 2024-04-21T23:55:42.021 INFO:tasks.workunit.client.0.smithi110.stdout:9/488: creat d1/d29/d2a/dc/d30/fa3 x:0 0 0 2024-04-21T23:55:42.154 INFO:tasks.workunit.client.0.smithi110.stdout:6/482: creat d16/d1d/d38/d48/d5e/d6a/d70/f9b x:0 0 0 2024-04-21T23:55:42.252 INFO:tasks.workunit.client.0.smithi110.stdout:0/491: mknod d0/d16/d5d/ca9 0 2024-04-21T23:55:42.716 INFO:tasks.workunit.client.0.smithi110.stdout:4/428: link d1/d11/d20/d23/d1c/d47/d4f/d56/d7a/c79 d1/d11/d20/d23/d1c/d47/d4f/d56/c90 0 2024-04-21T23:55:42.815 INFO:tasks.workunit.client.0.smithi110.stdout:5/482: symlink d7/l84 0 2024-04-21T23:55:42.822 INFO:tasks.workunit.client.0.smithi110.stdout:8/526: dwrite d5/da/d17/d7c/f7e [0,4194304] 0 2024-04-21T23:55:43.053 INFO:tasks.workunit.client.0.smithi110.stdout:9/489: mknod d1/d29/d2a/d2b/d57/ca4 0 2024-04-21T23:55:43.185 INFO:tasks.workunit.client.0.smithi110.stdout:6/483: rename f9 to d16/d3d/d40/f9c 0 2024-04-21T23:55:44.394 INFO:tasks.workunit.client.0.smithi110.stdout:4/429: mknod d1/d11/d12/d26/d5f/c91 0 2024-04-21T23:55:44.762 INFO:tasks.workunit.client.0.smithi110.stdout:9/490: mknod d1/d29/d2a/d3c/ca5 0 2024-04-21T23:55:45.260 INFO:tasks.workunit.client.0.smithi110.stdout:7/499: creat d10/d45/d51/d88/fb3 x:0 0 0 2024-04-21T23:55:45.309 INFO:tasks.workunit.client.0.smithi110.stdout:1/439: link d1/c17 d1/d2/d14/d16/d29/c92 0 2024-04-21T23:55:45.506 INFO:tasks.workunit.client.0.smithi110.stdout:3/466: creat d6/d12/d3c/f95 x:0 0 0 2024-04-21T23:55:45.695 INFO:tasks.workunit.client.0.smithi110.stdout:0/492: dwrite d0/d27/d4b/f4f [0,4194304] 0 2024-04-21T23:55:46.040 INFO:tasks.workunit.client.0.smithi110.stdout:8/527: rename d5/d24/f51 to d5/da/d17/d6c/d72/d73/d78/d91/fbe 0 2024-04-21T23:55:46.578 INFO:tasks.workunit.client.0.smithi110.stdout:1/440: symlink d1/dd/d23/d48/d4e/l93 0 2024-04-21T23:55:46.885 INFO:tasks.workunit.client.0.smithi110.stdout:5/483: dwrite d7/d24/d3a/f82 [0,4194304] 0 2024-04-21T23:55:47.015 INFO:tasks.workunit.client.0.smithi110.stdout:3/467: mknod d6/d12/d3c/d65/c96 0 2024-04-21T23:55:47.049 INFO:tasks.workunit.client.0.smithi110.stdout:2/511: creat d9/d1a/d1d/fa9 x:0 0 0 2024-04-21T23:55:47.646 INFO:tasks.workunit.client.0.smithi110.stdout:6/484: rename f10 to d16/d1d/d38/d8e/f9d 0 2024-04-21T23:55:47.994 INFO:tasks.workunit.client.0.smithi110.stdout:6/485: dread ff [0,4194304] 0 2024-04-21T23:55:48.206 INFO:tasks.workunit.client.0.smithi110.stdout:1/441: dread d1/d2/d1b/f35 [0,4194304] 0 2024-04-21T23:55:48.215 INFO:tasks.workunit.client.0.smithi110.stdout:0/493: symlink d0/d14/d23/d6d/da8/laa 0 2024-04-21T23:55:48.335 INFO:tasks.workunit.client.0.smithi110.stdout:4/430: creat d1/d11/d20/d23/d1c/d47/d4f/f92 x:0 0 0 2024-04-21T23:55:48.361 INFO:tasks.workunit.client.0.smithi110.stdout:4/431: stat d1/d11/d12/d26/f88 0 2024-04-21T23:55:48.657 INFO:tasks.workunit.client.0.smithi110.stdout:3/468: rename d6/d12/d16/d30/f46 to d6/d12/d14/d3f/f97 0 2024-04-21T23:55:48.674 INFO:tasks.workunit.client.0.smithi110.stdout:7/500: creat d10/d45/d51/d88/d46/fb4 x:0 0 0 2024-04-21T23:55:48.826 INFO:tasks.workunit.client.0.smithi110.stdout:8/528: mkdir d5/da/d17/dbf 0 2024-04-21T23:55:48.939 INFO:tasks.workunit.client.0.smithi110.stdout:5/484: mknod d7/c85 0 2024-04-21T23:55:49.313 INFO:tasks.workunit.client.0.smithi110.stdout:5/485: sync 2024-04-21T23:55:49.686 INFO:tasks.workunit.client.0.smithi110.stdout:1/442: symlink d1/d2/d14/l94 0 2024-04-21T23:55:49.769 INFO:tasks.workunit.client.0.smithi110.stdout:4/432: truncate d1/d11/d12/d26/f30 2544343 0 2024-04-21T23:55:50.311 INFO:tasks.workunit.client.0.smithi110.stdout:7/501: dread d10/d15/d22/f5a [0,4194304] 0 2024-04-21T23:55:50.336 INFO:tasks.workunit.client.0.smithi110.stdout:0/494: fsync d0/d27/f48 0 2024-04-21T23:55:50.533 INFO:tasks.workunit.client.0.smithi110.stdout:3/469: mknod d6/d12/d3c/c98 0 2024-04-21T23:55:50.652 INFO:tasks.workunit.client.0.smithi110.stdout:4/433: chown d1/d11/d20/f2c 964644115 1 2024-04-21T23:55:51.094 INFO:tasks.workunit.client.0.smithi110.stdout:9/491: dwrite d1/d29/d59/f93 [0,4194304] 0 2024-04-21T23:55:51.259 INFO:tasks.workunit.client.0.smithi110.stdout:1/443: rename d1/dd/d23/d48/d4e/l93 to d1/d1d/l95 0 2024-04-21T23:55:51.292 INFO:tasks.workunit.client.0.smithi110.stdout:2/512: dread d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e [0,4194304] 0 2024-04-21T23:55:51.321 INFO:tasks.workunit.client.0.smithi110.stdout:5/486: dread d7/d24/d37/d38/f66 [0,4194304] 0 2024-04-21T23:55:51.347 INFO:tasks.workunit.client.0.smithi110.stdout:0/495: truncate d0/fc 579322 0 2024-04-21T23:55:51.459 INFO:tasks.workunit.client.0.smithi110.stdout:9/492: chown d1/d29/d59/f93 3821952 1 2024-04-21T23:55:52.002 INFO:tasks.workunit.client.0.smithi110.stdout:4/434: rename d1/d11/d20/d23/d3c to d1/d11/d20/d58/d93 0 2024-04-21T23:55:52.010 INFO:tasks.workunit.client.0.smithi110.stdout:1/444: creat d1/dd/d23/f96 x:0 0 0 2024-04-21T23:55:52.134 INFO:tasks.workunit.client.0.smithi110.stdout:0/496: mknod d0/d25/cab 0 2024-04-21T23:55:52.364 INFO:tasks.workunit.client.0.smithi110.stdout:2/513: chown d9/d25/d1b/d45/d50/d94 7088 1 2024-04-21T23:55:52.456 INFO:tasks.workunit.client.0.smithi110.stdout:6/486: dwrite d16/d1d/d38/f4f [0,4194304] 0 2024-04-21T23:55:52.628 INFO:tasks.workunit.client.0.smithi110.stdout:9/493: rename d1/d29/d2a/d6/d1d/f94 to d1/d29/d2a/d3c/fa6 0 2024-04-21T23:55:52.705 INFO:tasks.workunit.client.0.smithi110.stdout:2/514: chown d9/d1a/d1d/d4a/d6b 2 1 2024-04-21T23:55:52.823 INFO:tasks.workunit.client.0.smithi110.stdout:8/529: dwrite d5/da/d17/d6c/d72/d73/d78/d8c/f83 [0,4194304] 0 2024-04-21T23:55:52.928 INFO:tasks.workunit.client.0.smithi110.stdout:9/494: dread - d1/d29/d2a/dc/d30/f92 zero size 2024-04-21T23:55:53.141 INFO:tasks.workunit.client.0.smithi110.stdout:3/470: link d6/d12/d3c/d65/c86 d6/d12/d16/d6f/c99 0 2024-04-21T23:55:53.211 INFO:tasks.workunit.client.0.smithi110.stdout:3/471: dread d6/d12/d14/f31 [0,4194304] 0 2024-04-21T23:55:53.600 INFO:tasks.workunit.client.0.smithi110.stdout:7/502: link d10/d45/d60/d5e/d65/da3/fac d10/d45/d60/d5e/d65/da3/fb5 0 2024-04-21T23:55:53.611 INFO:tasks.workunit.client.0.smithi110.stdout:0/497: symlink d0/d27/d68/d7d/lac 0 2024-04-21T23:55:53.686 INFO:tasks.workunit.client.0.smithi110.stdout:4/435: dread d1/d11/d12/d26/f3b [0,4194304] 0 2024-04-21T23:55:53.947 INFO:tasks.workunit.client.0.smithi110.stdout:9/495: chown d1/d29/d2a/d3c/c51 5737820 1 2024-04-21T23:55:54.049 INFO:tasks.workunit.client.0.smithi110.stdout:8/530: rename d5/da/d17/d6c/d72/d73/d78/d91 to d5/da/d17/d7c/dc0 0 2024-04-21T23:55:54.223 INFO:tasks.workunit.client.0.smithi110.stdout:8/531: sync 2024-04-21T23:55:54.256 INFO:tasks.workunit.client.0.smithi110.stdout:3/472: unlink l5 0 2024-04-21T23:55:54.578 INFO:tasks.workunit.client.0.smithi110.stdout:3/473: dread d6/d12/f29 [0,4194304] 0 2024-04-21T23:55:54.671 INFO:tasks.workunit.client.0.smithi110.stdout:0/498: symlink d0/d27/d4b/da0/lad 0 2024-04-21T23:55:54.843 INFO:tasks.workunit.client.0.smithi110.stdout:2/515: symlink d9/d1a/laa 0 2024-04-21T23:55:54.946 INFO:tasks.workunit.client.0.smithi110.stdout:9/496: truncate d1/d29/d2a/dc/d30/fa0 1040748 0 2024-04-21T23:55:55.037 INFO:tasks.workunit.client.0.smithi110.stdout:9/497: sync 2024-04-21T23:55:55.145 INFO:tasks.workunit.client.0.smithi110.stdout:9/498: sync 2024-04-21T23:55:55.485 INFO:tasks.workunit.client.0.smithi110.stdout:3/474: symlink d6/d12/d14/d4b/l9a 0 2024-04-21T23:55:55.513 INFO:tasks.workunit.client.0.smithi110.stdout:3/475: stat d6/d12/d16/d6f/f8e 0 2024-04-21T23:55:55.914 INFO:tasks.workunit.client.0.smithi110.stdout:0/499: symlink d0/d27/d68/d7d/lae 0 2024-04-21T23:55:55.942 INFO:tasks.workunit.client.0.smithi110.stdout:2/516: rename d9/d1a/d1d/d2b/d8d to d9/d1a/d7b/dab 0 2024-04-21T23:55:56.201 INFO:tasks.workunit.client.0.smithi110.stdout:4/436: link d1/d35/l3a d1/d11/d20/d50/l94 0 2024-04-21T23:55:56.220 INFO:tasks.workunit.client.0.smithi110.stdout:1/445: write d1/d2/f25 [5024827,128579] 0 2024-04-21T23:55:56.285 INFO:tasks.workunit.client.0.smithi110.stdout:1/446: stat d1/dd/d23/d48/d4e/d86 0 2024-04-21T23:55:56.473 INFO:tasks.workunit.client.0.smithi110.stdout:5/487: unlink d7/c7d 0 2024-04-21T23:55:56.672 INFO:tasks.workunit.client.0.smithi110.stdout:0/500: creat d0/d27/d4b/d7f/faf x:0 0 0 2024-04-21T23:55:56.779 INFO:tasks.workunit.client.0.smithi110.stdout:2/517: mkdir d9/d1a/d1d/d7a/d91/dac 0 2024-04-21T23:55:56.937 INFO:tasks.workunit.client.0.smithi110.stdout:6/487: dwrite d16/d3d/f2d [0,4194304] 0 2024-04-21T23:55:57.118 INFO:tasks.workunit.client.0.smithi110.stdout:1/447: symlink d1/dd/l97 0 2024-04-21T23:55:57.121 INFO:tasks.workunit.client.0.smithi110.stdout:4/437: dread - d1/d11/d12/d26/f88 zero size 2024-04-21T23:55:57.448 INFO:tasks.workunit.client.0.smithi110.stdout:0/501: fdatasync d0/d14/f5f 0 2024-04-21T23:55:57.756 INFO:tasks.workunit.client.0.smithi110.stdout:4/438: truncate d1/f28 2039360 0 2024-04-21T23:55:57.899 INFO:tasks.workunit.client.0.smithi110.stdout:5/488: dread d7/d9/d17/f2c [0,4194304] 0 2024-04-21T23:55:57.936 INFO:tasks.workunit.client.0.smithi110.stdout:0/502: chown d0/d16/d42/f61 188516 1 2024-04-21T23:55:58.044 INFO:tasks.workunit.client.0.smithi110.stdout:3/476: getdents d6/d12/d16/d30/d67 0 2024-04-21T23:55:58.093 INFO:tasks.workunit.client.0.smithi110.stdout:7/503: dwrite f9 [4194304,4194304] 0 2024-04-21T23:55:58.657 INFO:tasks.workunit.client.0.smithi110.stdout:7/504: creat d10/d15/d22/d2c/fb6 x:0 0 0 2024-04-21T23:55:58.784 INFO:tasks.workunit.client.0.smithi110.stdout:3/477: truncate d6/d12/d14/d32/f37 1681472 0 2024-04-21T23:55:59.260 INFO:tasks.workunit.client.0.smithi110.stdout:8/532: write d5/f9c [644373,100792] 0 2024-04-21T23:55:59.525 INFO:tasks.workunit.client.0.smithi110.stdout:0/503: symlink d0/d56/da3/lb0 0 2024-04-21T23:55:59.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:55:59.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:55:59.620 INFO:tasks.workunit.client.0.smithi110.stdout:9/499: dwrite d1/d29/d2a/dc/d30/f61 [0,4194304] 0 2024-04-21T23:56:00.198 INFO:tasks.workunit.client.0.smithi110.stdout:0/504: mkdir d0/d27/d4b/da0/db1 0 2024-04-21T23:56:00.218 INFO:tasks.workunit.client.0.smithi110.stdout:0/505: chown d0/d56/da3 324690 1 2024-04-21T23:56:00.363 INFO:tasks.workunit.client.0.smithi110.stdout:9/500: rmdir d1/d29/d2a/dc/d30/d79/d98 39 2024-04-21T23:56:01.256 INFO:tasks.workunit.client.0.smithi110.stdout:6/488: write d16/d3d/f81 [225620,33911] 0 2024-04-21T23:56:01.285 INFO:tasks.workunit.client.0.smithi110.stdout:1/448: write d1/dd/d23/f3d [1534856,36328] 0 2024-04-21T23:56:01.324 INFO:tasks.workunit.client.0.smithi110.stdout:2/518: write d9/d25/f2f [3229470,24251] 0 2024-04-21T23:56:01.555 INFO:tasks.workunit.client.0.smithi110.stdout:9/501: fdatasync d1/d29/d4d/f8e 0 2024-04-21T23:56:01.570 INFO:tasks.workunit.client.0.smithi110.stdout:4/439: write d1/d11/d20/d23/d1c/d47/d4f/d6a/f77 [14792,69513] 0 2024-04-21T23:56:01.672 INFO:tasks.workunit.client.0.smithi110.stdout:8/533: getdents d5/da/d17/d6c/d7d 0 2024-04-21T23:56:01.709 INFO:tasks.workunit.client.0.smithi110.stdout:1/449: chown d1/d2/d30/l3c 30944937 1 2024-04-21T23:56:01.752 INFO:tasks.workunit.client.0.smithi110.stdout:5/489: dwrite d7/d24/d37/d38/f66 [0,4194304] 0 2024-04-21T23:56:01.938 INFO:tasks.workunit.client.0.smithi110.stdout:9/502: chown d1/d29/ca2 4 1 2024-04-21T23:56:02.232 INFO:tasks.workunit.client.0.smithi110.stdout:0/506: write d0/d14/d23/f3a [1022826,92714] 0 2024-04-21T23:56:02.393 INFO:tasks.workunit.client.0.smithi110.stdout:1/450: creat d1/d2/d30/f98 x:0 0 0 2024-04-21T23:56:02.601 INFO:tasks.workunit.client.0.smithi110.stdout:8/534: creat d5/da/d17/d60/fc1 x:0 0 0 2024-04-21T23:56:02.690 INFO:tasks.workunit.client.0.smithi110.stdout:5/490: fdatasync d7/d9/f3d 0 2024-04-21T23:56:02.762 INFO:tasks.workunit.client.0.smithi110.stdout:3/478: dwrite d6/d12/d14/f25 [0,4194304] 0 2024-04-21T23:56:02.900 INFO:tasks.workunit.client.0.smithi110.stdout:7/505: dwrite d10/d45/d60/d5e/d65/d8a/fa5 [0,4194304] 0 2024-04-21T23:56:02.912 INFO:tasks.workunit.client.0.smithi110.stdout:4/440: mkdir d1/d11/d20/d23/d1c/d47/d95 0 2024-04-21T23:56:03.151 INFO:tasks.workunit.client.0.smithi110.stdout:3/479: chown d6/d12/d3c/f5a 55 1 2024-04-21T23:56:03.152 INFO:tasks.workunit.client.0.smithi110.stdout:5/491: chown d7/d22/d5b/l50 864346343 1 2024-04-21T23:56:03.297 INFO:tasks.workunit.client.0.smithi110.stdout:5/492: stat d7/d24/d37/d38/f66 0 2024-04-21T23:56:03.305 INFO:tasks.workunit.client.0.smithi110.stdout:7/506: dread d10/d15/d22/f79 [0,4194304] 0 2024-04-21T23:56:03.667 INFO:tasks.workunit.client.0.smithi110.stdout:6/489: dwrite f4 [0,4194304] 0 2024-04-21T23:56:03.780 INFO:tasks.workunit.client.0.smithi110.stdout:1/451: rename d1/dd/f6d to d1/d2/d30/f99 0 2024-04-21T23:56:03.790 INFO:tasks.workunit.client.0.smithi110.stdout:8/535: read d5/d24/d33/f96 [501677,47403] 0 2024-04-21T23:56:04.111 INFO:tasks.workunit.client.0.smithi110.stdout:5/493: mkdir d7/d22/d5b/d86 0 2024-04-21T23:56:04.444 INFO:tasks.workunit.client.0.smithi110.stdout:7/507: creat d10/d45/d51/d88/d46/d69/d75/fb7 x:0 0 0 2024-04-21T23:56:04.473 INFO:tasks.workunit.client.0.smithi110.stdout:7/508: chown d10/d45/f4f 186 1 2024-04-21T23:56:04.748 INFO:tasks.workunit.client.0.smithi110.stdout:2/519: link d9/d1a/d1d/d4a/d6b/d3a/f61 d9/d1a/d1d/d7a/d91/fad 0 2024-04-21T23:56:04.914 INFO:tasks.workunit.client.0.smithi110.stdout:4/441: symlink d1/d11/d20/l96 0 2024-04-21T23:56:05.054 INFO:tasks.workunit.client.0.smithi110.stdout:8/536: fsync d5/d24/f2f 0 2024-04-21T23:56:05.186 INFO:tasks.workunit.client.0.smithi110.stdout:1/452: fsync d1/d2/d1b/f13 0 2024-04-21T23:56:05.207 INFO:tasks.workunit.client.0.smithi110.stdout:8/537: dread d5/d24/d33/d3d/f64 [0,4194304] 0 2024-04-21T23:56:05.345 INFO:tasks.workunit.client.0.smithi110.stdout:6/490: unlink d16/d1d/d38/d48/d5e/f6b 0 2024-04-21T23:56:06.070 INFO:tasks.workunit.client.0.smithi110.stdout:7/509: symlink d10/d45/d51/d88/d39/d7f/d80/d53/lb8 0 2024-04-21T23:56:06.121 INFO:tasks.workunit.client.0.smithi110.stdout:2/520: mknod d9/d1a/d7b/cae 0 2024-04-21T23:56:06.286 INFO:tasks.workunit.client.0.smithi110.stdout:9/503: getdents d1/d29/d2a/dc/d30 0 2024-04-21T23:56:06.716 INFO:tasks.workunit.client.0.smithi110.stdout:8/538: unlink d5/d24/d33/d3d/d5c/d6a/cba 0 2024-04-21T23:56:06.772 INFO:tasks.workunit.client.0.smithi110.stdout:0/507: dwrite d0/fc [0,4194304] 0 2024-04-21T23:56:06.913 INFO:tasks.workunit.client.0.smithi110.stdout:1/453: truncate d1/d2/d30/f47 674927 0 2024-04-21T23:56:06.940 INFO:tasks.workunit.client.0.smithi110.stdout:3/480: dwrite d6/d12/d14/d4b/f63 [0,4194304] 0 2024-04-21T23:56:06.944 INFO:tasks.workunit.client.0.smithi110.stdout:6/491: fsync d16/d1e/d24/f2c 0 2024-04-21T23:56:07.236 INFO:tasks.workunit.client.0.smithi110.stdout:4/442: symlink d1/d11/d20/d58/d93/l97 0 2024-04-21T23:56:07.811 INFO:tasks.workunit.client.0.smithi110.stdout:7/510: mknod d10/d45/d60/d5e/d65/d8a/cb9 0 2024-04-21T23:56:08.036 INFO:tasks.workunit.client.0.smithi110.stdout:2/521: rename d9/d25/f46 to d9/d25/d1c/d82/faf 0 2024-04-21T23:56:08.340 INFO:tasks.workunit.client.0.smithi110.stdout:9/504: fsync d1/d29/d2a/d2b/d58/f63 0 2024-04-21T23:56:08.351 INFO:tasks.workunit.client.0.smithi110.stdout:5/494: creat d7/d24/d37/f87 x:0 0 0 2024-04-21T23:56:08.483 INFO:tasks.workunit.client.0.smithi110.stdout:8/539: creat d5/d24/d33/d84/fc2 x:0 0 0 2024-04-21T23:56:08.709 INFO:tasks.workunit.client.0.smithi110.stdout:0/508: creat d0/d27/d4b/da0/fb2 x:0 0 0 2024-04-21T23:56:08.942 INFO:tasks.workunit.client.0.smithi110.stdout:6/492: dread d16/d3d/d40/f9c [0,4194304] 0 2024-04-21T23:56:08.975 INFO:tasks.workunit.client.0.smithi110.stdout:1/454: fsync d1/d2/d1b/d10/f12 0 2024-04-21T23:56:09.065 INFO:tasks.workunit.client.0.smithi110.stdout:3/481: fdatasync d6/d12/d14/f31 0 2024-04-21T23:56:09.267 INFO:tasks.workunit.client.0.smithi110.stdout:4/443: creat d1/d11/d20/d23/f98 x:0 0 0 2024-04-21T23:56:10.086 INFO:tasks.workunit.client.0.smithi110.stdout:9/505: symlink d1/d29/d4d/la7 0 2024-04-21T23:56:10.148 INFO:tasks.workunit.client.0.smithi110.stdout:5/495: truncate d7/d9/f3d 3593753 0 2024-04-21T23:56:10.270 INFO:tasks.workunit.client.0.smithi110.stdout:8/540: symlink d5/da/d17/d7c/dc0/lc3 0 2024-04-21T23:56:10.311 INFO:tasks.workunit.client.0.smithi110.stdout:8/541: chown d5/da/d17/d6c/d72/d73/f90 84022 1 2024-04-21T23:56:10.892 INFO:tasks.workunit.client.0.smithi110.stdout:0/509: creat d0/d25/d5a/fb3 x:0 0 0 2024-04-21T23:56:11.096 INFO:tasks.workunit.client.0.smithi110.stdout:6/493: creat d16/d1d/d38/d48/d5e/d6a/f9e x:0 0 0 2024-04-21T23:56:11.655 INFO:tasks.workunit.client.0.smithi110.stdout:3/482: fdatasync d6/d12/f8f 0 2024-04-21T23:56:12.057 INFO:tasks.workunit.client.0.smithi110.stdout:7/511: unlink d10/d45/d60/d5e/d65/c67 0 2024-04-21T23:56:12.067 INFO:tasks.workunit.client.0.smithi110.stdout:2/522: mknod d9/d1a/d1d/d4a/cb0 0 2024-04-21T23:56:12.399 INFO:tasks.workunit.client.0.smithi110.stdout:5/496: mkdir d7/d24/d37/d38/d88 0 2024-04-21T23:56:12.438 INFO:tasks.workunit.client.0.smithi110.stdout:5/497: chown d7/d22/d5b/d68/c7c 166 1 2024-04-21T23:56:12.645 INFO:tasks.workunit.client.0.smithi110.stdout:8/542: mkdir d5/da/d17/d6c/d72/dc4 0 2024-04-21T23:56:12.994 INFO:tasks.workunit.client.0.smithi110.stdout:3/483: mknod d6/d12/d14/d4b/c9b 0 2024-04-21T23:56:13.155 INFO:tasks.workunit.client.0.smithi110.stdout:2/523: truncate d9/d1a/d1d/fa9 811406 0 2024-04-21T23:56:13.905 INFO:tasks.workunit.client.0.smithi110.stdout:8/543: fsync d5/da/d17/d6c/d72/d73/f90 0 2024-04-21T23:56:14.495 INFO:tasks.workunit.client.0.smithi110.stdout:1/455: dwrite d1/d1d/d4a/f79 [0,4194304] 0 2024-04-21T23:56:14.902 INFO:tasks.workunit.client.0.smithi110.stdout:9/506: getdents d1/d29/d2a/d2b 0 2024-04-21T23:56:15.202 INFO:tasks.workunit.client.0.smithi110.stdout:6/494: getdents d16/d1d/d38/d8e 0 2024-04-21T23:56:15.219 INFO:tasks.workunit.client.0.smithi110.stdout:6/495: readlink d16/d1e/l8f 0 2024-04-21T23:56:15.307 INFO:tasks.workunit.client.0.smithi110.stdout:1/456: mkdir d1/dd/d23/d9a 0 2024-04-21T23:56:15.930 INFO:tasks.workunit.client.0.smithi110.stdout:6/496: creat d16/d1d/d38/d8e/f9f x:0 0 0 2024-04-21T23:56:16.387 INFO:tasks.workunit.client.0.smithi110.stdout:1/457: getdents d1/d1d/d57/d91/d8d 0 2024-04-21T23:56:16.590 INFO:tasks.workunit.client.0.smithi110.stdout:6/497: dread d16/d1e/f57 [0,4194304] 0 2024-04-21T23:56:16.770 INFO:tasks.workunit.client.0.smithi110.stdout:5/498: write d7/d24/d37/f5f [783534,30160] 0 2024-04-21T23:56:17.457 INFO:tasks.workunit.client.0.smithi110.stdout:0/510: dwrite d0/d16/d42/f4c [0,4194304] 0 2024-04-21T23:56:17.651 INFO:tasks.workunit.client.0.smithi110.stdout:2/524: dwrite f1 [4194304,4194304] 0 2024-04-21T23:56:17.693 INFO:tasks.workunit.client.0.smithi110.stdout:6/498: creat d16/d3d/d97/fa0 x:0 0 0 2024-04-21T23:56:17.706 INFO:tasks.workunit.client.0.smithi110.stdout:8/544: dwrite d5/da/d17/d6c/d72/d73/d78/d8c/f83 [0,4194304] 0 2024-04-21T23:56:17.893 INFO:tasks.workunit.client.0.smithi110.stdout:9/507: write d1/d29/d2a/d2b/d58/f95 [999500,2890] 0 2024-04-21T23:56:17.941 INFO:tasks.workunit.client.0.smithi110.stdout:9/508: chown d1/d29/d2a/d2b/d57 205 1 2024-04-21T23:56:17.977 INFO:tasks.workunit.client.0.smithi110.stdout:4/444: rename d1/c15 to d1/d11/d20/d23/c99 0 2024-04-21T23:56:18.278 INFO:tasks.workunit.client.0.smithi110.stdout:1/458: dwrite d1/d2/f2d [0,4194304] 0 2024-04-21T23:56:18.394 INFO:tasks.workunit.client.0.smithi110.stdout:5/499: creat d7/d22/d5d/f89 x:0 0 0 2024-04-21T23:56:18.513 INFO:tasks.workunit.client.0.smithi110.stdout:2/525: read d9/d25/d1b/d45/d4d/f73 [170541,1585] 0 2024-04-21T23:56:18.917 INFO:tasks.workunit.client.0.smithi110.stdout:6/499: dread d16/d1e/d24/d33/f44 [0,4194304] 0 2024-04-21T23:56:19.036 INFO:tasks.workunit.client.0.smithi110.stdout:1/459: creat d1/d2/d1b/d10/d5c/d77/d78/f9b x:0 0 0 2024-04-21T23:56:19.040 INFO:tasks.workunit.client.0.smithi110.stdout:9/509: write d1/d29/d6f/f83 [44803,108255] 0 2024-04-21T23:56:19.117 INFO:tasks.workunit.client.0.smithi110.stdout:2/526: dread - d9/d25/d1b/d45/d50/d68/da4/fa2 zero size 2024-04-21T23:56:19.190 INFO:tasks.workunit.client.0.smithi110.stdout:4/445: unlink d1/d11/d20/d58/d93/d5e/f61 0 2024-04-21T23:56:19.316 INFO:tasks.workunit.client.0.smithi110.stdout:7/512: rename d10/d45/d51/d58/l8d to d10/d45/d60/lba 0 2024-04-21T23:56:19.481 INFO:tasks.workunit.client.0.smithi110.stdout:1/460: mkdir d1/d2/d30/d9c 0 2024-04-21T23:56:19.578 INFO:tasks.workunit.client.0.smithi110.stdout:8/545: dwrite d5/d24/f49 [0,4194304] 0 2024-04-21T23:56:19.664 INFO:tasks.workunit.client.0.smithi110.stdout:1/461: sync 2024-04-21T23:56:19.791 INFO:tasks.workunit.client.0.smithi110.stdout:6/500: dread d16/d1e/d24/f5d [0,4194304] 0 2024-04-21T23:56:19.805 INFO:tasks.workunit.client.0.smithi110.stdout:3/484: rename d6/d12/d14/d3f to d6/d12/d16/d30/d9c 0 2024-04-21T23:56:19.842 INFO:tasks.workunit.client.0.smithi110.stdout:9/510: fsync d1/d29/d2a/d2b/d57/f5c 0 2024-04-21T23:56:19.854 INFO:tasks.workunit.client.0.smithi110.stdout:5/500: dwrite d7/d22/d5b/f6c [0,4194304] 0 2024-04-21T23:56:20.097 INFO:tasks.workunit.client.0.smithi110.stdout:1/462: stat d1/dd/d23/d48/l5a 0 2024-04-21T23:56:20.122 INFO:tasks.workunit.client.0.smithi110.stdout:5/501: chown d7/d24/d31/f5e 3 1 2024-04-21T23:56:20.608 INFO:tasks.workunit.client.0.smithi110.stdout:9/511: dwrite d1/d29/d6f/f83 [0,4194304] 0 2024-04-21T23:56:20.731 INFO:tasks.workunit.client.0.smithi110.stdout:6/501: dwrite d16/d3d/d97/fa0 [0,4194304] 0 2024-04-21T23:56:20.964 INFO:tasks.workunit.client.0.smithi110.stdout:4/446: truncate d1/d11/f4b 3646155 0 2024-04-21T23:56:21.010 INFO:tasks.workunit.client.0.smithi110.stdout:8/546: read d5/d4f/d79/fa5 [623236,37393] 0 2024-04-21T23:56:21.171 INFO:tasks.workunit.client.0.smithi110.stdout:4/447: dread d1/fd [0,4194304] 0 2024-04-21T23:56:21.211 INFO:tasks.workunit.client.0.smithi110.stdout:3/485: creat d6/d12/d14/d4b/f9d x:0 0 0 2024-04-21T23:56:21.423 INFO:tasks.workunit.client.0.smithi110.stdout:2/527: dwrite d9/d25/d1c/d82/faf [0,4194304] 0 2024-04-21T23:56:21.551 INFO:tasks.workunit.client.0.smithi110.stdout:5/502: rmdir d7/d9/d17 39 2024-04-21T23:56:21.728 INFO:tasks.workunit.client.0.smithi110.stdout:9/512: mkdir d1/d29/d2a/d2b/d58/da8 0 2024-04-21T23:56:21.917 INFO:tasks.workunit.client.0.smithi110.stdout:3/486: fdatasync d6/d12/d16/f23 0 2024-04-21T23:56:22.093 INFO:tasks.workunit.client.0.smithi110.stdout:4/448: creat d1/d11/d20/d58/d93/d5e/f9a x:0 0 0 2024-04-21T23:56:22.230 INFO:tasks.workunit.client.0.smithi110.stdout:1/463: dwrite d1/d2/d14/d16/d27/f6b [0,4194304] 0 2024-04-21T23:56:22.233 INFO:tasks.workunit.client.0.smithi110.stdout:2/528: dread - d9/d1a/d1d/d2b/d54/d77/fa6 zero size 2024-04-21T23:56:22.358 INFO:tasks.workunit.client.0.smithi110.stdout:5/503: truncate d7/d35/f47 2056398 0 2024-04-21T23:56:22.599 INFO:tasks.workunit.client.0.smithi110.stdout:7/513: getdents d10/d45/d51/d58 0 2024-04-21T23:56:22.650 INFO:tasks.workunit.client.0.smithi110.stdout:9/513: creat d1/d29/d2a/d6/fa9 x:0 0 0 2024-04-21T23:56:22.783 INFO:tasks.workunit.client.0.smithi110.stdout:6/502: dwrite d16/d1d/d38/f98 [0,4194304] 0 2024-04-21T23:56:22.946 INFO:tasks.workunit.client.0.smithi110.stdout:3/487: fsync d6/d12/d16/d30/f35 0 2024-04-21T23:56:22.958 INFO:tasks.workunit.client.0.smithi110.stdout:4/449: creat d1/d35/d6b/f9b x:0 0 0 2024-04-21T23:56:22.996 INFO:tasks.workunit.client.0.smithi110.stdout:1/464: creat d1/d2/d14/f9d x:0 0 0 2024-04-21T23:56:23.034 INFO:tasks.workunit.client.0.smithi110.stdout:9/514: chown d1/d29/d6f/f8a 5407315 1 2024-04-21T23:56:23.128 INFO:tasks.workunit.client.0.smithi110.stdout:9/515: chown d1/d29/d2a 50121826 1 2024-04-21T23:56:23.150 INFO:tasks.workunit.client.0.smithi110.stdout:0/511: rename d0/d27/f36 to d0/d16/d42/d50/fb4 0 2024-04-21T23:56:23.699 INFO:tasks.workunit.client.0.smithi110.stdout:2/529: creat d9/d25/d1b/d45/d50/d68/fb1 x:0 0 0 2024-04-21T23:56:24.487 INFO:tasks.workunit.client.0.smithi110.stdout:6/503: dread - d16/d1d/d38/d48/d5e/d6a/d70/f9b zero size 2024-04-21T23:56:24.620 INFO:tasks.workunit.client.0.smithi110.stdout:4/450: symlink d1/d11/d20/d23/d1c/d47/d4f/d56/l9c 0 2024-04-21T23:56:24.840 INFO:tasks.workunit.client.0.smithi110.stdout:8/547: rename d5/c5a to d5/da/d17/d6c/d95/cc5 0 2024-04-21T23:56:25.348 INFO:tasks.workunit.client.0.smithi110.stdout:5/504: dwrite d7/d24/d3a/f82 [0,4194304] 0 2024-04-21T23:56:25.479 INFO:tasks.workunit.client.0.smithi110.stdout:0/512: creat d0/d14/d23/d3b/fb5 x:0 0 0 2024-04-21T23:56:25.639 INFO:tasks.workunit.client.0.smithi110.stdout:2/530: fdatasync d9/d1a/d1d/d7a/d91/fa3 0 2024-04-21T23:56:26.069 INFO:tasks.workunit.client.0.smithi110.stdout:3/488: symlink d6/d12/d3c/d8d/l9e 0 2024-04-21T23:56:27.556 INFO:tasks.workunit.client.0.smithi110.stdout:5/505: rmdir d7/d24/d49/d61 39 2024-04-21T23:56:27.611 INFO:tasks.workunit.client.0.smithi110.stdout:9/516: write d1/d29/f34 [782673,112680] 0 2024-04-21T23:56:27.664 INFO:tasks.workunit.client.0.smithi110.stdout:9/517: chown d1/d29/d2a/d6/f77 44 1 2024-04-21T23:56:27.703 INFO:tasks.workunit.client.0.smithi110.stdout:0/513: creat d0/d25/d5a/fb6 x:0 0 0 2024-04-21T23:56:28.247 INFO:tasks.workunit.client.0.smithi110.stdout:1/465: creat d1/d1d/f9e x:0 0 0 2024-04-21T23:56:28.519 INFO:tasks.workunit.client.0.smithi110.stdout:8/548: mkdir d5/da/dac/dc6 0 2024-04-21T23:56:28.673 INFO:tasks.workunit.client.0.smithi110.stdout:6/504: write d16/d3d/f2d [2554253,51965] 0 2024-04-21T23:56:29.704 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:56:29.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:56:29.839 INFO:tasks.workunit.client.0.smithi110.stdout:3/489: fsync d6/f8 0 2024-04-21T23:56:30.524 INFO:tasks.workunit.client.0.smithi110.stdout:7/514: write d10/d45/d51/d88/d39/d7f/d80/fa8 [173094,92552] 0 2024-04-21T23:56:30.852 INFO:tasks.workunit.client.0.smithi110.stdout:3/490: truncate d6/f2d 475528 0 2024-04-21T23:56:31.104 INFO:tasks.workunit.client.0.smithi110.stdout:1/466: link d1/dd/d23/d48/l5a d1/d2/d1b/d10/d5c/d77/l9f 0 2024-04-21T23:56:31.211 INFO:tasks.workunit.client.0.smithi110.stdout:2/531: dwrite d9/d25/d1c/f34 [0,4194304] 0 2024-04-21T23:56:31.365 INFO:tasks.workunit.client.0.smithi110.stdout:4/451: write d1/d11/d20/d23/d1c/f6f [996860,93906] 0 2024-04-21T23:56:32.162 INFO:tasks.workunit.client.0.smithi110.stdout:6/505: truncate d16/d1d/d38/f98 1480175 0 2024-04-21T23:56:32.213 INFO:tasks.workunit.client.0.smithi110.stdout:7/515: mkdir d10/d45/d60/dbb 0 2024-04-21T23:56:32.291 INFO:tasks.workunit.client.0.smithi110.stdout:5/506: dwrite d7/d9/f3b [12582912,4194304] 0 2024-04-21T23:56:32.335 INFO:tasks.workunit.client.0.smithi110.stdout:0/514: dwrite d0/d14/f6e [0,4194304] 0 2024-04-21T23:56:32.559 INFO:tasks.workunit.client.0.smithi110.stdout:9/518: dwrite d1/d29/d2a/d2b/f8d [0,4194304] 0 2024-04-21T23:56:32.563 INFO:tasks.workunit.client.0.smithi110.stdout:1/467: creat d1/dd/d23/d48/d4e/d86/fa0 x:0 0 0 2024-04-21T23:56:32.730 INFO:tasks.workunit.client.0.smithi110.stdout:3/491: dread d6/d12/d14/d4b/f5f [0,4194304] 0 2024-04-21T23:56:33.144 INFO:tasks.workunit.client.0.smithi110.stdout:8/549: dwrite d5/da/d17/d6c/d72/d73/d78/d8c/fb2 [0,4194304] 0 2024-04-21T23:56:33.381 INFO:tasks.workunit.client.0.smithi110.stdout:7/516: creat d10/d45/d60/d5e/d65/fbc x:0 0 0 2024-04-21T23:56:33.607 INFO:tasks.workunit.client.0.smithi110.stdout:6/506: dread d16/d1e/d24/f4e [0,4194304] 0 2024-04-21T23:56:33.681 INFO:tasks.workunit.client.0.smithi110.stdout:4/452: write d1/d11/d12/f18 [2090977,43011] 0 2024-04-21T23:56:33.722 INFO:tasks.workunit.client.0.smithi110.stdout:7/517: chown d10/d45/d60/la4 514806 1 2024-04-21T23:56:33.935 INFO:tasks.workunit.client.0.smithi110.stdout:2/532: dwrite d9/fa [8388608,4194304] 0 2024-04-21T23:56:34.114 INFO:tasks.workunit.client.0.smithi110.stdout:9/519: dread d1/d29/d2a/d2b/d58/d7b/f91 [0,4194304] 0 2024-04-21T23:56:34.148 INFO:tasks.workunit.client.0.smithi110.stdout:7/518: read d10/d45/d51/d88/f54 [3372949,111849] 0 2024-04-21T23:56:34.165 INFO:tasks.workunit.client.0.smithi110.stdout:1/468: truncate d1/d2/d1b/d10/f4d 1067928 0 2024-04-21T23:56:34.191 INFO:tasks.workunit.client.0.smithi110.stdout:3/492: mknod d6/c9f 0 2024-04-21T23:56:34.404 INFO:tasks.workunit.client.0.smithi110.stdout:4/453: symlink d1/d11/d20/d23/d1c/d47/d4f/d56/d7a/l9d 0 2024-04-21T23:56:34.479 INFO:tasks.workunit.client.0.smithi110.stdout:9/520: sync 2024-04-21T23:56:34.637 INFO:tasks.workunit.client.0.smithi110.stdout:3/493: creat d6/d12/d14/d4b/fa0 x:0 0 0 2024-04-21T23:56:34.855 INFO:tasks.workunit.client.0.smithi110.stdout:6/507: truncate d16/d1d/f41 169595 0 2024-04-21T23:56:34.926 INFO:tasks.workunit.client.0.smithi110.stdout:1/469: truncate d1/d2/d1b/f9 3197652 0 2024-04-21T23:56:35.111 INFO:tasks.workunit.client.0.smithi110.stdout:5/507: getdents d7/d24/d3a 0 2024-04-21T23:56:35.203 INFO:tasks.workunit.client.0.smithi110.stdout:5/508: sync 2024-04-21T23:56:35.644 INFO:tasks.workunit.client.0.smithi110.stdout:4/454: rename d1/d11/d20/d23/l5d to d1/d11/d20/d50/l9e 0 2024-04-21T23:56:35.662 INFO:tasks.workunit.client.0.smithi110.stdout:0/515: write d0/d14/d23/f9e [429918,121922] 0 2024-04-21T23:56:35.710 INFO:tasks.workunit.client.0.smithi110.stdout:2/533: symlink d9/d25/d1c/da0/lb2 0 2024-04-21T23:56:35.763 INFO:tasks.workunit.client.0.smithi110.stdout:2/534: chown d9/d25/d1c/d82 12 1 2024-04-21T23:56:35.838 INFO:tasks.workunit.client.0.smithi110.stdout:2/535: rename d9 to d9/d25/d1b/d45/d50/d68/da4/db3 22 2024-04-21T23:56:36.448 INFO:tasks.workunit.client.0.smithi110.stdout:8/550: write d5/d24/d33/d3d/f46 [61590,70592] 0 2024-04-21T23:56:36.725 INFO:tasks.workunit.client.0.smithi110.stdout:4/455: truncate d1/f39 3985776 0 2024-04-21T23:56:37.281 INFO:tasks.workunit.client.0.smithi110.stdout:7/519: dwrite d10/d45/d51/d88/d46/fb4 [0,4194304] 0 2024-04-21T23:56:38.269 INFO:tasks.workunit.client.0.smithi110.stdout:4/456: dread d1/d11/f3d [0,4194304] 0 2024-04-21T23:56:38.300 INFO:tasks.workunit.client.0.smithi110.stdout:4/457: read d1/fd [4097387,85390] 0 2024-04-21T23:56:38.490 INFO:tasks.workunit.client.0.smithi110.stdout:4/458: dread d1/d11/d12/d26/f3b [0,4194304] 0 2024-04-21T23:56:38.510 INFO:tasks.workunit.client.0.smithi110.stdout:9/521: write d1/d29/d4d/f8e [1039142,67493] 0 2024-04-21T23:56:38.514 INFO:tasks.workunit.client.0.smithi110.stdout:5/509: link d7/f58 d7/d35/f8a 0 2024-04-21T23:56:38.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/508: write d16/d3d/d40/d46/f76 [721287,40928] 0 2024-04-21T23:56:38.664 INFO:tasks.workunit.client.0.smithi110.stdout:1/470: write d1/dd/d23/f96 [615583,2187] 0 2024-04-21T23:56:39.404 INFO:tasks.workunit.client.0.smithi110.stdout:0/516: dwrite d0/d16/d5d/f90 [0,4194304] 0 2024-04-21T23:56:39.585 INFO:tasks.workunit.client.0.smithi110.stdout:0/517: chown d0/d27/d4b/da0/db1 7624243 1 2024-04-21T23:56:39.708 INFO:tasks.workunit.client.0.smithi110.stdout:3/494: mkdir d6/d12/da1 0 2024-04-21T23:56:40.080 INFO:tasks.workunit.client.0.smithi110.stdout:4/459: fsync d1/d11/d20/d50/f6e 0 2024-04-21T23:56:40.127 INFO:tasks.workunit.client.0.smithi110.stdout:2/536: write d9/d25/d1b/d45/f80 [181269,49621] 0 2024-04-21T23:56:40.129 INFO:tasks.workunit.client.0.smithi110.stdout:1/471: dread - d1/d2/d14/f5b zero size 2024-04-21T23:56:40.436 INFO:tasks.workunit.client.0.smithi110.stdout:5/510: truncate d7/d9/f3d 1388751 0 2024-04-21T23:56:41.017 INFO:tasks.workunit.client.0.smithi110.stdout:3/495: dread d6/f19 [0,4194304] 0 2024-04-21T23:56:41.241 INFO:tasks.workunit.client.0.smithi110.stdout:1/472: rename d1/dd/l97 to d1/d1d/d57/d91/d8d/la1 0 2024-04-21T23:56:41.444 INFO:tasks.workunit.client.0.smithi110.stdout:6/509: link d16/d1d/d38/d8e/f9f d16/d3d/d97/fa1 0 2024-04-21T23:56:41.558 INFO:tasks.workunit.client.0.smithi110.stdout:2/537: mkdir d9/d1a/d1d/db4 0 2024-04-21T23:56:41.621 INFO:tasks.workunit.client.0.smithi110.stdout:3/496: mkdir d6/d12/d3c/d65/da2 0 2024-04-21T23:56:41.686 INFO:tasks.workunit.client.0.smithi110.stdout:8/551: dwrite d5/da/d17/d7c/f87 [0,4194304] 0 2024-04-21T23:56:41.818 INFO:tasks.workunit.client.0.smithi110.stdout:1/473: mkdir d1/d2/d1b/d10/da2 0 2024-04-21T23:56:41.869 INFO:tasks.workunit.client.0.smithi110.stdout:8/552: sync 2024-04-21T23:56:41.869 INFO:tasks.workunit.client.0.smithi110.stdout:3/497: sync 2024-04-21T23:56:41.929 INFO:tasks.workunit.client.0.smithi110.stdout:0/518: rmdir d0/d2a 39 2024-04-21T23:56:42.017 INFO:tasks.workunit.client.0.smithi110.stdout:4/460: truncate d1/d11/d20/d23/d1c/d40/f63 2691010 0 2024-04-21T23:56:42.184 INFO:tasks.workunit.client.0.smithi110.stdout:7/520: dwrite d10/d45/d60/f78 [0,4194304] 0 2024-04-21T23:56:42.540 INFO:tasks.workunit.client.0.smithi110.stdout:2/538: fsync d9/d1a/d1d/d2b/d54/f70 0 2024-04-21T23:56:42.719 INFO:tasks.workunit.client.0.smithi110.stdout:4/461: dread d1/d35/f33 [0,4194304] 0 2024-04-21T23:56:42.930 INFO:tasks.workunit.client.0.smithi110.stdout:1/474: creat d1/d1d/d57/d91/fa3 x:0 0 0 2024-04-21T23:56:43.406 INFO:tasks.workunit.client.0.smithi110.stdout:0/519: truncate d0/d16/d42/d50/d83/fa2 465144 0 2024-04-21T23:56:43.426 INFO:tasks.workunit.client.0.smithi110.stdout:9/522: write d1/d29/d59/f93 [928281,128035] 0 2024-04-21T23:56:43.546 INFO:tasks.workunit.client.0.smithi110.stdout:8/553: truncate d5/da/f35 1736248 0 2024-04-21T23:56:43.624 INFO:tasks.workunit.client.0.smithi110.stdout:2/539: truncate d9/d1a/d1d/d4a/d6b/d3a/f41 714823 0 2024-04-21T23:56:44.423 INFO:tasks.workunit.client.0.smithi110.stdout:8/554: dread - d5/d74/faf zero size 2024-04-21T23:56:44.875 INFO:tasks.workunit.client.0.smithi110.stdout:3/498: link d6/d12/d16/l94 d6/d12/d14/d32/la3 0 2024-04-21T23:56:45.218 INFO:tasks.workunit.client.0.smithi110.stdout:8/555: rename d5/f9c to d5/d24/d33/d3d/d5c/fc7 0 2024-04-21T23:56:45.256 INFO:tasks.workunit.client.0.smithi110.stdout:8/556: chown d5/d4f/c93 1446040 1 2024-04-21T23:56:45.278 INFO:tasks.workunit.client.0.smithi110.stdout:8/557: chown d5/d74/fb1 21600008 1 2024-04-21T23:56:45.291 INFO:tasks.workunit.client.0.smithi110.stdout:8/558: chown d5/d4f 63 1 2024-04-21T23:56:45.916 INFO:tasks.workunit.client.0.smithi110.stdout:5/511: dwrite d7/d9/d17/f51 [0,4194304] 0 2024-04-21T23:56:46.114 INFO:tasks.workunit.client.0.smithi110.stdout:5/512: dread d7/d9/d17/f2c [0,4194304] 0 2024-04-21T23:56:46.147 INFO:tasks.workunit.client.0.smithi110.stdout:5/513: chown d7/d24/d37/f87 2835 1 2024-04-21T23:56:46.298 INFO:tasks.workunit.client.0.smithi110.stdout:7/521: write d10/d45/d51/d58/f72 [611117,55468] 0 2024-04-21T23:56:46.502 INFO:tasks.workunit.client.0.smithi110.stdout:7/522: sync 2024-04-21T23:56:46.516 INFO:tasks.workunit.client.0.smithi110.stdout:1/475: write d1/d2/d30/f98 [22828,67722] 0 2024-04-21T23:56:46.669 INFO:tasks.workunit.client.0.smithi110.stdout:6/510: dwrite d16/d3d/f43 [0,4194304] 0 2024-04-21T23:56:46.991 INFO:tasks.workunit.client.0.smithi110.stdout:4/462: write d1/d11/d20/d23/ff [1136896,31712] 0 2024-04-21T23:56:47.130 INFO:tasks.workunit.client.0.smithi110.stdout:1/476: read d1/d2/f25 [2123213,25670] 0 2024-04-21T23:56:47.150 INFO:tasks.workunit.client.0.smithi110.stdout:1/477: chown d1/dd 158037 1 2024-04-21T23:56:47.176 INFO:tasks.workunit.client.0.smithi110.stdout:0/520: write d0/d27/d4b/d7f/faf [379254,71874] 0 2024-04-21T23:56:47.238 INFO:tasks.workunit.client.0.smithi110.stdout:1/478: stat d1/d1d/d57/d91/l80 0 2024-04-21T23:56:47.726 INFO:tasks.workunit.client.0.smithi110.stdout:2/540: write d9/d1a/d1d/d2b/d5b/f79 [544027,65264] 0 2024-04-21T23:56:47.974 INFO:tasks.workunit.client.0.smithi110.stdout:0/521: rename d0/d16/l99 to d0/d14/d23/d6d/da8/lb7 0 2024-04-21T23:56:48.165 INFO:tasks.workunit.client.0.smithi110.stdout:7/523: truncate d10/d45/d60/d5e/d65/da3/fb5 687287 0 2024-04-21T23:56:48.275 INFO:tasks.workunit.client.0.smithi110.stdout:4/463: getdents d1/d11/d20/d58/d7e 0 2024-04-21T23:56:48.433 INFO:tasks.workunit.client.0.smithi110.stdout:1/479: fdatasync d1/d2/d30/f47 0 2024-04-21T23:56:48.536 INFO:tasks.workunit.client.0.smithi110.stdout:7/524: sync 2024-04-21T23:56:48.802 INFO:tasks.workunit.client.0.smithi110.stdout:3/499: dwrite d6/d12/d16/f23 [0,4194304] 0 2024-04-21T23:56:48.952 INFO:tasks.workunit.client.0.smithi110.stdout:4/464: symlink d1/d11/d20/d23/d1c/d40/l9f 0 2024-04-21T23:56:49.549 INFO:tasks.workunit.client.0.smithi110.stdout:4/465: chown d1/d35/c32 956843440 1 2024-04-21T23:56:49.675 INFO:tasks.workunit.client.0.smithi110.stdout:3/500: chown d6/d12/d50/f80 3977 1 2024-04-21T23:56:50.123 INFO:tasks.workunit.client.0.smithi110.stdout:5/514: dwrite d7/d9/f21 [0,4194304] 0 2024-04-21T23:56:50.242 INFO:tasks.workunit.client.0.smithi110.stdout:9/523: link d1/d19/l1c d1/d29/laa 0 2024-04-21T23:56:50.275 INFO:tasks.workunit.client.0.smithi110.stdout:1/480: getdents d1/d1d/d57/d91/d8d 0 2024-04-21T23:56:50.308 INFO:tasks.workunit.client.0.smithi110.stdout:4/466: creat d1/d11/d20/d58/d7e/fa0 x:0 0 0 2024-04-21T23:56:50.311 INFO:tasks.workunit.client.0.smithi110.stdout:5/515: chown d7/d9/f33 3 1 2024-04-21T23:56:50.401 INFO:tasks.workunit.client.0.smithi110.stdout:1/481: chown d1/dd/d23/f54 9545546 1 2024-04-21T23:56:50.421 INFO:tasks.workunit.client.0.smithi110.stdout:3/501: dread d6/d12/d16/d30/d9c/f42 [0,4194304] 0 2024-04-21T23:56:50.447 INFO:tasks.workunit.client.0.smithi110.stdout:1/482: stat d1/d1d/d4a/l5d 0 2024-04-21T23:56:50.736 INFO:tasks.workunit.client.0.smithi110.stdout:6/511: write f4 [4476731,28208] 0 2024-04-21T23:56:51.206 INFO:tasks.workunit.client.0.smithi110.stdout:7/525: dwrite d10/d15/d22/f79 [0,4194304] 0 2024-04-21T23:56:51.220 INFO:tasks.workunit.client.0.smithi110.stdout:2/541: dwrite d9/d25/d1c/f3c [0,4194304] 0 2024-04-21T23:56:51.477 INFO:tasks.workunit.client.0.smithi110.stdout:6/512: creat d16/d3d/d97/fa2 x:0 0 0 2024-04-21T23:56:51.549 INFO:tasks.workunit.client.0.smithi110.stdout:1/483: read d1/f83 [4148863,71535] 0 2024-04-21T23:56:51.594 INFO:tasks.workunit.client.0.smithi110.stdout:7/526: chown d10/d45/d60/d5e/f8b 3367 1 2024-04-21T23:56:51.606 INFO:tasks.workunit.client.0.smithi110.stdout:6/513: stat d16/d1d/d38/d48/d5e/d6a/d70 0 2024-04-21T23:56:51.836 INFO:tasks.workunit.client.0.smithi110.stdout:8/559: unlink d5/f55 0 2024-04-21T23:56:51.930 INFO:tasks.workunit.client.0.smithi110.stdout:0/522: rmdir d0/d27 39 2024-04-21T23:56:51.955 INFO:tasks.workunit.client.0.smithi110.stdout:3/502: write d6/d12/d14/f7e [3456726,66068] 0 2024-04-21T23:56:52.291 INFO:tasks.workunit.client.0.smithi110.stdout:7/527: creat d10/d45/d51/d88/d39/d7f/d80/d53/fbd x:0 0 0 2024-04-21T23:56:52.297 INFO:tasks.workunit.client.0.smithi110.stdout:6/514: truncate d16/d1e/d24/d33/f39 830598 0 2024-04-21T23:56:52.363 INFO:tasks.workunit.client.0.smithi110.stdout:6/515: chown d16/d3d/d40/d46/f67 275 1 2024-04-21T23:56:52.366 INFO:tasks.workunit.client.0.smithi110.stdout:7/528: chown d10/d45/d51/d88/c9e 17 1 2024-04-21T23:56:52.628 INFO:tasks.workunit.client.0.smithi110.stdout:3/503: rename d6/d12/d3c/f5a to d6/d12/d16/d6f/fa4 0 2024-04-21T23:56:52.796 INFO:tasks.workunit.client.0.smithi110.stdout:5/516: link d7/d22/d5d/f89 d7/d24/d37/d38/d88/f8b 0 2024-04-21T23:56:53.089 INFO:tasks.workunit.client.0.smithi110.stdout:6/516: rmdir d16/d3d/d40/d46 39 2024-04-21T23:56:53.118 INFO:tasks.workunit.client.0.smithi110.stdout:6/517: dread - d16/d3d/d40/f77 zero size 2024-04-21T23:56:53.274 INFO:tasks.workunit.client.0.smithi110.stdout:9/524: getdents d1/d29/d6f 0 2024-04-21T23:56:53.406 INFO:tasks.workunit.client.0.smithi110.stdout:0/523: symlink d0/lb8 0 2024-04-21T23:56:53.616 INFO:tasks.workunit.client.0.smithi110.stdout:3/504: creat d6/d12/d16/d5d/fa5 x:0 0 0 2024-04-21T23:56:53.803 INFO:tasks.workunit.client.0.smithi110.stdout:4/467: dwrite d1/f28 [0,4194304] 0 2024-04-21T23:56:53.996 INFO:tasks.workunit.client.0.smithi110.stdout:5/517: creat d7/d9/d17/f8c x:0 0 0 2024-04-21T23:56:54.133 INFO:tasks.workunit.client.0.smithi110.stdout:2/542: dwrite d9/d25/d1b/f62 [0,4194304] 0 2024-04-21T23:56:54.573 INFO:tasks.workunit.client.0.smithi110.stdout:9/525: truncate d1/d29/d4d/f8e 1944829 0 2024-04-21T23:56:54.658 INFO:tasks.workunit.client.0.smithi110.stdout:8/560: dwrite d5/d24/d33/d3d/f66 [4194304,4194304] 0 2024-04-21T23:56:54.793 INFO:tasks.workunit.client.0.smithi110.stdout:5/518: dread d7/d24/d3a/f82 [0,4194304] 0 2024-04-21T23:56:55.094 INFO:tasks.workunit.client.0.smithi110.stdout:1/484: getdents d1/d2/d14 0 2024-04-21T23:56:55.257 INFO:tasks.workunit.client.0.smithi110.stdout:7/529: dwrite d10/d15/d22/f73 [0,4194304] 0 2024-04-21T23:56:55.424 INFO:tasks.workunit.client.0.smithi110.stdout:4/468: creat d1/d11/d20/d23/fa1 x:0 0 0 2024-04-21T23:56:55.464 INFO:tasks.workunit.client.0.smithi110.stdout:2/543: mkdir d9/d1a/d1d/d4e/db5 0 2024-04-21T23:56:55.632 INFO:tasks.workunit.client.0.smithi110.stdout:0/524: symlink d0/d2a/lb9 0 2024-04-21T23:56:55.724 INFO:tasks.workunit.client.0.smithi110.stdout:1/485: dread d1/f83 [0,4194304] 0 2024-04-21T23:56:55.828 INFO:tasks.workunit.client.0.smithi110.stdout:0/525: sync 2024-04-21T23:56:55.953 INFO:tasks.workunit.client.0.smithi110.stdout:6/518: dwrite d16/d1d/d38/f4f [0,4194304] 0 2024-04-21T23:56:56.121 INFO:tasks.workunit.client.0.smithi110.stdout:5/519: creat d7/d9/d17/d48/d69/f8d x:0 0 0 2024-04-21T23:56:56.578 INFO:tasks.workunit.client.0.smithi110.stdout:2/544: fdatasync d9/d25/d1b/d45/d4d/f64 0 2024-04-21T23:56:56.814 INFO:tasks.workunit.client.0.smithi110.stdout:9/526: unlink d1/d29/d2a/dc/d30/d79/d98/l9f 0 2024-04-21T23:56:57.517 INFO:tasks.workunit.client.0.smithi110.stdout:1/486: truncate d1/d1d/d57/f62 111923 0 2024-04-21T23:56:57.743 INFO:tasks.workunit.client.0.smithi110.stdout:8/561: write d5/da/d17/d6c/d7d/f69 [923301,32457] 0 2024-04-21T23:56:57.813 INFO:tasks.workunit.client.0.smithi110.stdout:8/562: write d5/d24/d33/d3d/f66 [8294380,48051] 0 2024-04-21T23:56:57.826 INFO:tasks.workunit.client.0.smithi110.stdout:5/520: truncate d7/d24/d49/d64/f70 192784 0 2024-04-21T23:56:58.326 INFO:tasks.workunit.client.0.smithi110.stdout:9/527: creat d1/d29/d2a/d2b/d58/d7b/fab x:0 0 0 2024-04-21T23:56:58.484 INFO:tasks.workunit.client.0.smithi110.stdout:0/526: rename d0/d25/c3e to d0/d27/d4b/da0/da4/cba 0 2024-04-21T23:56:58.905 INFO:tasks.workunit.client.0.smithi110.stdout:7/530: write d10/d45/d51/d88/f54 [2018361,7305] 0 2024-04-21T23:56:58.941 INFO:tasks.workunit.client.0.smithi110.stdout:7/531: stat d10/d15/f25 0 2024-04-21T23:56:59.252 INFO:tasks.workunit.client.0.smithi110.stdout:1/487: mknod d1/dd/d23/d48/d4e/d86/ca4 0 2024-04-21T23:56:59.318 INFO:tasks.workunit.client.0.smithi110.stdout:3/505: getdents d6/d12/d16/d30 0 2024-04-21T23:56:59.348 INFO:tasks.workunit.client.0.smithi110.stdout:1/488: dread - d1/d2/d14/f5b zero size 2024-04-21T23:56:59.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/563: symlink d5/da/d17/d7c/dc0/lc8 0 2024-04-21T23:56:59.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:56:59.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:56:59.881 INFO:tasks.workunit.client.0.smithi110.stdout:2/545: symlink d9/d25/d1b/d45/d50/lb6 0 2024-04-21T23:56:59.899 INFO:tasks.workunit.client.0.smithi110.stdout:2/546: chown d9/d1a/d1d/f36 1 1 2024-04-21T23:57:00.036 INFO:tasks.workunit.client.0.smithi110.stdout:9/528: truncate d1/d29/f6c 1395049 0 2024-04-21T23:57:00.126 INFO:tasks.workunit.client.0.smithi110.stdout:0/527: rmdir d0/d56/da3 39 2024-04-21T23:57:00.225 INFO:tasks.workunit.client.0.smithi110.stdout:7/532: truncate d10/d45/d51/d88/f8e 1253271 0 2024-04-21T23:57:00.239 INFO:tasks.workunit.client.0.smithi110.stdout:7/533: stat d10/f1d 0 2024-04-21T23:57:01.161 INFO:tasks.workunit.client.0.smithi110.stdout:8/564: mknod d5/d24/d33/d3d/d82/cc9 0 2024-04-21T23:57:01.348 INFO:tasks.workunit.client.0.smithi110.stdout:2/547: rmdir d9/d1a/d1d/d2b 39 2024-04-21T23:57:01.362 INFO:tasks.workunit.client.0.smithi110.stdout:9/529: mkdir d1/d29/d4d/dac 0 2024-04-21T23:57:01.416 INFO:tasks.workunit.client.0.smithi110.stdout:2/548: chown d9/d1a/d1d/c47 8 1 2024-04-21T23:57:01.517 INFO:tasks.workunit.client.0.smithi110.stdout:0/528: truncate d0/d27/f4a 732620 0 2024-04-21T23:57:01.713 INFO:tasks.workunit.client.0.smithi110.stdout:7/534: fdatasync d10/d15/d22/d2c/f31 0 2024-04-21T23:57:01.896 INFO:tasks.workunit.client.0.smithi110.stdout:6/519: getdents d16/d1e/d24/d33 0 2024-04-21T23:57:01.961 INFO:tasks.workunit.client.0.smithi110.stdout:1/489: symlink d1/la5 0 2024-04-21T23:57:02.113 INFO:tasks.workunit.client.0.smithi110.stdout:8/565: mkdir d5/d6f/dca 0 2024-04-21T23:57:02.145 INFO:tasks.workunit.client.0.smithi110.stdout:8/566: chown d5/da/d17/d6c/d72/da0 2 1 2024-04-21T23:57:02.815 INFO:tasks.workunit.client.0.smithi110.stdout:9/530: fdatasync d1/d19/f4b 0 2024-04-21T23:57:03.539 INFO:tasks.workunit.client.0.smithi110.stdout:7/535: truncate d10/d45/d51/d58/f72 432792 0 2024-04-21T23:57:03.574 INFO:tasks.workunit.client.0.smithi110.stdout:6/520: creat d16/d1d/d38/d48/d5e/d6a/d70/fa3 x:0 0 0 2024-04-21T23:57:03.982 INFO:tasks.workunit.client.0.smithi110.stdout:8/567: creat d5/d74/fcb x:0 0 0 2024-04-21T23:57:04.384 INFO:tasks.workunit.client.0.smithi110.stdout:6/521: creat d16/d3d/d97/fa4 x:0 0 0 2024-04-21T23:57:04.537 INFO:tasks.workunit.client.0.smithi110.stdout:4/469: creat d1/d11/d20/fa2 x:0 0 0 2024-04-21T23:57:04.639 INFO:tasks.workunit.client.0.smithi110.stdout:9/531: mkdir d1/d29/d2a/d2b/d57/d97/dad 0 2024-04-21T23:57:04.841 INFO:tasks.workunit.client.0.smithi110.stdout:8/568: mknod d5/d24/d33/d3d/d82/ccc 0 2024-04-21T23:57:05.083 INFO:tasks.workunit.client.0.smithi110.stdout:3/506: dwrite d6/d12/d14/f31 [0,4194304] 0 2024-04-21T23:57:05.395 INFO:tasks.workunit.client.0.smithi110.stdout:5/521: dwrite d7/f58 [0,4194304] 0 2024-04-21T23:57:05.570 INFO:tasks.workunit.client.0.smithi110.stdout:4/470: creat d1/d11/d20/d50/fa3 x:0 0 0 2024-04-21T23:57:05.588 INFO:tasks.workunit.client.0.smithi110.stdout:9/532: mknod d1/d29/d2a/d3c/cae 0 2024-04-21T23:57:06.012 INFO:tasks.workunit.client.0.smithi110.stdout:8/569: unlink d5/d24/d33/d3d/d5c/d6a/la3 0 2024-04-21T23:57:06.221 INFO:tasks.workunit.client.0.smithi110.stdout:7/536: creat d10/d45/d60/fbe x:0 0 0 2024-04-21T23:57:06.453 INFO:tasks.workunit.client.0.smithi110.stdout:3/507: rename d6/d12/d16/d30/l5c to d6/d12/d16/d6f/d7a/la6 0 2024-04-21T23:57:06.505 INFO:tasks.workunit.client.0.smithi110.stdout:2/549: write d9/d25/d1b/d45/d50/d68/fb1 [145921,120730] 0 2024-04-21T23:57:06.566 INFO:tasks.workunit.client.0.smithi110.stdout:3/508: fdatasync d6/d12/d16/d30/d67/f92 0 2024-04-21T23:57:06.677 INFO:tasks.workunit.client.0.smithi110.stdout:5/522: symlink d7/d22/d5b/l8e 0 2024-04-21T23:57:06.824 INFO:tasks.workunit.client.0.smithi110.stdout:9/533: symlink d1/d29/d2a/laf 0 2024-04-21T23:57:07.220 INFO:tasks.workunit.client.0.smithi110.stdout:7/537: rename d10/fab to d10/d15/d22/d2c/fbf 0 2024-04-21T23:57:07.257 INFO:tasks.workunit.client.0.smithi110.stdout:1/490: write d1/d2/d1b/d10/f5f [4337659,78299] 0 2024-04-21T23:57:07.442 INFO:tasks.workunit.client.0.smithi110.stdout:8/570: dwrite d5/da/d17/f85 [0,4194304] 0 2024-04-21T23:57:08.006 INFO:tasks.workunit.client.0.smithi110.stdout:2/550: dread d9/d1a/d1d/d2b/f69 [0,4194304] 0 2024-04-21T23:57:08.069 INFO:tasks.workunit.client.0.smithi110.stdout:4/471: creat d1/d11/d20/fa4 x:0 0 0 2024-04-21T23:57:08.092 INFO:tasks.workunit.client.0.smithi110.stdout:4/472: chown d1/f28 427271 1 2024-04-21T23:57:08.480 INFO:tasks.workunit.client.0.smithi110.stdout:8/571: dread d5/d24/d33/d3d/d5c/fc7 [0,4194304] 0 2024-04-21T23:57:08.557 INFO:tasks.workunit.client.0.smithi110.stdout:5/523: creat d7/d24/d49/d61/f8f x:0 0 0 2024-04-21T23:57:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:7/538: symlink d10/d45/d51/d88/d39/lc0 0 2024-04-21T23:57:09.296 INFO:tasks.workunit.client.0.smithi110.stdout:0/529: rmdir d0/d25 39 2024-04-21T23:57:09.577 INFO:tasks.workunit.client.0.smithi110.stdout:6/522: dwrite d16/d3d/f30 [0,4194304] 0 2024-04-21T23:57:10.412 INFO:tasks.workunit.client.0.smithi110.stdout:3/509: dwrite d6/d12/d50/f66 [0,4194304] 0 2024-04-21T23:57:10.770 INFO:tasks.workunit.client.0.smithi110.stdout:6/523: dread d16/d1d/d38/f4f [0,4194304] 0 2024-04-21T23:57:10.781 INFO:tasks.workunit.client.0.smithi110.stdout:8/572: creat d5/da/dac/dc6/fcd x:0 0 0 2024-04-21T23:57:11.241 INFO:tasks.workunit.client.0.smithi110.stdout:7/539: mknod d10/d45/d51/d88/d93/cc1 0 2024-04-21T23:57:11.264 INFO:tasks.workunit.client.0.smithi110.stdout:1/491: write d1/d2/d1b/d10/f12 [3128406,129662] 0 2024-04-21T23:57:11.794 INFO:tasks.workunit.client.0.smithi110.stdout:3/510: mknod d6/d12/d16/d6f/d7a/ca7 0 2024-04-21T23:57:11.877 INFO:tasks.workunit.client.0.smithi110.stdout:5/524: rename d7/c28 to d7/d24/d49/d61/c90 0 2024-04-21T23:57:11.968 INFO:tasks.workunit.client.0.smithi110.stdout:5/525: chown d7/d24/d37/f87 655764 1 2024-04-21T23:57:12.220 INFO:tasks.workunit.client.0.smithi110.stdout:7/540: symlink d10/d45/d60/d5e/lc2 0 2024-04-21T23:57:12.569 INFO:tasks.workunit.client.0.smithi110.stdout:0/530: rename d0/d27/f9a to d0/d27/d68/d7d/fbb 0 2024-04-21T23:57:12.657 INFO:tasks.workunit.client.0.smithi110.stdout:3/511: truncate d6/d12/d50/f80 6146995 0 2024-04-21T23:57:12.891 INFO:tasks.workunit.client.0.smithi110.stdout:1/492: mkdir d1/d2/d14/d65/d8a/da6 0 2024-04-21T23:57:13.098 INFO:tasks.workunit.client.0.smithi110.stdout:4/473: dwrite d1/f3 [4194304,4194304] 0 2024-04-21T23:57:13.300 INFO:tasks.workunit.client.0.smithi110.stdout:9/534: dwrite d1/d19/d42/f6b [0,4194304] 0 2024-04-21T23:57:13.501 INFO:tasks.workunit.client.0.smithi110.stdout:4/474: sync 2024-04-21T23:57:13.533 INFO:tasks.workunit.client.0.smithi110.stdout:5/526: mkdir d7/d24/d37/d38/d88/d91 0 2024-04-21T23:57:13.561 INFO:tasks.workunit.client.0.smithi110.stdout:0/531: dread d0/d27/d4b/f64 [0,4194304] 0 2024-04-21T23:57:13.567 INFO:tasks.workunit.client.0.smithi110.stdout:9/535: sync 2024-04-21T23:57:13.569 INFO:tasks.workunit.client.0.smithi110.stdout:2/551: dwrite d9/d1a/d1d/fa9 [0,4194304] 0 2024-04-21T23:57:13.757 INFO:tasks.workunit.client.0.smithi110.stdout:1/493: truncate d1/f40 5081291 0 2024-04-21T23:57:14.041 INFO:tasks.workunit.client.0.smithi110.stdout:3/512: unlink d6/l10 0 2024-04-21T23:57:14.344 INFO:tasks.workunit.client.0.smithi110.stdout:5/527: fsync d7/d22/d5b/f6c 0 2024-04-21T23:57:14.542 INFO:tasks.workunit.client.0.smithi110.stdout:2/552: readlink d9/d25/d1b/d45/d50/l8f 0 2024-04-21T23:57:14.782 INFO:tasks.workunit.client.0.smithi110.stdout:3/513: mkdir d6/d12/d3c/d65/da8 0 2024-04-21T23:57:14.817 INFO:tasks.workunit.client.0.smithi110.stdout:8/573: write d5/d80/f8f [4476682,38113] 0 2024-04-21T23:57:14.987 INFO:tasks.workunit.client.0.smithi110.stdout:3/514: stat d6/d12/l43 0 2024-04-21T23:57:14.997 INFO:tasks.workunit.client.0.smithi110.stdout:5/528: fdatasync d7/d9/d17/f1c 0 2024-04-21T23:57:15.016 INFO:tasks.workunit.client.0.smithi110.stdout:6/524: dwrite d16/d3d/d97/fa2 [0,4194304] 0 2024-04-21T23:57:15.153 INFO:tasks.workunit.client.0.smithi110.stdout:0/532: mkdir d0/d16/d42/d50/dbc 0 2024-04-21T23:57:15.238 INFO:tasks.workunit.client.0.smithi110.stdout:5/529: chown d7/d22/d5b/l77 81781 1 2024-04-21T23:57:15.276 INFO:tasks.workunit.client.0.smithi110.stdout:5/530: stat d7/f58 0 2024-04-21T23:57:15.373 INFO:tasks.workunit.client.0.smithi110.stdout:1/494: fdatasync d1/f39 0 2024-04-21T23:57:15.603 INFO:tasks.workunit.client.0.smithi110.stdout:8/574: dread d5/f6 [0,4194304] 0 2024-04-21T23:57:15.625 INFO:tasks.workunit.client.0.smithi110.stdout:8/575: stat d5/d24/c11 0 2024-04-21T23:57:15.754 INFO:tasks.workunit.client.0.smithi110.stdout:0/533: readlink d0/l8 0 2024-04-21T23:57:15.900 INFO:tasks.workunit.client.0.smithi110.stdout:6/525: symlink d16/d1d/d38/d48/d5e/d6a/d70/la5 0 2024-04-21T23:57:15.987 INFO:tasks.workunit.client.0.smithi110.stdout:5/531: symlink d7/d22/d5b/d68/l92 0 2024-04-21T23:57:16.938 INFO:tasks.workunit.client.0.smithi110.stdout:8/576: creat d5/da/d17/d6c/d72/d73/d78/d8c/fce x:0 0 0 2024-04-21T23:57:17.108 INFO:tasks.workunit.client.0.smithi110.stdout:9/536: getdents d1/d29/d2a/d2b/d58 0 2024-04-21T23:57:17.305 INFO:tasks.workunit.client.0.smithi110.stdout:0/534: creat d0/d16/d42/fbd x:0 0 0 2024-04-21T23:57:17.393 INFO:tasks.workunit.client.0.smithi110.stdout:3/515: rename d6/l4a to d6/d12/d14/d4b/la9 0 2024-04-21T23:57:17.476 INFO:tasks.workunit.client.0.smithi110.stdout:2/553: link d9/d25/d1b/d45/d4d/f73 d9/d1a/d1d/d7a/d91/dac/fb7 0 2024-04-21T23:57:17.543 INFO:tasks.workunit.client.0.smithi110.stdout:3/516: sync 2024-04-21T23:57:17.624 INFO:tasks.workunit.client.0.smithi110.stdout:1/495: mkdir d1/d2/d1b/da7 0 2024-04-21T23:57:17.852 INFO:tasks.workunit.client.0.smithi110.stdout:7/541: dwrite d10/f1d [0,4194304] 0 2024-04-21T23:57:17.984 INFO:tasks.workunit.client.0.smithi110.stdout:8/577: creat d5/da/d17/d7c/dc0/fcf x:0 0 0 2024-04-21T23:57:18.134 INFO:tasks.workunit.client.0.smithi110.stdout:0/535: dread d0/d27/f6b [0,4194304] 0 2024-04-21T23:57:18.136 INFO:tasks.workunit.client.0.smithi110.stdout:6/526: rename cc to d16/d1d/d38/d8e/ca6 0 2024-04-21T23:57:18.900 INFO:tasks.workunit.client.0.smithi110.stdout:4/475: dwrite d1/d11/f8a [0,4194304] 0 2024-04-21T23:57:19.405 INFO:tasks.workunit.client.0.smithi110.stdout:5/532: rename d7/d9/d17/c2d to d7/d22/d5b/c93 0 2024-04-21T23:57:19.451 INFO:tasks.workunit.client.0.smithi110.stdout:8/578: dread d5/da/d17/d60/f6e [0,4194304] 0 2024-04-21T23:57:20.198 INFO:tasks.workunit.client.0.smithi110.stdout:9/537: link d1/d29/d2a/d2b/d57/ca4 d1/d29/d2a/d2b/cb0 0 2024-04-21T23:57:20.885 INFO:tasks.workunit.client.0.smithi110.stdout:3/517: creat d6/d12/faa x:0 0 0 2024-04-21T23:57:21.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/579: mknod d5/d74/cd0 0 2024-04-21T23:57:21.895 INFO:tasks.workunit.client.0.smithi110.stdout:2/554: creat d9/d25/d1b/d45/fb8 x:0 0 0 2024-04-21T23:57:22.202 INFO:tasks.workunit.client.0.smithi110.stdout:6/527: dwrite d16/d1d/d38/d48/d5e/d62/f8d [0,4194304] 0 2024-04-21T23:57:22.584 INFO:tasks.workunit.client.0.smithi110.stdout:1/496: dwrite d1/d2/d1b/f11 [0,4194304] 0 2024-04-21T23:57:22.701 INFO:tasks.workunit.client.0.smithi110.stdout:8/580: mkdir d5/d4f/d79/dd1 0 2024-04-21T23:57:22.757 INFO:tasks.workunit.client.0.smithi110.stdout:7/542: link d10/d45/d51/d88/d39/d7f/d80/l68 d10/d45/d51/d88/d39/d7f/lc3 0 2024-04-21T23:57:23.129 INFO:tasks.workunit.client.0.smithi110.stdout:4/476: dwrite d1/d11/d12/f18 [4194304,4194304] 0 2024-04-21T23:57:23.467 INFO:tasks.workunit.client.0.smithi110.stdout:0/536: rename d0/d27/d68/d7d/lae to d0/d16/d42/d50/lbe 0 2024-04-21T23:57:23.965 INFO:tasks.workunit.client.0.smithi110.stdout:5/533: rename d7/d24/d37/l52 to d7/d24/d37/l94 0 2024-04-21T23:57:24.152 INFO:tasks.workunit.client.0.smithi110.stdout:1/497: creat d1/dd/d23/d48/fa8 x:0 0 0 2024-04-21T23:57:24.185 INFO:tasks.workunit.client.0.smithi110.stdout:5/534: sync 2024-04-21T23:57:24.195 INFO:tasks.workunit.client.0.smithi110.stdout:1/498: readlink d1/dd/d23/d48/d4e/l60 0 2024-04-21T23:57:24.270 INFO:tasks.workunit.client.0.smithi110.stdout:7/543: creat d10/d45/d51/d88/d93/fc4 x:0 0 0 2024-04-21T23:57:24.312 INFO:tasks.workunit.client.0.smithi110.stdout:7/544: chown d10/d45/d51/d88/c96 15394580 1 2024-04-21T23:57:24.726 INFO:tasks.workunit.client.0.smithi110.stdout:6/528: creat d16/d1e/d24/d90/fa7 x:0 0 0 2024-04-21T23:57:25.210 INFO:tasks.workunit.client.0.smithi110.stdout:5/535: dread - d7/d35/f7b zero size 2024-04-21T23:57:25.371 INFO:tasks.workunit.client.0.smithi110.stdout:1/499: truncate d1/d2/d14/f9d 768876 0 2024-04-21T23:57:25.397 INFO:tasks.workunit.client.0.smithi110.stdout:9/538: dwrite d1/d29/d2a/d2b/d58/d7b/f91 [0,4194304] 0 2024-04-21T23:57:25.683 INFO:tasks.workunit.client.0.smithi110.stdout:3/518: mkdir d6/d12/d16/d6f/dab 0 2024-04-21T23:57:26.548 INFO:tasks.workunit.client.0.smithi110.stdout:6/529: mkdir d16/d1e/da8 0 2024-04-21T23:57:26.699 INFO:tasks.workunit.client.0.smithi110.stdout:1/500: dread d1/d2/d1b/d10/f4d [0,4194304] 0 2024-04-21T23:57:26.784 INFO:tasks.workunit.client.0.smithi110.stdout:9/539: dread d1/d29/d2a/d6/d1d/f24 [0,4194304] 0 2024-04-21T23:57:27.030 INFO:tasks.workunit.client.0.smithi110.stdout:7/545: rename d10/d15/f1b to d10/d15/fc5 0 2024-04-21T23:57:27.109 INFO:tasks.workunit.client.0.smithi110.stdout:4/477: link f0 d1/d11/d20/d58/d93/d7c/fa5 0 2024-04-21T23:57:27.203 INFO:tasks.workunit.client.0.smithi110.stdout:6/530: dread d16/f1b [0,4194304] 0 2024-04-21T23:57:27.341 INFO:tasks.workunit.client.0.smithi110.stdout:3/519: mknod d6/d12/d14/cac 0 2024-04-21T23:57:27.351 INFO:tasks.workunit.client.0.smithi110.stdout:2/555: unlink d9/fa 0 2024-04-21T23:57:27.467 INFO:tasks.workunit.client.0.smithi110.stdout:3/520: sync 2024-04-21T23:57:27.601 INFO:tasks.workunit.client.0.smithi110.stdout:9/540: mknod d1/d29/d2a/d6/cb1 0 2024-04-21T23:57:27.627 INFO:tasks.workunit.client.0.smithi110.stdout:8/581: write d5/d4f/f5f [1234120,58859] 0 2024-04-21T23:57:27.731 INFO:tasks.workunit.client.0.smithi110.stdout:4/478: readlink d1/d35/l3a 0 2024-04-21T23:57:27.920 INFO:tasks.workunit.client.0.smithi110.stdout:6/531: mkdir d16/d3d/d97/da9 0 2024-04-21T23:57:28.019 INFO:tasks.workunit.client.0.smithi110.stdout:2/556: creat d9/d25/d1b/d45/d50/d68/da4/fb9 x:0 0 0 2024-04-21T23:57:28.249 INFO:tasks.workunit.client.0.smithi110.stdout:8/582: dread - d5/fb3 zero size 2024-04-21T23:57:28.632 INFO:tasks.workunit.client.0.smithi110.stdout:0/537: dwrite d0/d14/f8f [0,4194304] 0 2024-04-21T23:57:28.974 INFO:tasks.workunit.client.0.smithi110.stdout:6/532: chown d16/d1d/d38/c59 53638173 1 2024-04-21T23:57:29.134 INFO:tasks.workunit.client.0.smithi110.stdout:2/557: rmdir d9/d1a/d1d/d2b/d54 39 2024-04-21T23:57:29.580 INFO:tasks.workunit.client.0.smithi110.stdout:0/538: creat d0/d16/d42/d50/d83/fbf x:0 0 0 2024-04-21T23:57:29.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:57:29.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:57:30.157 INFO:tasks.workunit.client.0.smithi110.stdout:5/536: dwrite d7/d35/f7b [0,4194304] 0 2024-04-21T23:57:30.747 INFO:tasks.workunit.client.0.smithi110.stdout:2/558: fsync d9/d1a/d1d/d2b/d54/d77/fa6 0 2024-04-21T23:57:30.939 INFO:tasks.workunit.client.0.smithi110.stdout:0/539: mknod d0/d25/cc0 0 2024-04-21T23:57:31.331 INFO:tasks.workunit.client.0.smithi110.stdout:2/559: truncate d9/d25/d1b/f62 1467378 0 2024-04-21T23:57:31.352 INFO:tasks.workunit.client.0.smithi110.stdout:1/501: write d1/dd/d23/d48/d4e/d86/fa0 [33246,92508] 0 2024-04-21T23:57:31.537 INFO:tasks.workunit.client.0.smithi110.stdout:0/540: mkdir d0/d27/d4b/d7f/dc1 0 2024-04-21T23:57:32.149 INFO:tasks.workunit.client.0.smithi110.stdout:2/560: symlink d9/d1a/d7b/lba 0 2024-04-21T23:57:32.681 INFO:tasks.workunit.client.0.smithi110.stdout:7/546: dwrite d10/d45/d51/f85 [0,4194304] 0 2024-04-21T23:57:32.862 INFO:tasks.workunit.client.0.smithi110.stdout:2/561: dwrite d9/d25/d1b/d45/d50/d68/da4/fb9 [0,4194304] 0 2024-04-21T23:57:33.016 INFO:tasks.workunit.client.0.smithi110.stdout:2/562: chown d9/d25/d1b/d45/d50/d68/l71 233 1 2024-04-21T23:57:33.188 INFO:tasks.workunit.client.0.smithi110.stdout:8/583: rename d5/da/l68 to d5/da/d17/d6c/d95/d98/ld2 0 2024-04-21T23:57:33.213 INFO:tasks.workunit.client.0.smithi110.stdout:0/541: creat d0/d14/d23/fc2 x:0 0 0 2024-04-21T23:57:33.304 INFO:tasks.workunit.client.0.smithi110.stdout:6/533: write f3 [9019495,112662] 0 2024-04-21T23:57:33.311 INFO:tasks.workunit.client.0.smithi110.stdout:9/541: write d1/d19/f16 [4823874,20002] 0 2024-04-21T23:57:33.462 INFO:tasks.workunit.client.0.smithi110.stdout:8/584: sync 2024-04-21T23:57:33.566 INFO:tasks.workunit.client.0.smithi110.stdout:7/547: unlink d10/d15/d22/f5a 0 2024-04-21T23:57:33.658 INFO:tasks.workunit.client.0.smithi110.stdout:2/563: creat d9/d25/d1c/da0/fbb x:0 0 0 2024-04-21T23:57:33.735 INFO:tasks.workunit.client.0.smithi110.stdout:2/564: sync 2024-04-21T23:57:33.862 INFO:tasks.workunit.client.0.smithi110.stdout:3/521: dwrite d6/f2d [0,4194304] 0 2024-04-21T23:57:34.067 INFO:tasks.workunit.client.0.smithi110.stdout:4/479: dwrite d1/d11/d20/d23/d1c/d40/f63 [0,4194304] 0 2024-04-21T23:57:34.207 INFO:tasks.workunit.client.0.smithi110.stdout:5/537: write d7/d24/d31/f45 [1014965,78503] 0 2024-04-21T23:57:34.634 INFO:tasks.workunit.client.0.smithi110.stdout:8/585: unlink d5/da/d17/d60/f6e 0 2024-04-21T23:57:34.840 INFO:tasks.workunit.client.0.smithi110.stdout:6/534: rename d16/d1e/d24/d90/fa7 to d16/d1e/d24/d33/faa 0 2024-04-21T23:57:35.082 INFO:tasks.workunit.client.0.smithi110.stdout:7/548: dread d10/d15/d22/f44 [0,4194304] 0 2024-04-21T23:57:35.124 INFO:tasks.workunit.client.0.smithi110.stdout:7/549: dread - d10/d45/d51/d88/f7c zero size 2024-04-21T23:57:35.324 INFO:tasks.workunit.client.0.smithi110.stdout:3/522: creat d6/d12/d16/d6f/fad x:0 0 0 2024-04-21T23:57:35.376 INFO:tasks.workunit.client.0.smithi110.stdout:5/538: unlink d7/d9/f3b 0 2024-04-21T23:57:35.648 INFO:tasks.workunit.client.0.smithi110.stdout:2/565: truncate d9/d1a/d1d/d2b/d5b/f92 499896 0 2024-04-21T23:57:35.677 INFO:tasks.workunit.client.0.smithi110.stdout:2/566: chown d9/d25/d1c/d82/f9d 8047808 1 2024-04-21T23:57:35.705 INFO:tasks.workunit.client.0.smithi110.stdout:2/567: chown d9/d1a/d1d/d4e/f9a 156 1 2024-04-21T23:57:35.750 INFO:tasks.workunit.client.0.smithi110.stdout:8/586: dread - d5/d6f/f70 zero size 2024-04-21T23:57:35.796 INFO:tasks.workunit.client.0.smithi110.stdout:8/587: dread - d5/da/d17/d6c/d7d/f9a zero size 2024-04-21T23:57:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:8/588: chown d5/da/d17/d6c/d7d/c61 1 1 2024-04-21T23:57:36.472 INFO:tasks.workunit.client.0.smithi110.stdout:3/523: creat d6/d12/d16/d30/fae x:0 0 0 2024-04-21T23:57:36.692 INFO:tasks.workunit.client.0.smithi110.stdout:0/542: rmdir d0/d16/d93 0 2024-04-21T23:57:36.889 INFO:tasks.workunit.client.0.smithi110.stdout:0/543: stat d0/d25/d5a 0 2024-04-21T23:57:37.256 INFO:tasks.workunit.client.0.smithi110.stdout:0/544: read - d0/d27/f82 zero size 2024-04-21T23:57:37.407 INFO:tasks.workunit.client.0.smithi110.stdout:9/542: dwrite d1/d29/d6f/f8a [0,4194304] 0 2024-04-21T23:57:37.410 INFO:tasks.workunit.client.0.smithi110.stdout:2/568: dread d9/d1a/d1d/fa5 [0,4194304] 0 2024-04-21T23:57:37.554 INFO:tasks.workunit.client.0.smithi110.stdout:3/524: dread - d6/d12/d14/d4b/f9d zero size 2024-04-21T23:57:37.618 INFO:tasks.workunit.client.0.smithi110.stdout:2/569: chown d9/d1a/d1d/d7a/d91 239530429 1 2024-04-21T23:57:37.961 INFO:tasks.workunit.client.0.smithi110.stdout:7/550: creat d10/d45/d51/d88/d39/fc6 x:0 0 0 2024-04-21T23:57:37.986 INFO:tasks.workunit.client.0.smithi110.stdout:7/551: stat d10/d15/f2e 0 2024-04-21T23:57:38.029 INFO:tasks.workunit.client.0.smithi110.stdout:7/552: chown d10/d45/d51/d88/d39/d7f/d80/l7d 14881 1 2024-04-21T23:57:38.045 INFO:tasks.workunit.client.0.smithi110.stdout:7/553: chown d10/d15/d22/d2c 28196 1 2024-04-21T23:57:38.070 INFO:tasks.workunit.client.0.smithi110.stdout:7/554: chown d10/d45/d51/d88/c96 4697 1 2024-04-21T23:57:38.218 INFO:tasks.workunit.client.0.smithi110.stdout:5/539: link d7/d24/d3a/d40/f57 d7/d22/d5d/f95 0 2024-04-21T23:57:38.350 INFO:tasks.workunit.client.0.smithi110.stdout:1/502: symlink d1/la9 0 2024-04-21T23:57:38.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/535: dwrite d16/d1e/d24/f71 [0,4194304] 0 2024-04-21T23:57:38.905 INFO:tasks.workunit.client.0.smithi110.stdout:4/480: dwrite d1/f39 [0,4194304] 0 2024-04-21T23:57:39.051 INFO:tasks.workunit.client.0.smithi110.stdout:4/481: read d1/d11/d12/d26/f3f [1458095,101142] 0 2024-04-21T23:57:39.087 INFO:tasks.workunit.client.0.smithi110.stdout:7/555: mknod d10/d45/d60/d5e/d65/d8a/cc7 0 2024-04-21T23:57:39.183 INFO:tasks.workunit.client.0.smithi110.stdout:9/543: rename d1/d29/f6c to d1/d29/d4d/fb2 0 2024-04-21T23:57:39.297 INFO:tasks.workunit.client.0.smithi110.stdout:8/589: write d5/da/dac/dc6/fcd [1039877,17517] 0 2024-04-21T23:57:39.352 INFO:tasks.workunit.client.0.smithi110.stdout:5/540: read - d7/d24/d37/f87 zero size 2024-04-21T23:57:39.752 INFO:tasks.workunit.client.0.smithi110.stdout:1/503: mkdir d1/d2/d1b/d10/d5c/daa 0 2024-04-21T23:57:40.530 INFO:tasks.workunit.client.0.smithi110.stdout:0/545: write d0/d16/f53 [344218,81719] 0 2024-04-21T23:57:40.715 INFO:tasks.workunit.client.0.smithi110.stdout:6/536: mkdir d16/d1d/d38/dab 0 2024-04-21T23:57:41.046 INFO:tasks.workunit.client.0.smithi110.stdout:1/504: stat d1/d2/cb 0 2024-04-21T23:57:41.372 INFO:tasks.workunit.client.0.smithi110.stdout:9/544: mknod d1/d29/d2a/d2b/d58/da8/cb3 0 2024-04-21T23:57:41.469 INFO:tasks.workunit.client.0.smithi110.stdout:3/525: dwrite d6/d12/d16/f5e [0,4194304] 0 2024-04-21T23:57:41.639 INFO:tasks.workunit.client.0.smithi110.stdout:0/546: rename d0/d16/d42/f61 to d0/d2a/fc3 0 2024-04-21T23:57:41.741 INFO:tasks.workunit.client.0.smithi110.stdout:2/570: dwrite d9/f10 [0,4194304] 0 2024-04-21T23:57:41.885 INFO:tasks.workunit.client.0.smithi110.stdout:7/556: creat d10/d15/fc8 x:0 0 0 2024-04-21T23:57:41.917 INFO:tasks.workunit.client.0.smithi110.stdout:0/547: chown d0/l8 207 1 2024-04-21T23:57:41.929 INFO:tasks.workunit.client.0.smithi110.stdout:1/505: fsync d1/d1d/f68 0 2024-04-21T23:57:42.430 INFO:tasks.workunit.client.0.smithi110.stdout:3/526: dread - d6/d12/d16/d5d/fa5 zero size 2024-04-21T23:57:42.486 INFO:tasks.workunit.client.0.smithi110.stdout:3/527: write d6/d12/d16/f5e [1725072,29729] 0 2024-04-21T23:57:42.635 INFO:tasks.workunit.client.0.smithi110.stdout:9/545: rename d1/d29/d2a/dc/d30 to d1/d29/d6f/db4 0 2024-04-21T23:57:42.957 INFO:tasks.workunit.client.0.smithi110.stdout:7/557: mkdir d10/d45/d51/db1/dc9 0 2024-04-21T23:57:42.961 INFO:tasks.workunit.client.0.smithi110.stdout:4/482: write d1/d11/d20/d23/d1c/d40/f73 [2159652,29605] 0 2024-04-21T23:57:43.094 INFO:tasks.workunit.client.0.smithi110.stdout:2/571: dread - d9/d1a/d1d/d4a/d6b/d3a/f61 zero size 2024-04-21T23:57:43.277 INFO:tasks.workunit.client.0.smithi110.stdout:4/483: sync 2024-04-21T23:57:43.309 INFO:tasks.workunit.client.0.smithi110.stdout:5/541: getdents d7/d24/d3a/d40 0 2024-04-21T23:57:43.326 INFO:tasks.workunit.client.0.smithi110.stdout:4/484: chown d1/d11/d20/d50 3901 1 2024-04-21T23:57:43.494 INFO:tasks.workunit.client.0.smithi110.stdout:3/528: symlink d6/d12/d16/d30/d9c/laf 0 2024-04-21T23:57:43.768 INFO:tasks.workunit.client.0.smithi110.stdout:3/529: dread d6/f3a [4194304,4194304] 0 2024-04-21T23:57:43.808 INFO:tasks.workunit.client.0.smithi110.stdout:6/537: rename d16/d3d/d40/d46/d5f to d16/d1e/d24/d90/dac 0 2024-04-21T23:57:44.146 INFO:tasks.workunit.client.0.smithi110.stdout:8/590: dwrite d5/d4f/d79/fb4 [0,4194304] 0 2024-04-21T23:57:44.307 INFO:tasks.workunit.client.0.smithi110.stdout:2/572: mknod d9/d1a/d1d/d4e/cbc 0 2024-04-21T23:57:44.385 INFO:tasks.workunit.client.0.smithi110.stdout:1/506: truncate d1/d1d/d57/f62 14754 0 2024-04-21T23:57:44.415 INFO:tasks.workunit.client.0.smithi110.stdout:1/507: read d1/d2/d30/f47 [526187,15718] 0 2024-04-21T23:57:44.992 INFO:tasks.workunit.client.0.smithi110.stdout:6/538: creat d16/d1d/d38/d48/d5e/d62/fad x:0 0 0 2024-04-21T23:57:45.458 INFO:tasks.workunit.client.0.smithi110.stdout:8/591: creat d5/d74/fd3 x:0 0 0 2024-04-21T23:57:45.486 INFO:tasks.workunit.client.0.smithi110.stdout:2/573: read d9/d25/d1c/f28 [1388790,93628] 0 2024-04-21T23:57:45.535 INFO:tasks.workunit.client.0.smithi110.stdout:8/592: readlink d5/da/d17/d60/l67 0 2024-04-21T23:57:45.549 INFO:tasks.workunit.client.0.smithi110.stdout:2/574: stat d9/d1a/d1d/d4a/d6b 0 2024-04-21T23:57:45.631 INFO:tasks.workunit.client.0.smithi110.stdout:8/593: dread d5/da/d17/f5d [0,4194304] 0 2024-04-21T23:57:46.324 INFO:tasks.workunit.client.0.smithi110.stdout:6/539: dread f3 [4194304,4194304] 0 2024-04-21T23:57:46.424 INFO:tasks.workunit.client.0.smithi110.stdout:4/485: link d1/d11/d20/d23/d1c/d47/d4f/f92 d1/d11/d20/d58/d93/d7c/fa6 0 2024-04-21T23:57:46.513 INFO:tasks.workunit.client.0.smithi110.stdout:3/530: mknod d6/d12/da1/cb0 0 2024-04-21T23:57:46.634 INFO:tasks.workunit.client.0.smithi110.stdout:4/486: sync 2024-04-21T23:57:46.863 INFO:tasks.workunit.client.0.smithi110.stdout:1/508: link d1/d1d/d4a/c46 d1/d2/d30/d9c/cab 0 2024-04-21T23:57:46.874 INFO:tasks.workunit.client.0.smithi110.stdout:0/548: unlink d0/f19 0 2024-04-21T23:57:46.893 INFO:tasks.workunit.client.0.smithi110.stdout:2/575: mknod d9/d1a/d1d/cbd 0 2024-04-21T23:57:46.908 INFO:tasks.workunit.client.0.smithi110.stdout:9/546: write d1/d29/d2a/d2b/f8d [3980106,109965] 0 2024-04-21T23:57:46.973 INFO:tasks.workunit.client.0.smithi110.stdout:8/594: mkdir d5/da/d88/dd4 0 2024-04-21T23:57:47.110 INFO:tasks.workunit.client.0.smithi110.stdout:8/595: chown d5/d6f 1062927116 1 2024-04-21T23:57:47.125 INFO:tasks.workunit.client.0.smithi110.stdout:6/540: chown d16/d1e/d24/d33/faa 14 1 2024-04-21T23:57:47.205 INFO:tasks.workunit.client.0.smithi110.stdout:9/547: dread - d1/d29/d2a/d6/d1d/f84 zero size 2024-04-21T23:57:47.357 INFO:tasks.workunit.client.0.smithi110.stdout:2/576: rename d9/d1a/d1d/d4a/d6b to d9/d1a/d1d/d4a/d6b/d3a/dbe 22 2024-04-21T23:57:47.427 INFO:tasks.workunit.client.0.smithi110.stdout:7/558: dwrite d10/d45/d51/f85 [0,4194304] 0 2024-04-21T23:57:47.558 INFO:tasks.workunit.client.0.smithi110.stdout:1/509: stat d1/d2/d14/f9d 0 2024-04-21T23:57:47.719 INFO:tasks.workunit.client.0.smithi110.stdout:0/549: mknod d0/d16/d42/d50/d83/cc4 0 2024-04-21T23:57:47.855 INFO:tasks.workunit.client.0.smithi110.stdout:5/542: write f5 [2258089,88625] 0 2024-04-21T23:57:48.163 INFO:tasks.workunit.client.0.smithi110.stdout:8/596: creat d5/d24/d33/d3d/d5c/d6a/fd5 x:0 0 0 2024-04-21T23:57:48.407 INFO:tasks.workunit.client.0.smithi110.stdout:2/577: mknod d9/d1a/d1d/d2b/d54/cbf 0 2024-04-21T23:57:48.503 INFO:tasks.workunit.client.0.smithi110.stdout:1/510: mknod d1/d1d/d57/cac 0 2024-04-21T23:57:48.618 INFO:tasks.workunit.client.0.smithi110.stdout:0/550: fdatasync d0/d27/d4b/f64 0 2024-04-21T23:57:48.662 INFO:tasks.workunit.client.0.smithi110.stdout:0/551: read d0/d27/d4b/f64 [314779,114838] 0 2024-04-21T23:57:48.769 INFO:tasks.workunit.client.0.smithi110.stdout:6/541: mkdir d16/d1d/d38/dae 0 2024-04-21T23:57:48.931 INFO:tasks.workunit.client.0.smithi110.stdout:5/543: fdatasync d7/d9/d17/f51 0 2024-04-21T23:57:49.472 INFO:tasks.workunit.client.0.smithi110.stdout:2/578: mkdir d9/d1a/d1d/d4e/dc0 0 2024-04-21T23:57:50.035 INFO:tasks.workunit.client.0.smithi110.stdout:0/552: dread - d0/d27/d4b/da0/fb2 zero size 2024-04-21T23:57:50.137 INFO:tasks.workunit.client.0.smithi110.stdout:6/542: fdatasync fe 0 2024-04-21T23:57:50.171 INFO:tasks.workunit.client.0.smithi110.stdout:6/543: stat d16/d3d/d40/l49 0 2024-04-21T23:57:50.353 INFO:tasks.workunit.client.0.smithi110.stdout:9/548: creat d1/d19/fb5 x:0 0 0 2024-04-21T23:57:50.577 INFO:tasks.workunit.client.0.smithi110.stdout:4/487: link d1/cb d1/d11/d20/d23/d1c/d47/d4f/ca7 0 2024-04-21T23:57:50.797 INFO:tasks.workunit.client.0.smithi110.stdout:8/597: rename d5/f31 to d5/d4f/d79/dd1/fd6 0 2024-04-21T23:57:51.008 INFO:tasks.workunit.client.0.smithi110.stdout:7/559: link d10/d15/f25 d10/d45/d60/dbb/fca 0 2024-04-21T23:57:51.158 INFO:tasks.workunit.client.0.smithi110.stdout:3/531: dwrite d6/d12/d14/d4b/f5f [0,4194304] 0 2024-04-21T23:57:51.259 INFO:tasks.workunit.client.0.smithi110.stdout:0/553: truncate d0/d16/d42/d50/d83/fbf 3645 0 2024-04-21T23:57:51.781 INFO:tasks.workunit.client.0.smithi110.stdout:4/488: rmdir d1/d11/d12/d26/d5f 39 2024-04-21T23:57:51.808 INFO:tasks.workunit.client.0.smithi110.stdout:4/489: chown d1/d35/c32 1029822410 1 2024-04-21T23:57:51.985 INFO:tasks.workunit.client.0.smithi110.stdout:8/598: creat d5/da/dac/fd7 x:0 0 0 2024-04-21T23:57:52.598 INFO:tasks.workunit.client.0.smithi110.stdout:0/554: dread d0/d16/d42/d50/d83/fa2 [0,4194304] 0 2024-04-21T23:57:53.117 INFO:tasks.workunit.client.0.smithi110.stdout:5/544: link d7/d9/d17/f8c d7/d35/f96 0 2024-04-21T23:57:53.380 INFO:tasks.workunit.client.0.smithi110.stdout:7/560: truncate d10/d45/d51/d88/d39/f4e 3738358 0 2024-04-21T23:57:53.695 INFO:tasks.workunit.client.0.smithi110.stdout:0/555: mkdir d0/d16/d5d/dc5 0 2024-04-21T23:57:53.748 INFO:tasks.workunit.client.0.smithi110.stdout:1/511: dwrite d1/d1d/d57/f81 [0,4194304] 0 2024-04-21T23:57:53.856 INFO:tasks.workunit.client.0.smithi110.stdout:9/549: link d1/d29/d2a/dc/c36 d1/d29/d2a/d2b/d58/d7b/cb6 0 2024-04-21T23:57:53.934 INFO:tasks.workunit.client.0.smithi110.stdout:5/545: stat d7/d24/d49/d64/f70 0 2024-04-21T23:57:54.000 INFO:tasks.workunit.client.0.smithi110.stdout:5/546: dread d7/d24/d49/d64/f70 [0,4194304] 0 2024-04-21T23:57:54.026 INFO:tasks.workunit.client.0.smithi110.stdout:5/547: readlink d7/d9/d17/l59 0 2024-04-21T23:57:54.074 INFO:tasks.workunit.client.0.smithi110.stdout:7/561: dread - d10/d45/d51/d88/d46/d69/d75/fb7 zero size 2024-04-21T23:57:54.160 INFO:tasks.workunit.client.0.smithi110.stdout:0/556: sync 2024-04-21T23:57:54.625 INFO:tasks.workunit.client.0.smithi110.stdout:2/579: dwrite f1 [0,4194304] 0 2024-04-21T23:57:54.988 INFO:tasks.workunit.client.0.smithi110.stdout:4/490: creat d1/d11/d12/d26/fa8 x:0 0 0 2024-04-21T23:57:55.098 INFO:tasks.workunit.client.0.smithi110.stdout:5/548: fsync d7/d9/d17/f51 0 2024-04-21T23:57:55.210 INFO:tasks.workunit.client.0.smithi110.stdout:7/562: dread - d10/d45/d51/d88/d39/fc6 zero size 2024-04-21T23:57:55.487 INFO:tasks.workunit.client.0.smithi110.stdout:0/557: rename d0/d25/d5a/l75 to d0/d2a/lc6 0 2024-04-21T23:57:55.597 INFO:tasks.workunit.client.0.smithi110.stdout:8/599: fdatasync d5/d4f/d79/dd1/fd6 0 2024-04-21T23:57:55.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/532: write d6/d12/d16/d5d/f7d [787038,116655] 0 2024-04-21T23:57:55.893 INFO:tasks.workunit.client.0.smithi110.stdout:2/580: mkdir d9/d1a/d7b/dab/dc1 0 2024-04-21T23:57:56.073 INFO:tasks.workunit.client.0.smithi110.stdout:4/491: creat d1/d11/d20/d23/d1c/d40/fa9 x:0 0 0 2024-04-21T23:57:56.254 INFO:tasks.workunit.client.0.smithi110.stdout:6/544: dwrite d16/d1d/d38/f98 [0,4194304] 0 2024-04-21T23:57:56.352 INFO:tasks.workunit.client.0.smithi110.stdout:5/549: mknod d7/d22/d5b/d6f/c97 0 2024-04-21T23:57:56.439 INFO:tasks.workunit.client.0.smithi110.stdout:6/545: chown d16/d1d/d38/d48/d5e/d6a/d70/la5 798638 1 2024-04-21T23:57:56.819 INFO:tasks.workunit.client.0.smithi110.stdout:0/558: dread d0/fc [0,4194304] 0 2024-04-21T23:57:56.898 INFO:tasks.workunit.client.0.smithi110.stdout:3/533: readlink d6/l41 0 2024-04-21T23:57:57.186 INFO:tasks.workunit.client.0.smithi110.stdout:9/550: link d1/d29/d2a/c21 d1/d29/d2a/d3c/cb7 0 2024-04-21T23:57:57.280 INFO:tasks.workunit.client.0.smithi110.stdout:2/581: fsync d9/d1a/d1d/f75 0 2024-04-21T23:57:57.411 INFO:tasks.workunit.client.0.smithi110.stdout:4/492: mknod d1/d11/d20/d58/d7e/caa 0 2024-04-21T23:57:57.715 INFO:tasks.workunit.client.0.smithi110.stdout:7/563: unlink d10/d45/d51/d58/f72 0 2024-04-21T23:57:58.110 INFO:tasks.workunit.client.0.smithi110.stdout:0/559: dread d0/d27/f4a [0,4194304] 0 2024-04-21T23:57:59.310 INFO:tasks.workunit.client.0.smithi110.stdout:3/534: truncate d6/d12/d16/f77 436219 0 2024-04-21T23:57:59.781 INFO:tasks.workunit.client.0.smithi110.stdout:2/582: mknod d9/d25/d1b/d45/d8e/cc2 0 2024-04-21T23:57:59.801 INFO:tasks.workunit.client.0.smithi110.stdout:1/512: write d1/f7a [40796,45277] 0 2024-04-21T23:57:59.807 INFO:tasks.workunit.client.0.smithi110.stdout:7/564: rename d10/d45/d60/d5e/d65/f7a to d10/d45/d60/d5e/d65/d8a/fcb 0 2024-04-21T23:57:59.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:57:59.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:57:59.872 INFO:tasks.workunit.client.0.smithi110.stdout:7/565: stat d10/d15 0 2024-04-21T23:57:59.942 INFO:tasks.workunit.client.0.smithi110.stdout:3/535: readlink d6/d12/d14/d32/la3 0 2024-04-21T23:57:59.966 INFO:tasks.workunit.client.0.smithi110.stdout:7/566: dread - d10/d45/d51/d88/d39/fc6 zero size 2024-04-21T23:58:00.225 INFO:tasks.workunit.client.0.smithi110.stdout:2/583: rmdir d9/d25/d1c/da0 39 2024-04-21T23:58:00.316 INFO:tasks.workunit.client.0.smithi110.stdout:1/513: unlink d1/dd/d23/f24 0 2024-04-21T23:58:00.483 INFO:tasks.workunit.client.0.smithi110.stdout:7/567: symlink d10/d45/d60/d5e/lcc 0 2024-04-21T23:58:00.776 INFO:tasks.workunit.client.0.smithi110.stdout:2/584: rename d9/d1a/d1d/f36 to d9/d1a/d7b/fc3 0 2024-04-21T23:58:00.800 INFO:tasks.workunit.client.0.smithi110.stdout:8/600: write d5/da/d17/d6c/d72/d73/d78/d8c/fce [528317,94957] 0 2024-04-21T23:58:00.878 INFO:tasks.workunit.client.0.smithi110.stdout:1/514: symlink d1/dd/d23/d48/d4e/lad 0 2024-04-21T23:58:00.955 INFO:tasks.workunit.client.0.smithi110.stdout:1/515: read d1/d2/d1b/d10/f4d [641212,22551] 0 2024-04-21T23:58:01.047 INFO:tasks.workunit.client.0.smithi110.stdout:7/568: creat d10/d45/d51/db1/fcd x:0 0 0 2024-04-21T23:58:01.427 INFO:tasks.workunit.client.0.smithi110.stdout:5/550: write d7/d24/d31/f81 [273463,43947] 0 2024-04-21T23:58:01.661 INFO:tasks.workunit.client.0.smithi110.stdout:8/601: rename d5/d24/c4c to d5/d24/d33/d84/cd8 0 2024-04-21T23:58:02.074 INFO:tasks.workunit.client.0.smithi110.stdout:6/546: dwrite d16/d3d/f81 [0,4194304] 0 2024-04-21T23:58:02.267 INFO:tasks.workunit.client.0.smithi110.stdout:3/536: link d6/d12/d3c/c98 d6/d78/cb1 0 2024-04-21T23:58:02.406 INFO:tasks.workunit.client.0.smithi110.stdout:5/551: dread d7/d35/f4c [0,4194304] 0 2024-04-21T23:58:02.557 INFO:tasks.workunit.client.0.smithi110.stdout:8/602: read d5/da/d17/d6c/d72/d73/d78/d8c/f83 [1213864,89860] 0 2024-04-21T23:58:02.738 INFO:tasks.workunit.client.0.smithi110.stdout:4/493: write d1/d11/d20/d23/fa1 [616095,80796] 0 2024-04-21T23:58:02.773 INFO:tasks.workunit.client.0.smithi110.stdout:9/551: dwrite d1/d29/d6f/f83 [0,4194304] 0 2024-04-21T23:58:03.188 INFO:tasks.workunit.client.0.smithi110.stdout:3/537: dread d6/d12/d16/d30/f35 [0,4194304] 0 2024-04-21T23:58:03.199 INFO:tasks.workunit.client.0.smithi110.stdout:0/560: write d0/d27/d4b/f54 [2894925,34618] 0 2024-04-21T23:58:03.596 INFO:tasks.workunit.client.0.smithi110.stdout:2/585: link d9/d1a/d1d/d2b/l2e d9/d1a/d1d/d7a/d91/lc4 0 2024-04-21T23:58:03.777 INFO:tasks.workunit.client.0.smithi110.stdout:8/603: creat d5/d24/d33/d3d/d82/fd9 x:0 0 0 2024-04-21T23:58:03.853 INFO:tasks.workunit.client.0.smithi110.stdout:4/494: creat d1/d35/fab x:0 0 0 2024-04-21T23:58:04.147 INFO:tasks.workunit.client.0.smithi110.stdout:6/547: mknod d16/d1e/da8/caf 0 2024-04-21T23:58:04.487 INFO:tasks.workunit.client.0.smithi110.stdout:1/516: getdents d1/d2 0 2024-04-21T23:58:04.713 INFO:tasks.workunit.client.0.smithi110.stdout:0/561: truncate d0/d56/f84 262164 0 2024-04-21T23:58:04.816 INFO:tasks.workunit.client.0.smithi110.stdout:2/586: chown d9/d1a/d1d/d7a/d91/dac/fb7 1119128 1 2024-04-21T23:58:05.038 INFO:tasks.workunit.client.0.smithi110.stdout:8/604: mknod d5/da/d17/d6c/d72/d73/d78/d8c/cda 0 2024-04-21T23:58:05.044 INFO:tasks.workunit.client.0.smithi110.stdout:7/569: write f9 [2348924,61786] 0 2024-04-21T23:58:05.129 INFO:tasks.workunit.client.0.smithi110.stdout:7/570: dread - d10/d45/d51/db1/fcd zero size 2024-04-21T23:58:05.341 INFO:tasks.workunit.client.0.smithi110.stdout:9/552: mkdir d1/d29/d4d/dac/db8 0 2024-04-21T23:58:05.470 INFO:tasks.workunit.client.0.smithi110.stdout:1/517: rmdir d1/d2/d30 39 2024-04-21T23:58:05.575 INFO:tasks.workunit.client.0.smithi110.stdout:5/552: creat d7/f98 x:0 0 0 2024-04-21T23:58:05.661 INFO:tasks.workunit.client.0.smithi110.stdout:3/538: truncate d6/d12/f2f 4735664 0 2024-04-21T23:58:05.884 INFO:tasks.workunit.client.0.smithi110.stdout:0/562: readlink d0/d2a/lc6 0 2024-04-21T23:58:06.014 INFO:tasks.workunit.client.0.smithi110.stdout:2/587: dread d9/d1a/d1d/fa9 [0,4194304] 0 2024-04-21T23:58:06.278 INFO:tasks.workunit.client.0.smithi110.stdout:8/605: symlink d5/da/d17/d6c/ldb 0 2024-04-21T23:58:06.321 INFO:tasks.workunit.client.0.smithi110.stdout:6/548: creat d16/d1d/d38/dae/fb0 x:0 0 0 2024-04-21T23:58:06.454 INFO:tasks.workunit.client.0.smithi110.stdout:8/606: dread d5/f1d [0,4194304] 0 2024-04-21T23:58:06.539 INFO:tasks.workunit.client.0.smithi110.stdout:6/549: truncate d16/d1d/d38/dae/fb0 855522 0 2024-04-21T23:58:06.565 INFO:tasks.workunit.client.0.smithi110.stdout:8/607: chown d5/da/d17/d6c/d7d/c61 3 1 2024-04-21T23:58:06.667 INFO:tasks.workunit.client.0.smithi110.stdout:5/553: dread d7/d24/d37/f5f [0,4194304] 0 2024-04-21T23:58:06.911 INFO:tasks.workunit.client.0.smithi110.stdout:3/539: truncate d6/d12/d16/d6f/f8e 187320 0 2024-04-21T23:58:07.254 INFO:tasks.workunit.client.0.smithi110.stdout:3/540: sync 2024-04-21T23:58:07.275 INFO:tasks.workunit.client.0.smithi110.stdout:3/541: stat d6/d12/d3c/d8d/l9e 0 2024-04-21T23:58:07.455 INFO:tasks.workunit.client.0.smithi110.stdout:6/550: rmdir d16/d1d 39 2024-04-21T23:58:07.492 INFO:tasks.workunit.client.0.smithi110.stdout:6/551: chown d16/d1e/d24/d33/l58 44 1 2024-04-21T23:58:08.268 INFO:tasks.workunit.client.0.smithi110.stdout:9/553: write d1/f7 [4594809,39141] 0 2024-04-21T23:58:08.515 INFO:tasks.workunit.client.0.smithi110.stdout:4/495: rename d1/fe to d1/d11/d20/d23/fac 0 2024-04-21T23:58:08.883 INFO:tasks.workunit.client.0.smithi110.stdout:0/563: write d0/d27/f6b [3319268,75520] 0 2024-04-21T23:58:08.941 INFO:tasks.workunit.client.0.smithi110.stdout:0/564: read d0/d25/f79 [3936718,117756] 0 2024-04-21T23:58:09.026 INFO:tasks.workunit.client.0.smithi110.stdout:7/571: write d10/d45/d51/d88/d39/f92 [2868071,121959] 0 2024-04-21T23:58:09.515 INFO:tasks.workunit.client.0.smithi110.stdout:8/608: write d5/d6f/f89 [1058459,22341] 0 2024-04-21T23:58:09.590 INFO:tasks.workunit.client.0.smithi110.stdout:3/542: truncate d6/f45 3080022 0 2024-04-21T23:58:09.621 INFO:tasks.workunit.client.0.smithi110.stdout:3/543: stat d6/d12/d3c/d65/da8 0 2024-04-21T23:58:09.846 INFO:tasks.workunit.client.0.smithi110.stdout:1/518: mkdir d1/d2/d14/d16/dae 0 2024-04-21T23:58:09.904 INFO:tasks.workunit.client.0.smithi110.stdout:5/554: write d7/d9/f33 [5676304,89022] 0 2024-04-21T23:58:09.963 INFO:tasks.workunit.client.0.smithi110.stdout:5/555: write d7/d9/f33 [3286657,2128] 0 2024-04-21T23:58:10.318 INFO:tasks.workunit.client.0.smithi110.stdout:6/552: mkdir d16/d1d/d38/d48/d5e/db1 0 2024-04-21T23:58:10.441 INFO:tasks.workunit.client.0.smithi110.stdout:2/588: write d9/d1a/d1d/d4a/d6b/d3a/f41 [902941,108849] 0 2024-04-21T23:58:10.840 INFO:tasks.workunit.client.0.smithi110.stdout:7/572: dread d10/d15/d22/f79 [0,4194304] 0 2024-04-21T23:58:10.978 INFO:tasks.workunit.client.0.smithi110.stdout:3/544: truncate d6/d12/d16/d6f/fad 811696 0 2024-04-21T23:58:11.013 INFO:tasks.workunit.client.0.smithi110.stdout:8/609: read - d5/d74/fb1 zero size 2024-04-21T23:58:11.064 INFO:tasks.workunit.client.0.smithi110.stdout:0/565: unlink d0/d25/c76 0 2024-04-21T23:58:11.604 INFO:tasks.workunit.client.0.smithi110.stdout:9/554: dwrite d1/d29/d6f/db4/f92 [0,4194304] 0 2024-04-21T23:58:11.768 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:05:52.029 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:11.784 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:05:52.046 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:11.786 INFO:tasks.workunit.client.0.smithi110.stdout:4/496: write d1/d11/d20/d23/d1c/d40/fa9 [1032730,55473] 0 2024-04-21T23:58:11.798 INFO:tasks.workunit.client.0.smithi110.stdout:1/519: dread d1/d2/d1b/d10/d5c/f76 [0,4194304] 0 2024-04-21T23:58:11.830 INFO:tasks.workunit.client.0.smithi110.stdout:4/497: readlink d1/d35/d6b/l6c 0 2024-04-21T23:58:11.831 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:05:52.028 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:11.856 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:05:52.053 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:11.862 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:05:52.058 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:11.863 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:05:52.060 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:11.954 INFO:tasks.workunit.client.0.smithi110.stdout:8/610: fsync d5/da/d17/d6c/d7d/f92 0 2024-04-21T23:58:11.956 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:05:52.218 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:12.028 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:05:52.225 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:12.031 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:05:52.229 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:58:12.069 INFO:tasks.workunit.client.0.smithi110.stdout:4/498: sync 2024-04-21T23:58:12.120 INFO:tasks.workunit.client.0.smithi110.stdout:4/499: write d1/d11/d20/d23/d1c/d40/fa9 [27617,66333] 0 2024-04-21T23:58:12.230 INFO:tasks.workunit.client.0.smithi110.stdout:5/556: creat d7/d24/d49/f99 x:0 0 0 2024-04-21T23:58:12.390 INFO:tasks.workunit.client.0.smithi110.stdout:7/573: mkdir d10/d45/d51/d88/dce 0 2024-04-21T23:58:13.117 INFO:tasks.workunit.client.0.smithi110.stdout:8/611: rename d5/d24/d33/d3d/c77 to d5/d24/d33/d3d/d82/da8/cdc 0 2024-04-21T23:58:13.120 INFO:tasks.workunit.client.0.smithi110.stdout:0/566: rmdir d0/d2a 39 2024-04-21T23:58:13.167 INFO:tasks.workunit.client.0.smithi110.stdout:8/612: chown d5/d6f/f70 342366 1 2024-04-21T23:58:13.369 INFO:tasks.workunit.client.0.smithi110.stdout:4/500: mknod d1/d11/d20/d58/cad 0 2024-04-21T23:58:13.757 INFO:tasks.workunit.client.0.smithi110.stdout:6/553: write d16/d1d/d38/f98 [429285,75177] 0 2024-04-21T23:58:13.843 INFO:tasks.workunit.client.0.smithi110.stdout:6/554: dread d16/d3d/d40/f9c [0,4194304] 0 2024-04-21T23:58:13.862 INFO:tasks.workunit.client.0.smithi110.stdout:3/545: link d6/d12/d14/cac d6/d12/d16/d6f/d7a/cb2 0 2024-04-21T23:58:13.962 INFO:tasks.workunit.client.0.smithi110.stdout:0/567: creat d0/d25/d5a/fc7 x:0 0 0 2024-04-21T23:58:14.069 INFO:tasks.workunit.client.0.smithi110.stdout:8/613: symlink d5/da/d17/d6c/d72/d73/ldd 0 2024-04-21T23:58:14.088 INFO:tasks.workunit.client.0.smithi110.stdout:8/614: dread - d5/d74/faf zero size 2024-04-21T23:58:14.400 INFO:tasks.workunit.client.0.smithi110.stdout:3/546: creat d6/d78/fb3 x:0 0 0 2024-04-21T23:58:14.442 INFO:tasks.workunit.client.0.smithi110.stdout:6/555: truncate d16/d3d/f2d 1475347 0 2024-04-21T23:58:14.488 INFO:tasks.workunit.client.0.smithi110.stdout:6/556: dread - d16/d1d/d38/d48/d5e/d62/f7c zero size 2024-04-21T23:58:14.695 INFO:tasks.workunit.client.0.smithi110.stdout:8/615: rmdir d5/d4f/d79 39 2024-04-21T23:58:14.962 INFO:tasks.workunit.client.0.smithi110.stdout:0/568: mkdir d0/d16/d42/d50/dbc/dc8 0 2024-04-21T23:58:15.130 INFO:tasks.workunit.client.0.smithi110.stdout:2/589: dwrite d9/d1a/d7b/fc3 [0,4194304] 0 2024-04-21T23:58:15.483 INFO:tasks.workunit.client.0.smithi110.stdout:2/590: read d9/d1a/d1d/d4a/d6b/d3a/f41 [828563,71621] 0 2024-04-21T23:58:15.584 INFO:tasks.workunit.client.0.smithi110.stdout:1/520: dwrite d1/f39 [4194304,4194304] 0 2024-04-21T23:58:16.216 INFO:tasks.workunit.client.0.smithi110.stdout:6/557: symlink d16/d1e/d24/d66/lb2 0 2024-04-21T23:58:16.627 INFO:tasks.workunit.client.0.smithi110.stdout:1/521: mknod d1/d2/d14/d65/caf 0 2024-04-21T23:58:16.659 INFO:tasks.workunit.client.0.smithi110.stdout:7/574: write d10/d15/d22/f73 [2840727,79241] 0 2024-04-21T23:58:16.857 INFO:tasks.workunit.client.0.smithi110.stdout:0/569: mkdir d0/d56/dc9 0 2024-04-21T23:58:17.074 INFO:tasks.workunit.client.0.smithi110.stdout:5/557: dwrite d7/d24/d31/f81 [0,4194304] 0 2024-04-21T23:58:17.226 INFO:tasks.workunit.client.0.smithi110.stdout:1/522: creat d1/d1d/d4a/fb0 x:0 0 0 2024-04-21T23:58:17.256 INFO:tasks.workunit.client.0.smithi110.stdout:1/523: readlink d1/dd/d23/l2e 0 2024-04-21T23:58:17.371 INFO:tasks.workunit.client.0.smithi110.stdout:4/501: write d1/fc [5401400,117016] 0 2024-04-21T23:58:17.412 INFO:tasks.workunit.client.0.smithi110.stdout:3/547: write d6/f6a [4422,15634] 0 2024-04-21T23:58:17.856 INFO:tasks.workunit.client.0.smithi110.stdout:1/524: stat d1/d2/d30/d9c 0 2024-04-21T23:58:18.237 INFO:tasks.workunit.client.0.smithi110.stdout:4/502: mkdir d1/d11/d20/d23/d1c/dae 0 2024-04-21T23:58:18.406 INFO:tasks.workunit.client.0.smithi110.stdout:3/548: read d6/d12/d16/d6f/f8e [182860,81935] 0 2024-04-21T23:58:18.979 INFO:tasks.workunit.client.0.smithi110.stdout:7/575: creat d10/d15/d22/fcf x:0 0 0 2024-04-21T23:58:19.112 INFO:tasks.workunit.client.0.smithi110.stdout:4/503: unlink d1/d11/l14 0 2024-04-21T23:58:19.201 INFO:tasks.workunit.client.0.smithi110.stdout:3/549: rename d6/d12/d16/d30/d67/f76 to d6/d12/da1/fb4 0 2024-04-21T23:58:19.380 INFO:tasks.workunit.client.0.smithi110.stdout:1/525: symlink d1/d2/d1b/da7/lb1 0 2024-04-21T23:58:19.536 INFO:tasks.workunit.client.0.smithi110.stdout:8/616: dwrite d5/da/d17/d7c/dc0/f94 [0,4194304] 0 2024-04-21T23:58:20.349 INFO:tasks.workunit.client.0.smithi110.stdout:2/591: dwrite d9/d1a/d1d/d2b/d54/d77/fa6 [0,4194304] 0 2024-04-21T23:58:20.354 INFO:tasks.workunit.client.0.smithi110.stdout:6/558: dwrite f15 [0,4194304] 0 2024-04-21T23:58:20.543 INFO:tasks.workunit.client.0.smithi110.stdout:4/504: truncate d1/d11/d12/d26/f2d 113223 0 2024-04-21T23:58:20.570 INFO:tasks.workunit.client.0.smithi110.stdout:9/555: symlink d1/lb9 0 2024-04-21T23:58:20.762 INFO:tasks.workunit.client.0.smithi110.stdout:9/556: stat d1/d29/l49 0 2024-04-21T23:58:20.976 INFO:tasks.workunit.client.0.smithi110.stdout:0/570: dwrite d0/d14/d23/f24 [0,4194304] 0 2024-04-21T23:58:21.120 INFO:tasks.workunit.client.0.smithi110.stdout:7/576: truncate d10/d15/d22/d2c/fbf 687149 0 2024-04-21T23:58:21.122 INFO:tasks.workunit.client.0.smithi110.stdout:9/557: chown d1/d29/d2a/d2b/f8d 27651813 1 2024-04-21T23:58:21.216 INFO:tasks.workunit.client.0.smithi110.stdout:6/559: read d16/d1d/f25 [949434,6198] 0 2024-04-21T23:58:21.569 INFO:tasks.workunit.client.0.smithi110.stdout:2/592: fsync d9/d1a/d1d/d2b/d5b/f7c 0 2024-04-21T23:58:21.873 INFO:tasks.workunit.client.0.smithi110.stdout:5/558: dwrite d7/d9/f3d [0,4194304] 0 2024-04-21T23:58:22.475 INFO:tasks.workunit.client.0.smithi110.stdout:4/505: truncate d1/d11/f66 268165 0 2024-04-21T23:58:22.578 INFO:tasks.workunit.client.0.smithi110.stdout:6/560: dread d16/d1e/d24/d33/d85/f65 [0,4194304] 0 2024-04-21T23:58:22.859 INFO:tasks.workunit.client.0.smithi110.stdout:6/561: sync 2024-04-21T23:58:23.080 INFO:tasks.workunit.client.0.smithi110.stdout:5/559: truncate d7/d9/f16 1243226 0 2024-04-21T23:58:23.949 INFO:tasks.workunit.client.0.smithi110.stdout:3/550: write d6/d12/d14/d32/f6d [1747216,45427] 0 2024-04-21T23:58:24.034 INFO:tasks.workunit.client.0.smithi110.stdout:6/562: symlink d16/d1d/d38/d48/d5e/lb3 0 2024-04-21T23:58:24.299 INFO:tasks.workunit.client.0.smithi110.stdout:1/526: write d1/d2/d1b/f35 [3178718,117772] 0 2024-04-21T23:58:24.567 INFO:tasks.workunit.client.0.smithi110.stdout:5/560: truncate d7/d24/d49/d61/f8f 351470 0 2024-04-21T23:58:24.577 INFO:tasks.workunit.client.0.smithi110.stdout:8/617: write d5/d24/d33/d3d/d5c/fc7 [548626,115650] 0 2024-04-21T23:58:24.829 INFO:tasks.workunit.client.0.smithi110.stdout:0/571: link d0/f17 d0/d16/d5d/dc5/fca 0 2024-04-21T23:58:24.843 INFO:tasks.workunit.client.0.smithi110.stdout:3/551: mkdir d6/d12/d16/d6f/db5 0 2024-04-21T23:58:25.085 INFO:tasks.workunit.client.0.smithi110.stdout:5/561: dread - d7/d24/d49/f99 zero size 2024-04-21T23:58:25.203 INFO:tasks.workunit.client.0.smithi110.stdout:8/618: truncate d5/fb3 643185 0 2024-04-21T23:58:25.328 INFO:tasks.workunit.client.0.smithi110.stdout:6/563: symlink d16/d1d/d38/d48/d5e/d6a/d70/d86/lb4 0 2024-04-21T23:58:25.487 INFO:tasks.workunit.client.0.smithi110.stdout:3/552: symlink d6/d12/d16/d5d/lb6 0 2024-04-21T23:58:25.717 INFO:tasks.workunit.client.0.smithi110.stdout:1/527: truncate d1/d2/f25 3396633 0 2024-04-21T23:58:25.795 INFO:tasks.workunit.client.0.smithi110.stdout:5/562: dread - d7/d9/d17/d48/d69/f8d zero size 2024-04-21T23:58:25.844 INFO:tasks.workunit.client.0.smithi110.stdout:0/572: dread d0/f2c [0,4194304] 0 2024-04-21T23:58:26.063 INFO:tasks.workunit.client.0.smithi110.stdout:1/528: chown d1/d2/d1b/d10/f12 24258860 1 2024-04-21T23:58:26.140 INFO:tasks.workunit.client.0.smithi110.stdout:9/558: dwrite d1/d29/d2a/d6/d1d/f89 [0,4194304] 0 2024-04-21T23:58:26.317 INFO:tasks.workunit.client.0.smithi110.stdout:3/553: creat d6/d12/d16/d30/fb7 x:0 0 0 2024-04-21T23:58:26.541 INFO:tasks.workunit.client.0.smithi110.stdout:9/559: stat d1/d29/d59/c6e 0 2024-04-21T23:58:26.823 INFO:tasks.workunit.client.0.smithi110.stdout:6/564: creat d16/d1d/d38/d48/d5e/d6a/d70/d74/fb5 x:0 0 0 2024-04-21T23:58:26.920 INFO:tasks.workunit.client.0.smithi110.stdout:5/563: dread d7/d35/f7b [0,4194304] 0 2024-04-21T23:58:27.023 INFO:tasks.workunit.client.0.smithi110.stdout:2/593: dwrite d9/d25/d1b/d45/f80 [0,4194304] 0 2024-04-21T23:58:27.044 INFO:tasks.workunit.client.0.smithi110.stdout:0/573: mknod d0/d27/d4b/d7f/dc1/ccb 0 2024-04-21T23:58:27.140 INFO:tasks.workunit.client.0.smithi110.stdout:1/529: unlink d1/d2/d1b/d10/d5c/f76 0 2024-04-21T23:58:27.210 INFO:tasks.workunit.client.0.smithi110.stdout:3/554: symlink d6/d12/d16/d30/lb8 0 2024-04-21T23:58:27.248 INFO:tasks.workunit.client.0.smithi110.stdout:7/577: dwrite d10/d45/d51/d88/d39/f5b [4194304,4194304] 0 2024-04-21T23:58:27.291 INFO:tasks.workunit.client.0.smithi110.stdout:2/594: sync 2024-04-21T23:58:27.596 INFO:tasks.workunit.client.0.smithi110.stdout:7/578: dread - d10/d45/d51/d88/d39/fc6 zero size 2024-04-21T23:58:27.641 INFO:tasks.workunit.client.0.smithi110.stdout:4/506: dwrite d1/d11/d12/f18 [4194304,4194304] 0 2024-04-21T23:58:27.752 INFO:tasks.workunit.client.0.smithi110.stdout:5/564: creat d7/d24/d3a/d40/f9a x:0 0 0 2024-04-21T23:58:27.803 INFO:tasks.workunit.client.0.smithi110.stdout:9/560: symlink d1/d52/d76/lba 0 2024-04-21T23:58:27.822 INFO:tasks.workunit.client.0.smithi110.stdout:6/565: mkdir d16/d1d/d38/d48/d5e/d6a/db6 0 2024-04-21T23:58:27.868 INFO:tasks.workunit.client.0.smithi110.stdout:0/574: creat d0/d16/d42/d50/dbc/fcc x:0 0 0 2024-04-21T23:58:27.904 INFO:tasks.workunit.client.0.smithi110.stdout:1/530: creat d1/dd/d23/d48/d4e/fb2 x:0 0 0 2024-04-21T23:58:28.471 INFO:tasks.workunit.client.0.smithi110.stdout:3/555: mkdir d6/d12/d16/d6f/db5/db9 0 2024-04-21T23:58:28.596 INFO:tasks.workunit.client.0.smithi110.stdout:3/556: dread d6/d12/d16/d30/d9c/f97 [0,4194304] 0 2024-04-21T23:58:28.693 INFO:tasks.workunit.client.0.smithi110.stdout:4/507: fsync d1/d11/d12/d26/f3f 0 2024-04-21T23:58:29.088 INFO:tasks.workunit.client.0.smithi110.stdout:8/619: write d5/d24/d33/d84/fc2 [816333,117788] 0 2024-04-21T23:58:29.973 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:58:29.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:58:30.077 INFO:tasks.workunit.client.0.smithi110.stdout:4/508: truncate d1/d11/f69 825400 0 2024-04-21T23:58:30.193 INFO:tasks.workunit.client.0.smithi110.stdout:0/575: fsync d0/d16/d42/d50/fb4 0 2024-04-21T23:58:30.465 INFO:tasks.workunit.client.0.smithi110.stdout:8/620: symlink d5/da/d17/d6c/d95/lde 0 2024-04-21T23:58:31.125 INFO:tasks.workunit.client.0.smithi110.stdout:3/557: rename d6/l4f to d6/d12/d16/d6f/lba 0 2024-04-21T23:58:31.919 INFO:tasks.workunit.client.0.smithi110.stdout:7/579: getdents d10/d45/d60/d5e/d65/d8a 0 2024-04-21T23:58:32.001 INFO:tasks.workunit.client.0.smithi110.stdout:2/595: dwrite d9/d1a/d1d/d2b/f9b [0,4194304] 0 2024-04-21T23:58:32.175 INFO:tasks.workunit.client.0.smithi110.stdout:2/596: readlink d9/d1a/d1d/d4a/l6f 0 2024-04-21T23:58:32.399 INFO:tasks.workunit.client.0.smithi110.stdout:8/621: unlink d5/da/f35 0 2024-04-21T23:58:32.734 INFO:tasks.workunit.client.0.smithi110.stdout:4/509: unlink d1/l71 0 2024-04-21T23:58:32.822 INFO:tasks.workunit.client.0.smithi110.stdout:1/531: dwrite d1/d2/d1b/f13 [0,4194304] 0 2024-04-21T23:58:32.940 INFO:tasks.workunit.client.0.smithi110.stdout:2/597: truncate d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e 1110434 0 2024-04-21T23:58:32.965 INFO:tasks.workunit.client.0.smithi110.stdout:6/566: write d16/d1e/d24/d33/d85/f65 [4151374,89980] 0 2024-04-21T23:58:33.053 INFO:tasks.workunit.client.0.smithi110.stdout:2/598: stat d9/d25/d1b/d45/d50/d68/da4/fa2 0 2024-04-21T23:58:33.188 INFO:tasks.workunit.client.0.smithi110.stdout:9/561: write d1/d29/d2a/dc/f90 [1283965,20261] 0 2024-04-21T23:58:33.192 INFO:tasks.workunit.client.0.smithi110.stdout:5/565: write d7/d9/d17/d48/d69/d6d/f74 [488726,43908] 0 2024-04-21T23:58:34.307 INFO:tasks.workunit.client.0.smithi110.stdout:0/576: dwrite d0/d27/d4b/f64 [0,4194304] 0 2024-04-21T23:58:34.516 INFO:tasks.workunit.client.0.smithi110.stdout:0/577: chown d0/d14/d23/d3b 0 1 2024-04-21T23:58:34.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/558: dwrite d6/d12/d14/f31 [0,4194304] 0 2024-04-21T23:58:34.749 INFO:tasks.workunit.client.0.smithi110.stdout:0/578: read d0/d27/f4a [554424,16251] 0 2024-04-21T23:58:34.766 INFO:tasks.workunit.client.0.smithi110.stdout:8/622: write d5/da/d17/d60/fc1 [264338,35798] 0 2024-04-21T23:58:34.812 INFO:tasks.workunit.client.0.smithi110.stdout:7/580: write d10/d45/d51/d88/f8e [1099231,74105] 0 2024-04-21T23:58:34.961 INFO:tasks.workunit.client.0.smithi110.stdout:7/581: dread d10/d15/d22/f42 [0,4194304] 0 2024-04-21T23:58:35.114 INFO:tasks.workunit.client.0.smithi110.stdout:9/562: mknod d1/d29/d4d/dac/cbb 0 2024-04-21T23:58:35.142 INFO:tasks.workunit.client.0.smithi110.stdout:9/563: dread - d1/d19/d42/f82 zero size 2024-04-21T23:58:36.123 INFO:tasks.workunit.client.0.smithi110.stdout:8/623: truncate d5/d74/fb1 621470 0 2024-04-21T23:58:36.567 INFO:tasks.workunit.client.0.smithi110.stdout:4/510: creat d1/d35/d6b/faf x:0 0 0 2024-04-21T23:58:36.597 INFO:tasks.workunit.client.0.smithi110.stdout:9/564: dread d1/d29/d6f/f8a [0,4194304] 0 2024-04-21T23:58:36.783 INFO:tasks.workunit.client.0.smithi110.stdout:6/567: creat d16/d1d/d38/fb7 x:0 0 0 2024-04-21T23:58:36.935 INFO:tasks.workunit.client.0.smithi110.stdout:9/565: sync 2024-04-21T23:58:37.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/566: sync 2024-04-21T23:58:37.520 INFO:tasks.workunit.client.0.smithi110.stdout:7/582: fdatasync d10/d45/fa6 0 2024-04-21T23:58:37.533 INFO:tasks.workunit.client.0.smithi110.stdout:1/532: dwrite d1/d2/d14/d16/f50 [0,4194304] 0 2024-04-21T23:58:37.618 INFO:tasks.workunit.client.0.smithi110.stdout:1/533: sync 2024-04-21T23:58:37.804 INFO:tasks.workunit.client.0.smithi110.stdout:4/511: unlink d1/f39 0 2024-04-21T23:58:37.963 INFO:tasks.workunit.client.0.smithi110.stdout:5/566: rename d7/c4f to d7/d24/d37/d38/c9b 0 2024-04-21T23:58:38.030 INFO:tasks.workunit.client.0.smithi110.stdout:3/559: rmdir d6/d12/d3c/d65/da2 0 2024-04-21T23:58:38.074 INFO:tasks.workunit.client.0.smithi110.stdout:0/579: write d0/fc [2741025,88575] 0 2024-04-21T23:58:38.289 INFO:tasks.workunit.client.0.smithi110.stdout:9/567: dread d1/d29/d4d/f8e [0,4194304] 0 2024-04-21T23:58:38.607 INFO:tasks.workunit.client.0.smithi110.stdout:4/512: fsync d1/d35/d6b/faf 0 2024-04-21T23:58:38.613 INFO:tasks.workunit.client.0.smithi110.stdout:7/583: creat d10/d45/d60/d5e/d65/da3/fd0 x:0 0 0 2024-04-21T23:58:38.997 INFO:tasks.workunit.client.0.smithi110.stdout:5/567: symlink d7/d9/d17/d48/d69/l9c 0 2024-04-21T23:58:39.142 INFO:tasks.workunit.client.0.smithi110.stdout:0/580: mkdir d0/d27/dcd 0 2024-04-21T23:58:39.179 INFO:tasks.workunit.client.0.smithi110.stdout:0/581: dread - d0/d16/d42/d50/f94 zero size 2024-04-21T23:58:39.279 INFO:tasks.workunit.client.0.smithi110.stdout:3/560: truncate d6/d78/fb3 22810 0 2024-04-21T23:58:39.299 INFO:tasks.workunit.client.0.smithi110.stdout:3/561: chown d6/d12/d16/d5d 7 1 2024-04-21T23:58:40.289 INFO:tasks.workunit.client.0.smithi110.stdout:6/568: write d16/d1d/d38/d48/d5e/d6a/d70/d74/fb5 [70193,24893] 0 2024-04-21T23:58:40.294 INFO:tasks.workunit.client.0.smithi110.stdout:4/513: creat d1/d11/d20/d50/fb0 x:0 0 0 2024-04-21T23:58:40.375 INFO:tasks.workunit.client.0.smithi110.stdout:4/514: chown d1/fc 68987574 1 2024-04-21T23:58:40.616 INFO:tasks.workunit.client.0.smithi110.stdout:8/624: getdents d5/da/d17/d7c 0 2024-04-21T23:58:40.643 INFO:tasks.workunit.client.0.smithi110.stdout:1/534: write d1/f89 [382228,102114] 0 2024-04-21T23:58:40.704 INFO:tasks.workunit.client.0.smithi110.stdout:3/562: mknod d6/d12/d16/d6f/db5/cbb 0 2024-04-21T23:58:42.272 INFO:tasks.workunit.client.0.smithi110.stdout:1/535: unlink d1/d1d/d4a/f79 0 2024-04-21T23:58:42.288 INFO:tasks.workunit.client.0.smithi110.stdout:8/625: mknod d5/da/d17/d6c/d72/cdf 0 2024-04-21T23:58:42.686 INFO:tasks.workunit.client.0.smithi110.stdout:0/582: link d0/d27/d4b/d7f/c86 d0/d16/d5d/dc5/cce 0 2024-04-21T23:58:43.264 INFO:tasks.workunit.client.0.smithi110.stdout:6/569: write d16/d1d/f25 [607207,125289] 0 2024-04-21T23:58:43.483 INFO:tasks.workunit.client.0.smithi110.stdout:9/568: getdents d1/d29 0 2024-04-21T23:58:43.531 INFO:tasks.workunit.client.0.smithi110.stdout:7/584: link d10/d15/d22/c41 d10/cd1 0 2024-04-21T23:58:43.658 INFO:tasks.workunit.client.0.smithi110.stdout:5/568: dwrite d7/d24/d49/d61/f75 [0,4194304] 0 2024-04-21T23:58:43.810 INFO:tasks.workunit.client.0.smithi110.stdout:0/583: fsync d0/d27/d4b/f64 0 2024-04-21T23:58:43.928 INFO:tasks.workunit.client.0.smithi110.stdout:3/563: truncate d6/d12/d16/f77 385671 0 2024-04-21T23:58:43.975 INFO:tasks.workunit.client.0.smithi110.stdout:4/515: dwrite d1/d11/d20/d23/d1c/d40/f63 [0,4194304] 0 2024-04-21T23:58:44.435 INFO:tasks.workunit.client.0.smithi110.stdout:2/599: rename d9/d25/d1b/d45/d4d/f64 to d9/fc5 0 2024-04-21T23:58:44.601 INFO:tasks.workunit.client.0.smithi110.stdout:6/570: symlink d16/d1d/d38/d48/lb8 0 2024-04-21T23:58:44.626 INFO:tasks.workunit.client.0.smithi110.stdout:8/626: write d5/f38 [1109441,11703] 0 2024-04-21T23:58:45.061 INFO:tasks.workunit.client.0.smithi110.stdout:1/536: dwrite d1/d1d/f9e [0,4194304] 0 2024-04-21T23:58:45.168 INFO:tasks.workunit.client.0.smithi110.stdout:7/585: creat d10/d45/d51/fd2 x:0 0 0 2024-04-21T23:58:45.448 INFO:tasks.workunit.client.0.smithi110.stdout:9/569: creat d1/d29/d2a/d2b/d58/da8/fbc x:0 0 0 2024-04-21T23:58:45.512 INFO:tasks.workunit.client.0.smithi110.stdout:9/570: chown d1/d29/d2a/d6/fa9 1539818 1 2024-04-21T23:58:45.673 INFO:tasks.workunit.client.0.smithi110.stdout:4/516: rmdir d1/d11/d20/d58/d93 39 2024-04-21T23:58:45.986 INFO:tasks.workunit.client.0.smithi110.stdout:2/600: creat d9/d25/d1b/d45/d50/d68/fc6 x:0 0 0 2024-04-21T23:58:46.427 INFO:tasks.workunit.client.0.smithi110.stdout:8/627: truncate d5/da/d17/d6c/d72/d73/d78/d8c/fce 977423 0 2024-04-21T23:58:46.551 INFO:tasks.workunit.client.0.smithi110.stdout:1/537: dread d1/d2/d30/f98 [0,4194304] 0 2024-04-21T23:58:46.783 INFO:tasks.workunit.client.0.smithi110.stdout:7/586: unlink d10/d45/d51/d88/d46/faa 0 2024-04-21T23:58:46.849 INFO:tasks.workunit.client.0.smithi110.stdout:3/564: truncate d6/d78/fb3 576466 0 2024-04-21T23:58:46.869 INFO:tasks.workunit.client.0.smithi110.stdout:3/565: chown d6/d12/da1 30 1 2024-04-21T23:58:46.944 INFO:tasks.workunit.client.0.smithi110.stdout:9/571: read d1/d19/f16 [185988,93420] 0 2024-04-21T23:58:47.243 INFO:tasks.workunit.client.0.smithi110.stdout:0/584: rename d0/d56/f84 to d0/d16/d42/d50/d83/fcf 0 2024-04-21T23:58:47.874 INFO:tasks.workunit.client.0.smithi110.stdout:8/628: dread - d5/d74/fcb zero size 2024-04-21T23:58:48.921 INFO:tasks.workunit.client.0.smithi110.stdout:8/629: fsync d5/da/dac/dc6/fcd 0 2024-04-21T23:58:49.882 INFO:tasks.workunit.client.0.smithi110.stdout:6/571: dwrite d16/d3d/d40/d46/f6d [0,4194304] 0 2024-04-21T23:58:50.002 INFO:tasks.workunit.client.0.smithi110.stdout:1/538: link d1/d2/d14/d16/d29/f32 d1/dd/fb3 0 2024-04-21T23:58:50.007 INFO:tasks.workunit.client.0.smithi110.stdout:8/630: fdatasync d5/d24/d33/d3d/f64 0 2024-04-21T23:58:50.139 INFO:tasks.workunit.client.0.smithi110.stdout:7/587: symlink d10/d45/d60/d5e/d65/ld3 0 2024-04-21T23:58:50.736 INFO:tasks.workunit.client.0.smithi110.stdout:5/569: write d7/d24/d37/d38/d88/f8b [773447,123314] 0 2024-04-21T23:58:51.490 INFO:tasks.workunit.client.0.smithi110.stdout:2/601: dwrite d9/d25/d1c/f28 [0,4194304] 0 2024-04-21T23:58:51.938 INFO:tasks.workunit.client.0.smithi110.stdout:0/585: write d0/d16/d42/fbd [479208,121575] 0 2024-04-21T23:58:51.990 INFO:tasks.workunit.client.0.smithi110.stdout:9/572: dwrite d1/d29/d4d/f8e [0,4194304] 0 2024-04-21T23:58:52.172 INFO:tasks.workunit.client.0.smithi110.stdout:1/539: rename d1/d2/d14/d16/d27/c6a to d1/d1d/cb4 0 2024-04-21T23:58:52.406 INFO:tasks.workunit.client.0.smithi110.stdout:4/517: dwrite d1/d11/d12/d26/f2d [0,4194304] 0 2024-04-21T23:58:52.543 INFO:tasks.workunit.client.0.smithi110.stdout:3/566: write d6/d12/d50/f6c [793545,18201] 0 2024-04-21T23:58:52.596 INFO:tasks.workunit.client.0.smithi110.stdout:4/518: stat d1/d11/d20/d50/fa3 0 2024-04-21T23:58:52.893 INFO:tasks.workunit.client.0.smithi110.stdout:1/540: creat d1/d2/d1b/d10/fb5 x:0 0 0 2024-04-21T23:58:52.941 INFO:tasks.workunit.client.0.smithi110.stdout:1/541: dread d1/d2/d30/f98 [0,4194304] 0 2024-04-21T23:58:52.959 INFO:tasks.workunit.client.0.smithi110.stdout:3/567: sync 2024-04-21T23:58:53.162 INFO:tasks.workunit.client.0.smithi110.stdout:5/570: write d7/d9/d17/f2c [5424327,72639] 0 2024-04-21T23:58:53.180 INFO:tasks.workunit.client.0.smithi110.stdout:7/588: write f5 [104804,54213] 0 2024-04-21T23:58:53.234 INFO:tasks.workunit.client.0.smithi110.stdout:9/573: mknod d1/d29/d2a/d2b/d57/cbd 0 2024-04-21T23:58:53.430 INFO:tasks.workunit.client.0.smithi110.stdout:9/574: chown d1/l18 60 1 2024-04-21T23:58:53.746 INFO:tasks.workunit.client.0.smithi110.stdout:8/631: dwrite d5/d4f/d79/dd1/fd6 [0,4194304] 0 2024-04-21T23:58:53.899 INFO:tasks.workunit.client.0.smithi110.stdout:6/572: dwrite d16/d3d/d97/fa1 [0,4194304] 0 2024-04-21T23:58:54.054 INFO:tasks.workunit.client.0.smithi110.stdout:9/575: read d1/d19/f4b [1040752,125239] 0 2024-04-21T23:58:54.104 INFO:tasks.workunit.client.0.smithi110.stdout:7/589: fsync d10/d15/d22/f79 0 2024-04-21T23:58:54.210 INFO:tasks.workunit.client.0.smithi110.stdout:0/586: rename d0/c74 to d0/d14/d23/cd0 0 2024-04-21T23:58:54.224 INFO:tasks.workunit.client.0.smithi110.stdout:2/602: link d9/d1a/d1d/d4e/f5f d9/d1a/d1d/d4a/d6b/fc7 0 2024-04-21T23:58:54.307 INFO:tasks.workunit.client.0.smithi110.stdout:2/603: readlink d9/d25/d1b/d45/d50/d68/l71 0 2024-04-21T23:58:54.584 INFO:tasks.workunit.client.0.smithi110.stdout:5/571: fsync d7/d24/f56 0 2024-04-21T23:58:54.786 INFO:tasks.workunit.client.0.smithi110.stdout:4/519: creat d1/d11/d20/d23/d1c/d47/d4f/fb1 x:0 0 0 2024-04-21T23:58:54.937 INFO:tasks.workunit.client.0.smithi110.stdout:3/568: symlink d6/lbc 0 2024-04-21T23:58:55.528 INFO:tasks.workunit.client.0.smithi110.stdout:6/573: dread d16/d3d/d97/fa0 [0,4194304] 0 2024-04-21T23:58:56.023 INFO:tasks.workunit.client.0.smithi110.stdout:1/542: rename d1/la5 to d1/d2/d14/d65/lb6 0 2024-04-21T23:58:56.097 INFO:tasks.workunit.client.0.smithi110.stdout:2/604: dread d9/d25/d1c/f34 [0,4194304] 0 2024-04-21T23:58:56.242 INFO:tasks.workunit.client.0.smithi110.stdout:3/569: dread d6/d12/d16/f39 [0,4194304] 0 2024-04-21T23:58:56.561 INFO:tasks.workunit.client.0.smithi110.stdout:9/576: unlink d1/d29/d2a/d2b/cb0 0 2024-04-21T23:58:56.853 INFO:tasks.workunit.client.0.smithi110.stdout:6/574: fsync d16/d1d/d38/d48/d5e/d6a/f92 0 2024-04-21T23:58:57.274 INFO:tasks.workunit.client.0.smithi110.stdout:4/520: chown d1/d11/d20/d58/d93/c55 686 1 2024-04-21T23:58:57.324 INFO:tasks.workunit.client.0.smithi110.stdout:1/543: truncate d1/d2/d30/f98 684442 0 2024-04-21T23:58:57.433 INFO:tasks.workunit.client.0.smithi110.stdout:6/575: dread fe [0,4194304] 0 2024-04-21T23:58:57.458 INFO:tasks.workunit.client.0.smithi110.stdout:0/587: write d0/d25/f79 [1303340,127682] 0 2024-04-21T23:58:57.590 INFO:tasks.workunit.client.0.smithi110.stdout:3/570: rename d6/d12/d16/d30/l4d to d6/d12/d14/lbd 0 2024-04-21T23:58:57.641 INFO:tasks.workunit.client.0.smithi110.stdout:6/576: readlink d16/d1e/l8f 0 2024-04-21T23:58:57.653 INFO:tasks.workunit.client.0.smithi110.stdout:7/590: dwrite d10/d15/fc8 [0,4194304] 0 2024-04-21T23:58:57.824 INFO:tasks.workunit.client.0.smithi110.stdout:9/577: mknod d1/d29/d2a/d2b/d58/cbe 0 2024-04-21T23:58:58.031 INFO:tasks.workunit.client.0.smithi110.stdout:5/572: write d7/f27 [423063,42319] 0 2024-04-21T23:58:58.181 INFO:tasks.workunit.client.0.smithi110.stdout:4/521: read f0 [3859257,57238] 0 2024-04-21T23:58:58.287 INFO:tasks.workunit.client.0.smithi110.stdout:4/522: write d1/d11/d12/d26/f2d [1718383,106716] 0 2024-04-21T23:58:58.567 INFO:tasks.workunit.client.0.smithi110.stdout:8/632: getdents d5/d24/d33/d3d/d5c 0 2024-04-21T23:58:58.751 INFO:tasks.workunit.client.0.smithi110.stdout:7/591: chown d10/d15/d22/d2c/fb0 33 1 2024-04-21T23:58:58.870 INFO:tasks.workunit.client.0.smithi110.stdout:2/605: write d9/d1a/d1d/d4e/f9a [875729,33190] 0 2024-04-21T23:58:58.963 INFO:tasks.workunit.client.0.smithi110.stdout:9/578: fsync d1/f15 0 2024-04-21T23:58:59.072 INFO:tasks.workunit.client.0.smithi110.stdout:2/606: dread d9/d25/d1c/f34 [0,4194304] 0 2024-04-21T23:58:59.166 INFO:tasks.workunit.client.0.smithi110.stdout:2/607: chown d9/d1a/d1d/d4a/d78/f86 7 1 2024-04-21T23:58:59.374 INFO:tasks.workunit.client.0.smithi110.stdout:2/608: sync 2024-04-21T23:59:00.061 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:59:00.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:59:00.433 INFO:tasks.workunit.client.0.smithi110.stdout:3/571: unlink d6/d12/d16/d6f/d7a/cb2 0 2024-04-21T23:59:00.439 INFO:tasks.workunit.client.0.smithi110.stdout:1/544: write d1/d2/d1b/f9 [3894025,80588] 0 2024-04-21T23:59:00.625 INFO:tasks.workunit.client.0.smithi110.stdout:6/577: symlink d16/d1d/d38/d48/d5e/d62/d94/lb9 0 2024-04-21T23:59:00.630 INFO:tasks.workunit.client.0.smithi110.stdout:0/588: write d0/d27/d4b/d7f/faf [327872,16567] 0 2024-04-21T23:59:01.376 INFO:tasks.workunit.client.0.smithi110.stdout:9/579: dread d1/d29/d2a/d6/fe [0,4194304] 0 2024-04-21T23:59:01.558 INFO:tasks.workunit.client.0.smithi110.stdout:4/523: symlink d1/d11/d12/d26/d5f/lb2 0 2024-04-21T23:59:01.948 INFO:tasks.workunit.client.0.smithi110.stdout:1/545: symlink d1/d1d/d57/d91/d8d/lb7 0 2024-04-21T23:59:02.125 INFO:tasks.workunit.client.0.smithi110.stdout:0/589: chown d0/d27/d68/d7d/fbb 32857253 1 2024-04-21T23:59:02.180 INFO:tasks.workunit.client.0.smithi110.stdout:7/592: write d10/d45/d60/d5e/d65/d8a/fcb [554087,81150] 0 2024-04-21T23:59:02.302 INFO:tasks.workunit.client.0.smithi110.stdout:6/578: dread d16/d1d/d38/dae/fb0 [0,4194304] 0 2024-04-21T23:59:02.345 INFO:tasks.workunit.client.0.smithi110.stdout:8/633: dwrite d5/d80/f8f [4194304,4194304] 0 2024-04-21T23:59:02.493 INFO:tasks.workunit.client.0.smithi110.stdout:2/609: mkdir d9/d25/d1b/d45/d50/dc8 0 2024-04-21T23:59:02.703 INFO:tasks.workunit.client.0.smithi110.stdout:1/546: creat d1/d1d/d57/fb8 x:0 0 0 2024-04-21T23:59:02.737 INFO:tasks.workunit.client.0.smithi110.stdout:1/547: readlink d1/dd/d23/d48/d4e/l60 0 2024-04-21T23:59:02.958 INFO:tasks.workunit.client.0.smithi110.stdout:5/573: truncate d7/d9/d17/f2c 3687550 0 2024-04-21T23:59:03.173 INFO:tasks.workunit.client.0.smithi110.stdout:7/593: mkdir d10/d45/d51/d88/d39/d7f/dd4 0 2024-04-21T23:59:03.191 INFO:tasks.workunit.client.0.smithi110.stdout:8/634: symlink d5/da/d17/d6c/d95/d98/le0 0 2024-04-21T23:59:03.347 INFO:tasks.workunit.client.0.smithi110.stdout:2/610: symlink d9/d25/d1b/d45/d8e/lc9 0 2024-04-21T23:59:03.594 INFO:tasks.workunit.client.0.smithi110.stdout:6/579: truncate d16/d1d/d38/d48/d5e/d62/f8d 897239 0 2024-04-21T23:59:03.757 INFO:tasks.workunit.client.0.smithi110.stdout:1/548: chown d1/dd/fb3 7 1 2024-04-21T23:59:03.767 INFO:tasks.workunit.client.0.smithi110.stdout:2/611: dread d9/d1a/d1d/d2b/d54/f70 [0,4194304] 0 2024-04-21T23:59:03.842 INFO:tasks.workunit.client.0.smithi110.stdout:6/580: chown d16/d1e/d24/d33/c87 3 1 2024-04-21T23:59:03.909 INFO:tasks.workunit.client.0.smithi110.stdout:2/612: dread - d9/d1a/d1d/d7a/d91/fa3 zero size 2024-04-21T23:59:04.170 INFO:tasks.workunit.client.0.smithi110.stdout:7/594: mknod d10/d45/d51/d88/d93/cd5 0 2024-04-21T23:59:04.185 INFO:tasks.workunit.client.0.smithi110.stdout:8/635: truncate d5/da/f4e 1047084 0 2024-04-21T23:59:04.235 INFO:tasks.workunit.client.0.smithi110.stdout:3/572: write d6/d12/d3c/f95 [967388,9747] 0 2024-04-21T23:59:04.314 INFO:tasks.workunit.client.0.smithi110.stdout:8/636: read d5/da/d17/d7c/f87 [3775815,30584] 0 2024-04-21T23:59:04.910 INFO:tasks.workunit.client.0.smithi110.stdout:2/613: creat d9/d1a/d1d/d2b/d54/d77/fca x:0 0 0 2024-04-21T23:59:05.027 INFO:tasks.workunit.client.0.smithi110.stdout:9/580: dwrite d1/d29/d59/f93 [0,4194304] 0 2024-04-21T23:59:05.136 INFO:tasks.workunit.client.0.smithi110.stdout:7/595: truncate d10/d27/f29 4149014 0 2024-04-21T23:59:05.263 INFO:tasks.workunit.client.0.smithi110.stdout:8/637: creat d5/da/d88/fe1 x:0 0 0 2024-04-21T23:59:05.645 INFO:tasks.workunit.client.0.smithi110.stdout:4/524: dwrite d1/d11/d20/d58/d93/d5e/f9a [0,4194304] 0 2024-04-21T23:59:05.790 INFO:tasks.workunit.client.0.smithi110.stdout:6/581: mknod d16/d3d/d97/da9/cba 0 2024-04-21T23:59:05.911 INFO:tasks.workunit.client.0.smithi110.stdout:0/590: dwrite d0/d14/f8f [0,4194304] 0 2024-04-21T23:59:06.587 INFO:tasks.workunit.client.0.smithi110.stdout:8/638: creat d5/da/d17/d6c/fe2 x:0 0 0 2024-04-21T23:59:07.266 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:06:47.528 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.339 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:06:47.601 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.353 INFO:tasks.workunit.client.0.smithi110.stdout:5/574: write d7/d9/f16 [1203850,66014] 0 2024-04-21T23:59:07.386 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:06:47.584 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.392 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:06:47.590 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.422 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:06:47.684 27810== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.445 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:06:47.643 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.448 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:06:47.646 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.471 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:06:47.669 27790== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.518 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:06:47.715 27791== Warning: unimplemented fcntl command: 1036 2024-04-21T23:59:07.619 INFO:tasks.workunit.client.0.smithi110.stdout:8/639: mkdir d5/d24/d33/d3d/d82/de3 0 2024-04-21T23:59:07.807 INFO:tasks.workunit.client.0.smithi110.stdout:3/573: getdents d6/d12/d3c/d65 0 2024-04-21T23:59:07.855 INFO:tasks.workunit.client.0.smithi110.stdout:1/549: dwrite d1/d2/d1b/d10/f12 [0,4194304] 0 2024-04-21T23:59:07.987 INFO:tasks.workunit.client.0.smithi110.stdout:0/591: stat d0/d2a/fc3 0 2024-04-21T23:59:08.582 INFO:tasks.workunit.client.0.smithi110.stdout:8/640: creat d5/d24/d33/d3d/fe4 x:0 0 0 2024-04-21T23:59:08.599 INFO:tasks.workunit.client.0.smithi110.stdout:4/525: creat d1/d11/fb3 x:0 0 0 2024-04-21T23:59:08.722 INFO:tasks.workunit.client.0.smithi110.stdout:3/574: dread - d6/d12/d16/d30/fb7 zero size 2024-04-21T23:59:08.752 INFO:tasks.workunit.client.0.smithi110.stdout:9/581: write d1/d29/d2a/d2b/d57/f9b [272267,99305] 0 2024-04-21T23:59:08.908 INFO:tasks.workunit.client.0.smithi110.stdout:1/550: mkdir d1/d2/d30/db9 0 2024-04-21T23:59:09.241 INFO:tasks.workunit.client.0.smithi110.stdout:7/596: dwrite d10/d45/d51/d88/d93/fc4 [0,4194304] 0 2024-04-21T23:59:09.368 INFO:tasks.workunit.client.0.smithi110.stdout:6/582: getdents d16/d1e/d24/d66 0 2024-04-21T23:59:09.424 INFO:tasks.workunit.client.0.smithi110.stdout:8/641: mknod d5/da/ce5 0 2024-04-21T23:59:10.349 INFO:tasks.workunit.client.0.smithi110.stdout:2/614: write d9/d1a/d1d/d2b/f9c [322489,76380] 0 2024-04-21T23:59:10.489 INFO:tasks.workunit.client.0.smithi110.stdout:1/551: mkdir d1/d2/d14/d16/d27/d3e/dba 0 2024-04-21T23:59:10.598 INFO:tasks.workunit.client.0.smithi110.stdout:7/597: dread - d10/d43/f91 zero size 2024-04-21T23:59:10.939 INFO:tasks.workunit.client.0.smithi110.stdout:4/526: creat d1/d11/d20/d23/d1c/dae/fb4 x:0 0 0 2024-04-21T23:59:11.195 INFO:tasks.workunit.client.0.smithi110.stdout:3/575: symlink d6/d12/d16/d6f/db5/db9/lbe 0 2024-04-21T23:59:11.292 INFO:tasks.workunit.client.0.smithi110.stdout:0/592: link d0/d25/d5a/fb3 d0/d2a/fd1 0 2024-04-21T23:59:11.388 INFO:tasks.workunit.client.0.smithi110.stdout:2/615: symlink d9/d25/d1b/d45/d8e/lcb 0 2024-04-21T23:59:11.795 INFO:tasks.workunit.client.0.smithi110.stdout:5/575: dwrite d7/d9/d17/f1c [4194304,4194304] 0 2024-04-21T23:59:12.464 INFO:tasks.workunit.client.0.smithi110.stdout:0/593: unlink d0/d14/f8f 0 2024-04-21T23:59:12.609 INFO:tasks.workunit.client.0.smithi110.stdout:2/616: mkdir d9/d25/d1b/d45/d50/d68/da4/dcc 0 2024-04-21T23:59:12.986 INFO:tasks.workunit.client.0.smithi110.stdout:9/582: write d1/d29/d2a/dc/f40 [501092,126250] 0 2024-04-21T23:59:13.439 INFO:tasks.workunit.client.0.smithi110.stdout:6/583: link d16/d1e/d24/d33/faa d16/d3d/d40/d46/fbb 0 2024-04-21T23:59:13.678 INFO:tasks.workunit.client.0.smithi110.stdout:3/576: creat d6/d12/d3c/d65/d91/fbf x:0 0 0 2024-04-21T23:59:13.749 INFO:tasks.workunit.client.0.smithi110.stdout:4/527: mkdir d1/d11/d12/d26/db5 0 2024-04-21T23:59:13.751 INFO:tasks.workunit.client.0.smithi110.stdout:3/577: chown d6/d12/d3c/l56 66100042 1 2024-04-21T23:59:13.843 INFO:tasks.workunit.client.0.smithi110.stdout:6/584: sync 2024-04-21T23:59:14.026 INFO:tasks.workunit.client.0.smithi110.stdout:2/617: stat d9/d25/l81 0 2024-04-21T23:59:14.181 INFO:tasks.workunit.client.0.smithi110.stdout:9/583: dread - d1/d29/d2a/d2b/d58/da8/fbc zero size 2024-04-21T23:59:14.465 INFO:tasks.workunit.client.0.smithi110.stdout:8/642: write d5/d24/d33/d3d/d82/fd9 [271172,14697] 0 2024-04-21T23:59:15.127 INFO:tasks.workunit.client.0.smithi110.stdout:2/618: dread d9/d1a/d1d/d4a/d6b/d3a/f41 [0,4194304] 0 2024-04-21T23:59:15.204 INFO:tasks.workunit.client.0.smithi110.stdout:9/584: mkdir d1/d29/d4d/dac/dbf 0 2024-04-21T23:59:15.345 INFO:tasks.workunit.client.0.smithi110.stdout:1/552: write d1/f89 [646561,76674] 0 2024-04-21T23:59:15.410 INFO:tasks.workunit.client.0.smithi110.stdout:8/643: mkdir d5/d24/d33/d84/de6 0 2024-04-21T23:59:15.458 INFO:tasks.workunit.client.0.smithi110.stdout:7/598: write d10/d45/d51/d88/d46/fa0 [974425,96841] 0 2024-04-21T23:59:15.844 INFO:tasks.workunit.client.0.smithi110.stdout:0/594: link d0/d27/d68/d7d/l7e d0/d27/d4b/da0/ld2 0 2024-04-21T23:59:16.172 INFO:tasks.workunit.client.0.smithi110.stdout:9/585: fsync d1/d29/d59/f93 0 2024-04-21T23:59:16.253 INFO:tasks.workunit.client.0.smithi110.stdout:5/576: getdents d7/d24/d37/d38 0 2024-04-21T23:59:16.376 INFO:tasks.workunit.client.0.smithi110.stdout:1/553: fsync d1/d2/d14/f64 0 2024-04-21T23:59:16.546 INFO:tasks.workunit.client.0.smithi110.stdout:8/644: creat d5/d24/d33/d3d/d82/da8/fe7 x:0 0 0 2024-04-21T23:59:16.667 INFO:tasks.workunit.client.0.smithi110.stdout:7/599: mkdir d10/d45/d51/d88/d39/d7f/dd6 0 2024-04-21T23:59:17.275 INFO:tasks.workunit.client.0.smithi110.stdout:9/586: mknod d1/d29/d2a/d2b/d58/d7b/cc0 0 2024-04-21T23:59:17.597 INFO:tasks.workunit.client.0.smithi110.stdout:1/554: symlink d1/d2/d30/lbb 0 2024-04-21T23:59:17.779 INFO:tasks.workunit.client.0.smithi110.stdout:8/645: mknod d5/d24/d33/d3d/d82/ce8 0 2024-04-21T23:59:18.341 INFO:tasks.workunit.client.0.smithi110.stdout:7/600: symlink d10/d15/d95/ld7 0 2024-04-21T23:59:18.618 INFO:tasks.workunit.client.0.smithi110.stdout:8/646: rename d5/d4f/d79/fa5 to d5/da/d17/d6c/d72/da0/fe9 0 2024-04-21T23:59:18.978 INFO:tasks.workunit.client.0.smithi110.stdout:4/528: truncate d1/d11/fb3 593705 0 2024-04-21T23:59:19.008 INFO:tasks.workunit.client.0.smithi110.stdout:3/578: write d6/d12/d16/d30/d9c/f42 [4216346,8555] 0 2024-04-21T23:59:19.040 INFO:tasks.workunit.client.0.smithi110.stdout:6/585: write d16/d1d/d38/d8e/f9d [2578040,66932] 0 2024-04-21T23:59:19.486 INFO:tasks.workunit.client.0.smithi110.stdout:5/577: getdents d7/d22/d5b/d6f 0 2024-04-21T23:59:20.035 INFO:tasks.workunit.client.0.smithi110.stdout:3/579: dread d6/d12/d14/f25 [0,4194304] 0 2024-04-21T23:59:20.049 INFO:tasks.workunit.client.0.smithi110.stdout:5/578: mkdir d7/d22/d5b/d68/d9d 0 2024-04-21T23:59:20.093 INFO:tasks.workunit.client.0.smithi110.stdout:5/579: dread - d7/d24/d49/f99 zero size 2024-04-21T23:59:20.645 INFO:tasks.workunit.client.0.smithi110.stdout:5/580: dread d7/d24/d49/d61/f75 [0,4194304] 0 2024-04-21T23:59:20.672 INFO:tasks.workunit.client.0.smithi110.stdout:5/581: chown d7/d24/d37/d38/d88 188917618 1 2024-04-21T23:59:20.781 INFO:tasks.workunit.client.0.smithi110.stdout:2/619: write d9/d25/d1b/d45/d4d/f52 [646276,94755] 0 2024-04-21T23:59:20.995 INFO:tasks.workunit.client.0.smithi110.stdout:2/620: chown d9/d1a/d1d/d4a/d78 245 1 2024-04-21T23:59:21.158 INFO:tasks.workunit.client.0.smithi110.stdout:0/595: dwrite d0/d25/fa5 [0,4194304] 0 2024-04-21T23:59:21.326 INFO:tasks.workunit.client.0.smithi110.stdout:3/580: truncate d6/d78/fb3 373636 0 2024-04-21T23:59:21.374 INFO:tasks.workunit.client.0.smithi110.stdout:5/582: symlink d7/d35/l9e 0 2024-04-21T23:59:21.405 INFO:tasks.workunit.client.0.smithi110.stdout:7/601: write d10/d45/d51/d88/d46/fb4 [4986146,17264] 0 2024-04-21T23:59:21.830 INFO:tasks.workunit.client.0.smithi110.stdout:6/586: write d16/d1e/d24/d33/f34 [4014111,124021] 0 2024-04-21T23:59:21.854 INFO:tasks.workunit.client.0.smithi110.stdout:9/587: dwrite d1/d29/d2a/d2b/d58/f63 [0,4194304] 0 2024-04-21T23:59:21.996 INFO:tasks.workunit.client.0.smithi110.stdout:1/555: dwrite d1/dd/d23/f54 [0,4194304] 0 2024-04-21T23:59:22.024 INFO:tasks.workunit.client.0.smithi110.stdout:5/583: chown d7/l84 238 1 2024-04-21T23:59:22.295 INFO:tasks.workunit.client.0.smithi110.stdout:8/647: dwrite d5/da/d17/d7c/dc0/f94 [0,4194304] 0 2024-04-21T23:59:22.561 INFO:tasks.workunit.client.0.smithi110.stdout:0/596: rename d0/d27/d4b/f64 to d0/d27/d4b/da0/fd3 0 2024-04-21T23:59:22.607 INFO:tasks.workunit.client.0.smithi110.stdout:9/588: read d1/d19/f4b [4159541,64172] 0 2024-04-21T23:59:22.760 INFO:tasks.workunit.client.0.smithi110.stdout:4/529: dwrite f0 [4194304,4194304] 0 2024-04-21T23:59:22.998 INFO:tasks.workunit.client.0.smithi110.stdout:1/556: fdatasync d1/dd/d23/f3d 0 2024-04-21T23:59:23.225 INFO:tasks.workunit.client.0.smithi110.stdout:2/621: link d9/d1a/d1d/d2b/d54/f8c d9/d25/d1b/d45/d50/dc8/fcd 0 2024-04-21T23:59:23.269 INFO:tasks.workunit.client.0.smithi110.stdout:8/648: mknod d5/da/d17/d6c/d7d/cea 0 2024-04-21T23:59:23.317 INFO:tasks.workunit.client.0.smithi110.stdout:6/587: dread f15 [0,4194304] 0 2024-04-21T23:59:23.416 INFO:tasks.workunit.client.0.smithi110.stdout:3/581: dwrite d6/f3a [0,4194304] 0 2024-04-21T23:59:23.417 INFO:tasks.workunit.client.0.smithi110.stdout:5/584: rename d7/d22/d5b/l50 to d7/d22/d5b/d68/d9d/l9f 0 2024-04-21T23:59:23.582 INFO:tasks.workunit.client.0.smithi110.stdout:4/530: rmdir d1/d11/d20/d58/d7e 39 2024-04-21T23:59:23.611 INFO:tasks.workunit.client.0.smithi110.stdout:0/597: write d0/f41 [546535,66137] 0 2024-04-21T23:59:23.679 INFO:tasks.workunit.client.0.smithi110.stdout:9/589: mkdir d1/d29/d2a/d2b/d58/d7b/dc1 0 2024-04-21T23:59:23.735 INFO:tasks.workunit.client.0.smithi110.stdout:1/557: symlink d1/d2/d1b/da7/lbc 0 2024-04-21T23:59:24.132 INFO:tasks.workunit.client.0.smithi110.stdout:7/602: dwrite d10/f34 [4194304,4194304] 0 2024-04-21T23:59:24.136 INFO:tasks.workunit.client.0.smithi110.stdout:2/622: dread d9/d25/d1b/d45/d50/d68/fb1 [0,4194304] 0 2024-04-21T23:59:24.318 INFO:tasks.workunit.client.0.smithi110.stdout:1/558: symlink d1/d1d/d70/lbd 0 2024-04-21T23:59:24.319 INFO:tasks.workunit.client.0.smithi110.stdout:5/585: creat d7/d9/d17/d48/fa0 x:0 0 0 2024-04-21T23:59:24.398 INFO:tasks.workunit.client.0.smithi110.stdout:8/649: getdents d5/da/d17/d7c 0 2024-04-21T23:59:24.415 INFO:tasks.workunit.client.0.smithi110.stdout:0/598: creat d0/d25/d5a/d63/fd4 x:0 0 0 2024-04-21T23:59:24.696 INFO:tasks.workunit.client.0.smithi110.stdout:9/590: unlink d1/d29/d2a/d2b/d57/f9b 0 2024-04-21T23:59:24.713 INFO:tasks.workunit.client.0.smithi110.stdout:6/588: mknod d16/d1d/d38/d48/d5e/d6a/d70/d86/cbc 0 2024-04-21T23:59:24.752 INFO:tasks.workunit.client.0.smithi110.stdout:2/623: symlink d9/d25/d1c/d82/lce 0 2024-04-21T23:59:24.834 INFO:tasks.workunit.client.0.smithi110.stdout:4/531: creat d1/d35/fb6 x:0 0 0 2024-04-21T23:59:24.865 INFO:tasks.workunit.client.0.smithi110.stdout:1/559: read d1/d1d/d57/f62 [7213,129545] 0 2024-04-21T23:59:24.888 INFO:tasks.workunit.client.0.smithi110.stdout:9/591: chown d1/d19/d42/f6b 24066562 1 2024-04-21T23:59:25.156 INFO:tasks.workunit.client.0.smithi110.stdout:7/603: truncate d10/d15/d22/f42 1435904 0 2024-04-21T23:59:25.162 INFO:tasks.workunit.client.0.smithi110.stdout:5/586: fsync d7/d9/d17/d48/d69/d6d/f74 0 2024-04-21T23:59:25.239 INFO:tasks.workunit.client.0.smithi110.stdout:7/604: chown d10/d45/d51/d88/d93/fc4 23875401 1 2024-04-21T23:59:25.501 INFO:tasks.workunit.client.0.smithi110.stdout:0/599: rmdir d0/d27/d4b/da0/da4 39 2024-04-21T23:59:26.738 INFO:tasks.workunit.client.0.smithi110.stdout:5/587: creat d7/d24/d37/d38/fa1 x:0 0 0 2024-04-21T23:59:26.974 INFO:tasks.workunit.client.0.smithi110.stdout:0/600: dread - d0/d14/d23/fc2 zero size 2024-04-21T23:59:27.228 INFO:tasks.workunit.client.0.smithi110.stdout:4/532: symlink d1/d35/lb7 0 2024-04-21T23:59:27.532 INFO:tasks.workunit.client.0.smithi110.stdout:8/650: dwrite d5/d24/d33/d84/fc2 [0,4194304] 0 2024-04-21T23:59:27.659 INFO:tasks.workunit.client.0.smithi110.stdout:9/592: creat d1/d29/d4d/dac/db8/fc2 x:0 0 0 2024-04-21T23:59:27.713 INFO:tasks.workunit.client.0.smithi110.stdout:8/651: stat d5/da/dac/fd7 0 2024-04-21T23:59:27.761 INFO:tasks.workunit.client.0.smithi110.stdout:8/652: readlink d5/da/d17/d60/l67 0 2024-04-21T23:59:27.806 INFO:tasks.workunit.client.0.smithi110.stdout:5/588: truncate d7/d22/d5b/f6c 1672267 0 2024-04-21T23:59:27.810 INFO:tasks.workunit.client.0.smithi110.stdout:8/653: chown d5/d24/cb7 1773634 1 2024-04-21T23:59:28.206 INFO:tasks.workunit.client.0.smithi110.stdout:3/582: truncate d6/d12/d3c/f68 662285 0 2024-04-21T23:59:28.476 INFO:tasks.workunit.client.0.smithi110.stdout:6/589: rename d16/d3d/d40/f4b to d16/d1e/d24/fbd 0 2024-04-21T23:59:28.871 INFO:tasks.workunit.client.0.smithi110.stdout:4/533: dread - d1/d11/d20/d23/d1c/d47/d4f/f92 zero size 2024-04-21T23:59:29.028 INFO:tasks.workunit.client.0.smithi110.stdout:9/593: truncate d1/d29/d2a/dc/f1f 4850157 0 2024-04-21T23:59:29.179 INFO:tasks.workunit.client.0.smithi110.stdout:5/589: dread d7/d22/d5d/f89 [0,4194304] 0 2024-04-21T23:59:29.251 INFO:tasks.workunit.client.0.smithi110.stdout:8/654: fdatasync d5/d24/f49 0 2024-04-21T23:59:29.255 INFO:tasks.workunit.client.0.smithi110.stdout:5/590: chown d7/d9 25 1 2024-04-21T23:59:29.609 INFO:tasks.workunit.client.0.smithi110.stdout:8/655: dread d5/da/d17/d6c/d7d/f92 [0,4194304] 0 2024-04-21T23:59:29.696 INFO:tasks.workunit.client.0.smithi110.stdout:2/624: rename d9/d1a/c27 to d9/d1a/d1d/d7a/ccf 0 2024-04-21T23:59:29.725 INFO:tasks.workunit.client.0.smithi110.stdout:1/560: getdents d1/d2/d14/d16/d27/d3e 0 2024-04-21T23:59:30.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:59:30.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T23:59:30.667 INFO:tasks.workunit.client.0.smithi110.stdout:5/591: truncate d7/d9/fd 862468 0 2024-04-21T23:59:30.682 INFO:tasks.workunit.client.0.smithi110.stdout:0/601: dwrite d0/d14/d23/fc2 [0,4194304] 0 2024-04-21T23:59:30.800 INFO:tasks.workunit.client.0.smithi110.stdout:8/656: fsync d5/da/dac/fd7 0 2024-04-21T23:59:31.522 INFO:tasks.workunit.client.0.smithi110.stdout:2/625: truncate d9/d25/d1c/d82/f9d 40732 0 2024-04-21T23:59:31.535 INFO:tasks.workunit.client.0.smithi110.stdout:9/594: mknod d1/cc3 0 2024-04-21T23:59:32.015 INFO:tasks.workunit.client.0.smithi110.stdout:6/590: creat d16/fbe x:0 0 0 2024-04-21T23:59:32.077 INFO:tasks.workunit.client.0.smithi110.stdout:0/602: creat d0/d27/d68/fd5 x:0 0 0 2024-04-21T23:59:32.290 INFO:tasks.workunit.client.0.smithi110.stdout:8/657: creat d5/da/d17/d7c/feb x:0 0 0 2024-04-21T23:59:32.386 INFO:tasks.workunit.client.0.smithi110.stdout:1/561: mknod d1/d2/d14/d16/cbe 0 2024-04-21T23:59:32.527 INFO:tasks.workunit.client.0.smithi110.stdout:9/595: creat d1/d29/d2a/d6/fc4 x:0 0 0 2024-04-21T23:59:32.567 INFO:tasks.workunit.client.0.smithi110.stdout:9/596: chown d1/d29/d2a/dc/f67 220601035 1 2024-04-21T23:59:32.598 INFO:tasks.workunit.client.0.smithi110.stdout:9/597: chown d1/d29/d6f/db4/f9a 1371609470 1 2024-04-21T23:59:32.644 INFO:tasks.workunit.client.0.smithi110.stdout:2/626: truncate d9/d1a/d1d/fa5 5626158 0 2024-04-21T23:59:33.062 INFO:tasks.workunit.client.0.smithi110.stdout:3/583: dwrite d6/d12/d14/f2e [0,4194304] 0 2024-04-21T23:59:33.196 INFO:tasks.workunit.client.0.smithi110.stdout:6/591: dread d16/d1d/f41 [0,4194304] 0 2024-04-21T23:59:33.224 INFO:tasks.workunit.client.0.smithi110.stdout:8/658: truncate d5/da/d17/d7c/f7e 3196865 0 2024-04-21T23:59:33.326 INFO:tasks.workunit.client.0.smithi110.stdout:9/598: symlink d1/d29/d4d/lc5 0 2024-04-21T23:59:33.461 INFO:tasks.workunit.client.0.smithi110.stdout:4/534: dwrite d1/d11/f41 [4194304,4194304] 0 2024-04-21T23:59:33.689 INFO:tasks.workunit.client.0.smithi110.stdout:2/627: symlink d9/d1a/d1d/d7a/d91/ld0 0 2024-04-21T23:59:33.782 INFO:tasks.workunit.client.0.smithi110.stdout:7/605: rename d10/d45/d51/d88/d39/f4e to d10/d45/d51/d88/d46/fd8 0 2024-04-21T23:59:34.593 INFO:tasks.workunit.client.0.smithi110.stdout:8/659: creat d5/da/d17/d7c/dc0/fec x:0 0 0 2024-04-21T23:59:34.630 INFO:tasks.workunit.client.0.smithi110.stdout:8/660: stat d5/d24/d33/d3d/d5c/f8b 0 2024-04-21T23:59:34.839 INFO:tasks.workunit.client.0.smithi110.stdout:9/599: creat d1/d29/d2a/d2b/d58/fc6 x:0 0 0 2024-04-21T23:59:35.133 INFO:tasks.workunit.client.0.smithi110.stdout:5/592: rename d7/d22/l42 to d7/d24/d37/d38/la2 0 2024-04-21T23:59:35.216 INFO:tasks.workunit.client.0.smithi110.stdout:2/628: dread d9/f10 [0,4194304] 0 2024-04-21T23:59:35.347 INFO:tasks.workunit.client.0.smithi110.stdout:1/562: creat d1/d2/d14/d16/d27/fbf x:0 0 0 2024-04-21T23:59:35.610 INFO:tasks.workunit.client.0.smithi110.stdout:8/661: mknod d5/da/d17/d7c/dc0/ced 0 2024-04-21T23:59:36.181 INFO:tasks.workunit.client.0.smithi110.stdout:2/629: truncate d9/d25/d1c/d82/f9f 831728 0 2024-04-21T23:59:36.218 INFO:tasks.workunit.client.0.smithi110.stdout:2/630: readlink d9/lb 0 2024-04-21T23:59:36.316 INFO:tasks.workunit.client.0.smithi110.stdout:0/603: write d0/d2a/f57 [193545,1003] 0 2024-04-21T23:59:36.317 INFO:tasks.workunit.client.0.smithi110.stdout:1/563: read d1/f26 [676570,66262] 0 2024-04-21T23:59:36.391 INFO:tasks.workunit.client.0.smithi110.stdout:8/662: fdatasync d5/d24/d33/d3d/f43 0 2024-04-21T23:59:36.495 INFO:tasks.workunit.client.0.smithi110.stdout:4/535: creat d1/d35/fb8 x:0 0 0 2024-04-21T23:59:37.390 INFO:tasks.workunit.client.0.smithi110.stdout:1/564: unlink d1/d2/d14/l85 0 2024-04-21T23:59:37.612 INFO:tasks.workunit.client.0.smithi110.stdout:8/663: read d5/d24/d33/d3d/f46 [7921,77367] 0 2024-04-21T23:59:37.716 INFO:tasks.workunit.client.0.smithi110.stdout:6/592: getdents d16/d1e/d24/d7b 0 2024-04-21T23:59:37.823 INFO:tasks.workunit.client.0.smithi110.stdout:2/631: symlink d9/d25/d1b/d45/d50/ld1 0 2024-04-21T23:59:38.130 INFO:tasks.workunit.client.0.smithi110.stdout:3/584: dwrite d6/f6a [0,4194304] 0 2024-04-21T23:59:38.442 INFO:tasks.workunit.client.0.smithi110.stdout:0/604: mknod d0/d16/d42/d50/dbc/dc8/cd6 0 2024-04-21T23:59:38.878 INFO:tasks.workunit.client.0.smithi110.stdout:6/593: truncate d16/d1d/d38/d8e/f9d 3652421 0 2024-04-21T23:59:39.096 INFO:tasks.workunit.client.0.smithi110.stdout:2/632: mkdir d9/d1a/d1d/d2b/d5b/dd2 0 2024-04-21T23:59:39.122 INFO:tasks.workunit.client.0.smithi110.stdout:2/633: readlink d9/d25/d1b/d45/d50/d68/l71 0 2024-04-21T23:59:39.624 INFO:tasks.workunit.client.0.smithi110.stdout:4/536: rename d1/d11 to d1/d35/db9 0 2024-04-21T23:59:39.649 INFO:tasks.workunit.client.0.smithi110.stdout:0/605: dread d0/d14/d23/f9e [0,4194304] 0 2024-04-21T23:59:39.679 INFO:tasks.workunit.client.0.smithi110.stdout:5/593: write d7/d35/f7b [617117,129436] 0 2024-04-21T23:59:39.975 INFO:tasks.workunit.client.0.smithi110.stdout:9/600: dwrite d1/d29/d2a/d6/fa9 [0,4194304] 0 2024-04-21T23:59:40.214 INFO:tasks.workunit.client.0.smithi110.stdout:2/634: creat d9/d1a/d1d/d4e/dc0/fd3 x:0 0 0 2024-04-21T23:59:40.217 INFO:tasks.workunit.client.0.smithi110.stdout:4/537: stat d1/d35/db9/d20/d23/d1c/d40/fa9 0 2024-04-21T23:59:40.321 INFO:tasks.workunit.client.0.smithi110.stdout:7/606: dwrite d10/d27/f82 [0,4194304] 0 2024-04-21T23:59:40.518 INFO:tasks.workunit.client.0.smithi110.stdout:7/607: read d10/d15/d22/f44 [40958,23976] 0 2024-04-21T23:59:41.074 INFO:tasks.workunit.client.0.smithi110.stdout:5/594: creat d7/d24/d3a/d54/fa3 x:0 0 0 2024-04-21T23:59:41.103 INFO:tasks.workunit.client.0.smithi110.stdout:8/664: dwrite d5/d24/f2c [0,4194304] 0 2024-04-21T23:59:41.111 INFO:tasks.workunit.client.0.smithi110.stdout:1/565: dwrite d1/dd/d23/d48/d4e/fb2 [0,4194304] 0 2024-04-21T23:59:41.290 INFO:tasks.workunit.client.0.smithi110.stdout:3/585: rename d6/d12/d14/lbd to d6/d12/d16/d6f/db5/lc0 0 2024-04-21T23:59:41.939 INFO:tasks.workunit.client.0.smithi110.stdout:2/635: symlink d9/d25/d1b/d45/d8e/ld4 0 2024-04-21T23:59:41.946 INFO:tasks.workunit.client.0.smithi110.stdout:6/594: write d16/d3d/d97/fa2 [1669740,107833] 0 2024-04-21T23:59:42.172 INFO:tasks.workunit.client.0.smithi110.stdout:4/538: dread d1/d35/db9/d20/d23/d1c/d40/fa9 [0,4194304] 0 2024-04-21T23:59:42.249 INFO:tasks.workunit.client.0.smithi110.stdout:7/608: creat d10/d15/d22/d2c/fd9 x:0 0 0 2024-04-21T23:59:42.622 INFO:tasks.workunit.client.0.smithi110.stdout:5/595: unlink d7/d9/d17/c1f 0 2024-04-21T23:59:42.787 INFO:tasks.workunit.client.0.smithi110.stdout:0/606: rename d0/d16/c5c to d0/d27/d4b/d7f/cd7 0 2024-04-21T23:59:42.807 INFO:tasks.workunit.client.0.smithi110.stdout:1/566: dread d1/d2/d1b/d10/f12 [4194304,4194304] 0 2024-04-21T23:59:42.826 INFO:tasks.workunit.client.0.smithi110.stdout:3/586: truncate d6/d12/d50/f6c 1121511 0 2024-04-21T23:59:42.884 INFO:tasks.workunit.client.0.smithi110.stdout:9/601: symlink d1/d29/d4d/dac/dbf/lc7 0 2024-04-21T23:59:42.994 INFO:tasks.workunit.client.0.smithi110.stdout:2/636: mkdir d9/d25/d1b/d45/d8e/dd5 0 2024-04-21T23:59:43.915 INFO:tasks.workunit.client.0.smithi110.stdout:0/607: fdatasync d0/d14/f1c 0 2024-04-21T23:59:43.963 INFO:tasks.workunit.client.0.smithi110.stdout:0/608: dread - d0/d16/d42/d50/f94 zero size 2024-04-21T23:59:44.337 INFO:tasks.workunit.client.0.smithi110.stdout:1/567: truncate d1/d2/d14/f9d 1141134 0 2024-04-21T23:59:44.349 INFO:tasks.workunit.client.0.smithi110.stdout:9/602: read d1/d29/d2a/d6/fe [2608852,85657] 0 2024-04-21T23:59:44.444 INFO:tasks.workunit.client.0.smithi110.stdout:2/637: rename d9/d25/d1b/l6d to d9/d1a/d1d/d4e/dc0/ld6 0 2024-04-21T23:59:44.746 INFO:tasks.workunit.client.0.smithi110.stdout:7/609: creat d10/d45/d51/d88/dce/fda x:0 0 0 2024-04-21T23:59:44.833 INFO:tasks.workunit.client.0.smithi110.stdout:4/539: truncate d1/d35/f33 1285054 0 2024-04-21T23:59:45.045 INFO:tasks.workunit.client.0.smithi110.stdout:3/587: fdatasync d6/d12/d50/f80 0 2024-04-21T23:59:45.252 INFO:tasks.workunit.client.0.smithi110.stdout:9/603: mknod d1/d29/d2a/d2b/cc8 0 2024-04-21T23:59:45.418 INFO:tasks.workunit.client.0.smithi110.stdout:0/609: rename d0/d2a/f4e to d0/d16/d42/fd8 0 2024-04-21T23:59:45.440 INFO:tasks.workunit.client.0.smithi110.stdout:8/665: write d5/f54 [4934298,81358] 0 2024-04-21T23:59:45.526 INFO:tasks.workunit.client.0.smithi110.stdout:0/610: readlink d0/d27/d4b/da0/lad 0 2024-04-21T23:59:45.568 INFO:tasks.workunit.client.0.smithi110.stdout:2/638: creat d9/d1a/d1d/d2b/d54/fd7 x:0 0 0 2024-04-21T23:59:45.661 INFO:tasks.workunit.client.0.smithi110.stdout:2/639: dread d9/d1a/d1d/d4a/d6b/d3a/f41 [0,4194304] 0 2024-04-21T23:59:45.775 INFO:tasks.workunit.client.0.smithi110.stdout:4/540: creat d1/d35/db9/d12/d26/d5f/fba x:0 0 0 2024-04-21T23:59:46.192 INFO:tasks.workunit.client.0.smithi110.stdout:3/588: mknod d6/d12/d14/d32/cc1 0 2024-04-21T23:59:46.363 INFO:tasks.workunit.client.0.smithi110.stdout:1/568: creat d1/d2/d30/d9c/fc0 x:0 0 0 2024-04-21T23:59:46.463 INFO:tasks.workunit.client.0.smithi110.stdout:9/604: creat d1/d29/d6f/db4/fc9 x:0 0 0 2024-04-21T23:59:47.081 INFO:tasks.workunit.client.0.smithi110.stdout:0/611: fsync d0/d27/f48 0 2024-04-21T23:59:47.165 INFO:tasks.workunit.client.0.smithi110.stdout:6/595: link d16/d3d/d97/fa0 d16/d1d/d38/fbf 0 2024-04-21T23:59:47.479 INFO:tasks.workunit.client.0.smithi110.stdout:5/596: write d7/d9/f3d [577195,16056] 0 2024-04-21T23:59:47.508 INFO:tasks.workunit.client.0.smithi110.stdout:5/597: stat d7 0 2024-04-21T23:59:47.558 INFO:tasks.workunit.client.0.smithi110.stdout:3/589: dread - d6/d12/da1/fb4 zero size 2024-04-21T23:59:47.768 INFO:tasks.workunit.client.0.smithi110.stdout:9/605: fdatasync d1/d29/d2a/d2b/d58/f63 0 2024-04-21T23:59:47.955 INFO:tasks.workunit.client.0.smithi110.stdout:9/606: stat d1/d29/d2a/laf 0 2024-04-21T23:59:47.958 INFO:tasks.workunit.client.0.smithi110.stdout:3/590: dread d6/d12/d16/d30/f73 [0,4194304] 0 2024-04-21T23:59:48.536 INFO:tasks.workunit.client.0.smithi110.stdout:0/612: creat d0/d16/d42/fd9 x:0 0 0 2024-04-21T23:59:48.571 INFO:tasks.workunit.client.0.smithi110.stdout:1/569: creat d1/d2/d1b/d10/d5c/daa/fc1 x:0 0 0 2024-04-21T23:59:48.668 INFO:tasks.workunit.client.0.smithi110.stdout:0/613: read - d0/d27/d68/d7d/fbb zero size 2024-04-21T23:59:49.016 INFO:tasks.workunit.client.0.smithi110.stdout:7/610: rename d10/d45/d60/fbe to d10/d15/d22/fdb 0 2024-04-21T23:59:49.080 INFO:tasks.workunit.client.0.smithi110.stdout:7/611: readlink d10/d45/d51/d88/d46/d69/d75/lad 0 2024-04-21T23:59:49.382 INFO:tasks.workunit.client.0.smithi110.stdout:9/607: dread - d1/d29/d2a/d2b/d58/d7b/fab zero size 2024-04-21T23:59:49.903 INFO:tasks.workunit.client.0.smithi110.stdout:6/596: rename d16/d1d/d38/d48/d5e/d6a/d70/d74/fb5 to d16/d1e/da8/fc0 0 2024-04-21T23:59:50.106 INFO:tasks.workunit.client.0.smithi110.stdout:7/612: read d10/d15/d22/d2c/fbf [87869,18340] 0 2024-04-21T23:59:50.124 INFO:tasks.workunit.client.0.smithi110.stdout:7/613: readlink d10/d27/l63 0 2024-04-21T23:59:50.206 INFO:tasks.workunit.client.0.smithi110.stdout:9/608: rmdir d1/d52/d76 39 2024-04-21T23:59:50.274 INFO:tasks.workunit.client.0.smithi110.stdout:6/597: sync 2024-04-21T23:59:50.430 INFO:tasks.workunit.client.0.smithi110.stdout:7/614: chown d10/d45/d60/d5e/d65/da3/fb5 232621 1 2024-04-21T23:59:50.743 INFO:tasks.workunit.client.0.smithi110.stdout:4/541: write d1/d35/db9/d20/d58/d93/d5e/f9a [4903500,46033] 0 2024-04-21T23:59:50.745 INFO:tasks.workunit.client.0.smithi110.stdout:8/666: write d5/d74/fb1 [592990,3022] 0 2024-04-21T23:59:50.765 INFO:tasks.workunit.client.0.smithi110.stdout:2/640: write d9/d1a/d1d/d4a/d6b/f98 [956333,96785] 0 2024-04-21T23:59:50.891 INFO:tasks.workunit.client.0.smithi110.stdout:8/667: chown d5/da/d17/d7c/cb9 398 1 2024-04-21T23:59:51.150 INFO:tasks.workunit.client.0.smithi110.stdout:5/598: dwrite d7/f27 [0,4194304] 0 2024-04-21T23:59:51.264 INFO:tasks.workunit.client.0.smithi110.stdout:6/598: unlink d16/d3d/d40/f82 0 2024-04-21T23:59:51.316 INFO:tasks.workunit.client.0.smithi110.stdout:5/599: read d7/d24/d49/d61/f75 [2786280,73069] 0 2024-04-21T23:59:51.359 INFO:tasks.workunit.client.0.smithi110.stdout:5/600: stat d7/d9/f16 0 2024-04-21T23:59:51.456 INFO:tasks.workunit.client.0.smithi110.stdout:3/591: rename d6/d12/d16/f77 to d6/d78/fc2 0 2024-04-21T23:59:52.527 INFO:tasks.workunit.client.0.smithi110.stdout:2/641: fsync d9/f49 0 2024-04-21T23:59:52.575 INFO:tasks.workunit.client.0.smithi110.stdout:8/668: mkdir d5/da/d17/d6c/d72/da0/dee 0 2024-04-21T23:59:52.680 INFO:tasks.workunit.client.0.smithi110.stdout:2/642: sync 2024-04-21T23:59:52.823 INFO:tasks.workunit.client.0.smithi110.stdout:5/601: truncate d7/d35/f8a 4520482 0 2024-04-21T23:59:52.899 INFO:tasks.workunit.client.0.smithi110.stdout:2/643: stat d9/d1a/d1d/d2b/f9c 0 2024-04-21T23:59:52.962 INFO:tasks.workunit.client.0.smithi110.stdout:1/570: dwrite d1/d1d/d57/fb8 [0,4194304] 0 2024-04-21T23:59:53.068 INFO:tasks.workunit.client.0.smithi110.stdout:5/602: readlink d7/d9/d17/l59 0 2024-04-21T23:59:53.087 INFO:tasks.workunit.client.0.smithi110.stdout:0/614: rename d0/d2a/f57 to d0/d14/d23/d6d/fda 0 2024-04-21T23:59:54.254 INFO:tasks.workunit.client.0.smithi110.stdout:0/615: unlink d0/d27/f82 0 2024-04-21T23:59:54.283 INFO:tasks.workunit.client.0.smithi110.stdout:0/616: chown d0/d25/d5a/d63/fd4 59135933 1 2024-04-21T23:59:54.474 INFO:tasks.workunit.client.0.smithi110.stdout:8/669: rename d5/d24/f14 to d5/da/d17/d60/fef 0 2024-04-21T23:59:54.500 INFO:tasks.workunit.client.0.smithi110.stdout:7/615: write d10/d27/f82 [1151554,38942] 0 2024-04-21T23:59:54.555 INFO:tasks.workunit.client.0.smithi110.stdout:2/644: dread - d9/d1a/d1d/d4a/d6b/d3a/d5c/f97 zero size 2024-04-21T23:59:54.586 INFO:tasks.workunit.client.0.smithi110.stdout:8/670: chown d5/da/d17/c30 1646554 1 2024-04-21T23:59:54.742 INFO:tasks.workunit.client.0.smithi110.stdout:9/609: link d1/d29/d2a/d2b/d58/d7b/f91 d1/fca 0 2024-04-21T23:59:54.806 INFO:tasks.workunit.client.0.smithi110.stdout:6/599: link d16/d3d/d40/l8b d16/d1e/d24/d90/lc1 0 2024-04-21T23:59:54.997 INFO:tasks.workunit.client.0.smithi110.stdout:4/542: write d1/d35/db9/d20/d58/d93/d7c/fa6 [472145,18064] 0 2024-04-21T23:59:55.051 INFO:tasks.workunit.client.0.smithi110.stdout:4/543: chown d1/d35/db9/d20/d23/d1c/d47/c48 609989578 1 2024-04-21T23:59:55.362 INFO:tasks.workunit.client.0.smithi110.stdout:7/616: mknod d10/d45/d60/d5e/d65/cdc 0 2024-04-21T23:59:55.379 INFO:tasks.workunit.client.0.smithi110.stdout:8/671: truncate d5/d24/d33/d84/fc2 3852795 0 2024-04-21T23:59:55.445 INFO:tasks.workunit.client.0.smithi110.stdout:2/645: dread d9/f15 [0,4194304] 0 2024-04-21T23:59:55.476 INFO:tasks.workunit.client.0.smithi110.stdout:2/646: chown d9/d1a/d7b 438190851 1 2024-04-21T23:59:55.539 INFO:tasks.workunit.client.0.smithi110.stdout:7/617: sync 2024-04-21T23:59:55.755 INFO:tasks.workunit.client.0.smithi110.stdout:6/600: mknod d16/d1d/d38/d48/d5e/cc2 0 2024-04-21T23:59:55.902 INFO:tasks.workunit.client.0.smithi110.stdout:0/617: symlink d0/d14/d23/ldb 0 2024-04-21T23:59:55.946 INFO:tasks.workunit.client.0.smithi110.stdout:0/618: read d0/d16/d42/d50/fb4 [776130,1487] 0 2024-04-21T23:59:56.135 INFO:tasks.workunit.client.0.smithi110.stdout:4/544: fsync d1/d35/db9/d20/d23/ff 0 2024-04-21T23:59:56.372 INFO:tasks.workunit.client.0.smithi110.stdout:2/647: dread d9/d1a/d1d/d2b/d54/f70 [0,4194304] 0 2024-04-21T23:59:56.576 INFO:tasks.workunit.client.0.smithi110.stdout:8/672: rename d5/d24/d33/d3d/f43 to d5/d24/d33/d3d/d82/da8/ff0 0 2024-04-21T23:59:57.278 INFO:tasks.workunit.client.0.smithi110.stdout:3/592: rename d6/d12/l90 to d6/d12/lc3 0 2024-04-21T23:59:57.434 INFO:tasks.workunit.client.0.smithi110.stdout:0/619: dread d0/d16/d42/f4c [0,4194304] 0 2024-04-21T23:59:57.458 INFO:tasks.workunit.client.0.smithi110.stdout:0/620: chown d0/d25/d5a 87 1 2024-04-21T23:59:57.487 INFO:tasks.workunit.client.0.smithi110.stdout:0/621: stat d0/d16/d42/d50/c87 0 2024-04-21T23:59:57.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/673: dread - d5/da/d17/d7c/dc0/fcf zero size 2024-04-21T23:59:58.062 INFO:tasks.workunit.client.0.smithi110.stdout:5/603: write d7/d9/d17/d48/d69/d6d/f74 [2349581,50532] 0 2024-04-21T23:59:58.244 INFO:tasks.workunit.client.0.smithi110.stdout:1/571: dwrite d1/d2/d14/d16/d29/f41 [4194304,4194304] 0 2024-04-21T23:59:58.269 INFO:tasks.workunit.client.0.smithi110.stdout:4/545: creat d1/d35/db9/d20/d23/d1c/d47/d95/fbb x:0 0 0 2024-04-21T23:59:58.410 INFO:tasks.workunit.client.0.smithi110.stdout:0/622: creat d0/d2a/fdc x:0 0 0 2024-04-21T23:59:58.532 INFO:tasks.workunit.client.0.smithi110.stdout:0/623: dread d0/d16/d42/f52 [0,4194304] 0 2024-04-21T23:59:58.672 INFO:tasks.workunit.client.0.smithi110.stdout:7/618: creat d10/d45/d51/d88/d46/fdd x:0 0 0 2024-04-21T23:59:58.722 INFO:tasks.workunit.client.0.smithi110.stdout:6/601: creat d16/fc3 x:0 0 0 2024-04-21T23:59:59.085 INFO:tasks.workunit.client.0.smithi110.stdout:5/604: creat d7/d9/d17/d48/d69/fa4 x:0 0 0 2024-04-21T23:59:59.106 INFO:tasks.workunit.client.0.smithi110.stdout:9/610: write d1/f15 [1618069,13298] 0 2024-04-21T23:59:59.288 INFO:tasks.workunit.client.0.smithi110.stdout:5/605: sync 2024-04-21T23:59:59.408 INFO:tasks.workunit.client.0.smithi110.stdout:4/546: creat d1/d35/db9/d20/d23/d1c/d47/d95/fbc x:0 0 0 2024-04-21T23:59:59.960 INFO:tasks.workunit.client.0.smithi110.stdout:6/602: truncate d16/d1e/d24/f4e 6736701 0 2024-04-22T00:00:00.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T00:00:00.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T00:00:00.647 INFO:tasks.workunit.client.0.smithi110.stdout:7/619: mknod d10/d45/d60/cde 0 2024-04-22T00:00:00.998 INFO:tasks.workunit.client.0.smithi110.stdout:6/603: creat d16/d1e/d24/d90/fc4 x:0 0 0 2024-04-22T00:00:01.070 INFO:tasks.workunit.client.0.smithi110.stdout:9/611: getdents d1/d29/d59/d99 0 2024-04-22T00:00:01.304 INFO:tasks.workunit.client.0.smithi110.stdout:2/648: dwrite d9/d25/d1b/d60/f67 [0,4194304] 0 2024-04-22T00:00:01.466 INFO:tasks.workunit.client.0.smithi110.stdout:7/620: symlink d10/d45/d60/d5e/ldf 0 2024-04-22T00:00:01.876 INFO:tasks.workunit.client.0.smithi110.stdout:5/606: mkdir d7/d22/d5b/da5 0 2024-04-22T00:00:02.107 INFO:tasks.workunit.client.0.smithi110.stdout:9/612: creat d1/d29/d2a/dc/fcb x:0 0 0 2024-04-22T00:00:02.188 INFO:tasks.workunit.client.0.smithi110.stdout:4/547: creat d1/d35/db9/d20/d58/d93/fbd x:0 0 0 2024-04-22T00:00:02.493 INFO:tasks.workunit.client.0.smithi110.stdout:8/674: dwrite d5/da/d17/f85 [4194304,4194304] 0 2024-04-22T00:00:02.661 INFO:tasks.workunit.client.0.smithi110.stdout:3/593: fsync d6/d12/d16/d30/d9c/f42 0 2024-04-22T00:00:02.738 INFO:tasks.workunit.client.0.smithi110.stdout:6/604: mknod d16/d1d/d38/dab/cc5 0 2024-04-22T00:00:03.193 INFO:tasks.workunit.client.0.smithi110.stdout:2/649: symlink d9/d25/d1c/ld8 0 2024-04-22T00:00:03.433 INFO:tasks.workunit.client.0.smithi110.stdout:4/548: rmdir d1/d35/db9/d20/d23/d1c/d40 39 2024-04-22T00:00:03.499 INFO:tasks.workunit.client.0.smithi110.stdout:2/650: sync 2024-04-22T00:00:03.605 INFO:tasks.workunit.client.0.smithi110.stdout:0/624: dwrite d0/d25/d5a/fc7 [0,4194304] 0 2024-04-22T00:00:04.046 INFO:tasks.workunit.client.0.smithi110.stdout:1/572: write d1/f40 [1478248,31312] 0 2024-04-22T00:00:04.339 INFO:tasks.workunit.client.0.smithi110.stdout:6/605: dread d16/d3d/f43 [0,4194304] 0 2024-04-22T00:00:04.350 INFO:tasks.workunit.client.0.smithi110.stdout:6/606: chown d16 246995308 1 2024-04-22T00:00:04.746 INFO:tasks.workunit.client.0.smithi110.stdout:0/625: creat d0/d14/d23/d3b/fdd x:0 0 0 2024-04-22T00:00:04.910 INFO:tasks.workunit.client.0.smithi110.stdout:7/621: rename d10/d45/d60/d5e/d65/d8a/cb9 to d10/d45/d51/d88/d46/ce0 0 2024-04-22T00:00:05.888 INFO:tasks.workunit.client.0.smithi110.stdout:1/573: fdatasync d1/d2/d30/d9c/fc0 0 2024-04-22T00:00:06.114 INFO:tasks.workunit.client.0.smithi110.stdout:1/574: sync 2024-04-22T00:00:06.173 INFO:tasks.workunit.client.0.smithi110.stdout:2/651: mknod d9/d25/d1c/da0/cd9 0 2024-04-22T00:00:06.628 INFO:tasks.workunit.client.0.smithi110.stdout:0/626: dread d0/f1e [0,4194304] 0 2024-04-22T00:00:06.898 INFO:tasks.workunit.client.0.smithi110.stdout:9/613: write d1/d29/d6f/db4/fc9 [357720,74207] 0 2024-04-22T00:00:07.265 INFO:tasks.workunit.client.0.smithi110.stdout:9/614: dwrite d1/d29/d6f/db4/fc9 [0,4194304] 0 2024-04-22T00:00:07.550 INFO:tasks.workunit.client.0.smithi110.stdout:0/627: mkdir d0/d14/d23/d6d/dde 0 2024-04-22T00:00:07.683 INFO:tasks.workunit.client.0.smithi110.stdout:8/675: write d5/da/d17/d6c/d95/fa6 [856472,19521] 0 2024-04-22T00:00:07.782 INFO:tasks.workunit.client.0.smithi110.stdout:1/575: dread d1/d2/d1b/d10/f5f [0,4194304] 0 2024-04-22T00:00:08.535 INFO:tasks.workunit.client.0.smithi110.stdout:3/594: link d6/f6a d6/d12/d3c/fc4 0 2024-04-22T00:00:08.583 INFO:tasks.workunit.client.0.smithi110.stdout:5/607: dwrite d7/d9/d17/f8c [0,4194304] 0 2024-04-22T00:00:08.693 INFO:tasks.workunit.client.0.smithi110.stdout:0/628: creat d0/d16/d5d/fdf x:0 0 0 2024-04-22T00:00:08.735 INFO:tasks.workunit.client.0.smithi110.stdout:9/615: dread d1/d29/d6f/f75 [0,4194304] 0 2024-04-22T00:00:08.792 INFO:tasks.workunit.client.0.smithi110.stdout:8/676: dread - d5/d24/d33/d3d/fe4 zero size 2024-04-22T00:00:09.084 INFO:tasks.workunit.client.0.smithi110.stdout:1/576: rename d1/d2/d1b/d10/f4d to d1/d2/d30/db9/fc2 0 2024-04-22T00:00:09.099 INFO:tasks.workunit.client.0.smithi110.stdout:6/607: link d16/d1e/d24/f71 d16/d3d/fc6 0 2024-04-22T00:00:09.976 INFO:tasks.workunit.client.0.smithi110.stdout:0/629: unlink d0/d25/d5a/d63/c70 0 2024-04-22T00:00:10.038 INFO:tasks.workunit.client.0.smithi110.stdout:5/608: dread d7/d35/f7b [0,4194304] 0 2024-04-22T00:00:10.548 INFO:tasks.workunit.client.0.smithi110.stdout:1/577: mkdir d1/d2/d30/d8b/dc3 0 2024-04-22T00:00:10.584 INFO:tasks.workunit.client.0.smithi110.stdout:1/578: chown d1/dd/d23/d48 208 1 2024-04-22T00:00:10.670 INFO:tasks.workunit.client.0.smithi110.stdout:7/622: link fd d10/d45/d51/d88/d39/fe1 0 2024-04-22T00:00:10.687 INFO:tasks.workunit.client.0.smithi110.stdout:4/549: mkdir d1/dbe 0 2024-04-22T00:00:10.766 INFO:tasks.workunit.client.0.smithi110.stdout:7/623: chown d10/d45/d51/d88/d39/lc0 1050750326 1 2024-04-22T00:00:10.935 INFO:tasks.workunit.client.0.smithi110.stdout:5/609: read f5 [3510996,10427] 0 2024-04-22T00:00:11.266 INFO:tasks.workunit.client.0.smithi110.stdout:8/677: getdents d5/da/d17/d6c/d72/dc4 0 2024-04-22T00:00:11.433 INFO:tasks.workunit.client.0.smithi110.stdout:1/579: creat d1/dd/d23/d48/d4e/d86/fc4 x:0 0 0 2024-04-22T00:00:11.698 INFO:tasks.workunit.client.0.smithi110.stdout:5/610: creat d7/d24/d49/d61/fa6 x:0 0 0 2024-04-22T00:00:11.792 INFO:tasks.workunit.client.0.smithi110.stdout:1/580: rename d1/d2/d14/d16 to d1/d2/d1b/d10/d5c/dc5 0 2024-04-22T00:00:11.927 INFO:tasks.workunit.client.0.smithi110.stdout:8/678: mknod d5/d80/cf1 0 2024-04-22T00:00:12.351 INFO:tasks.workunit.client.0.smithi110.stdout:7/624: link d10/d45/d51/d88/d39/lc0 d10/d45/d51/d88/d46/le2 0 2024-04-22T00:00:12.535 INFO:tasks.workunit.client.0.smithi110.stdout:8/679: dread d5/d4f/d79/fb4 [0,4194304] 0 2024-04-22T00:00:12.618 INFO:tasks.workunit.client.0.smithi110.stdout:2/652: write d9/d25/d1b/d45/d4d/f73 [1295360,1581] 0 2024-04-22T00:00:13.114 INFO:tasks.workunit.client.0.smithi110.stdout:8/680: read d5/d6f/f89 [444276,97163] 0 2024-04-22T00:00:13.180 INFO:tasks.workunit.client.0.smithi110.stdout:9/616: write d1/d29/d2a/d6/d1d/f89 [1153767,114177] 0 2024-04-22T00:00:13.394 INFO:tasks.workunit.client.0.smithi110.stdout:2/653: unlink d9/d1a/d1d/d2b/f9c 0 2024-04-22T00:00:13.445 INFO:tasks.workunit.client.0.smithi110.stdout:2/654: readlink d9/d1a/d1d/d2b/la8 0 2024-04-22T00:00:13.939 INFO:tasks.workunit.client.0.smithi110.stdout:8/681: rename d5/da/d17/d6c/d95/lde to d5/da/d88/dd4/lf2 0 2024-04-22T00:00:14.016 INFO:tasks.workunit.client.0.smithi110.stdout:7/625: creat d10/d45/d51/d88/d39/fe3 x:0 0 0 2024-04-22T00:00:14.083 INFO:tasks.workunit.client.0.smithi110.stdout:0/630: write d0/d14/d23/d3b/f67 [992519,34035] 0 2024-04-22T00:00:14.109 INFO:tasks.workunit.client.0.smithi110.stdout:3/595: dwrite d6/d12/d14/d4b/f5b [0,4194304] 0 2024-04-22T00:00:14.239 INFO:tasks.workunit.client.0.smithi110.stdout:2/655: creat d9/d25/d1b/d45/d8e/fda x:0 0 0 2024-04-22T00:00:14.808 INFO:tasks.workunit.client.0.smithi110.stdout:7/626: creat d10/d45/d60/d5e/d65/da3/fe4 x:0 0 0 2024-04-22T00:00:14.925 INFO:tasks.workunit.client.0.smithi110.stdout:3/596: creat d6/d78/fc5 x:0 0 0 2024-04-22T00:00:15.110 INFO:tasks.workunit.client.0.smithi110.stdout:6/608: dwrite d16/d1d/d38/fbf [0,4194304] 0 2024-04-22T00:00:15.176 INFO:tasks.workunit.client.0.smithi110.stdout:4/550: dwrite d1/d35/db9/f3d [4194304,4194304] 0 2024-04-22T00:00:15.187 INFO:tasks.workunit.client.0.smithi110.stdout:8/682: truncate d5/d24/d33/d3d/fe4 624733 0 2024-04-22T00:00:15.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/631: dread - d0/d16/d42/d50/dbc/fcc zero size 2024-04-22T00:00:15.416 INFO:tasks.workunit.client.0.smithi110.stdout:5/611: dwrite d7/d24/d49/d64/f83 [0,4194304] 0 2024-04-22T00:00:15.625 INFO:tasks.workunit.client.0.smithi110.stdout:3/597: chown d6/c11 7067126 1 2024-04-22T00:00:15.626 INFO:tasks.workunit.client.0.smithi110.stdout:4/551: stat d1/d35/db9/d20/d58/d93/c55 0 2024-04-22T00:00:15.702 INFO:tasks.workunit.client.0.smithi110.stdout:5/612: fdatasync d7/f72 0 2024-04-22T00:00:15.903 INFO:tasks.workunit.client.0.smithi110.stdout:0/632: unlink d0/l1d 0 2024-04-22T00:00:16.163 INFO:tasks.workunit.client.0.smithi110.stdout:6/609: dread d16/d3d/d40/d46/f76 [0,4194304] 0 2024-04-22T00:00:16.272 INFO:tasks.workunit.client.0.smithi110.stdout:9/617: dwrite d1/f7 [4194304,4194304] 0 2024-04-22T00:00:16.451 INFO:tasks.workunit.client.0.smithi110.stdout:6/610: chown d16/d1e/l53 76581488 1 2024-04-22T00:00:16.513 INFO:tasks.workunit.client.0.smithi110.stdout:2/656: truncate d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e 1861816 0 2024-04-22T00:00:16.532 INFO:tasks.workunit.client.0.smithi110.stdout:8/683: truncate d5/d24/d33/d3d/d5c/d6a/fd5 530611 0 2024-04-22T00:00:16.550 INFO:tasks.workunit.client.0.smithi110.stdout:3/598: truncate d6/d12/d16/d30/d9c/f79 2118861 0 2024-04-22T00:00:16.747 INFO:tasks.workunit.client.0.smithi110.stdout:5/613: mkdir d7/d24/d3a/da7 0 2024-04-22T00:00:16.793 INFO:tasks.workunit.client.0.smithi110.stdout:4/552: dread d1/f28 [0,4194304] 0 2024-04-22T00:00:16.845 INFO:tasks.workunit.client.0.smithi110.stdout:5/614: fsync d7/d24/d49/d64/f83 0 2024-04-22T00:00:17.105 INFO:tasks.workunit.client.0.smithi110.stdout:7/627: creat d10/d15/d22/fe5 x:0 0 0 2024-04-22T00:00:17.123 INFO:tasks.workunit.client.0.smithi110.stdout:5/615: sync 2024-04-22T00:00:17.171 INFO:tasks.workunit.client.0.smithi110.stdout:0/633: fsync d0/d16/fa6 0 2024-04-22T00:00:17.451 INFO:tasks.workunit.client.0.smithi110.stdout:3/599: chown d6/c24 354746279 1 2024-04-22T00:00:17.545 INFO:tasks.workunit.client.0.smithi110.stdout:9/618: mknod d1/d29/d2a/d2b/d58/ccc 0 2024-04-22T00:00:17.575 INFO:tasks.workunit.client.0.smithi110.stdout:9/619: readlink d1/d29/d2a/d2b/d58/l65 0 2024-04-22T00:00:17.869 INFO:tasks.workunit.client.0.smithi110.stdout:2/657: fdatasync d9/d25/d1b/d45/d50/d68/fc6 0 2024-04-22T00:00:18.246 INFO:tasks.workunit.client.0.smithi110.stdout:7/628: symlink d10/d45/d60/d5e/d65/le6 0 2024-04-22T00:00:18.319 INFO:tasks.workunit.client.0.smithi110.stdout:0/634: chown d0/d16/d42/fd8 1234 1 2024-04-22T00:00:18.382 INFO:tasks.workunit.client.0.smithi110.stdout:0/635: truncate d0/d14/d23/d3b/f67 2071981 0 2024-04-22T00:00:18.473 INFO:tasks.workunit.client.0.smithi110.stdout:5/616: rename d7/d9/d17/d48/fa0 to d7/d24/d3a/d40/fa8 0 2024-04-22T00:00:18.639 INFO:tasks.workunit.client.0.smithi110.stdout:1/581: rmdir d1/d2/d1b 39 2024-04-22T00:00:18.898 INFO:tasks.workunit.client.0.smithi110.stdout:3/600: chown d6/d12/d14/d4b/la9 4624216 1 2024-04-22T00:00:19.092 INFO:tasks.workunit.client.0.smithi110.stdout:9/620: fdatasync d1/d29/d2a/dc/f67 0 2024-04-22T00:00:19.747 INFO:tasks.workunit.client.0.smithi110.stdout:4/553: truncate d1/d35/db9/f69 1142560 0 2024-04-22T00:00:20.107 INFO:tasks.workunit.client.0.smithi110.stdout:7/629: dread d10/d15/d22/f79 [0,4194304] 0 2024-04-22T00:00:20.594 INFO:tasks.workunit.client.0.smithi110.stdout:1/582: rename d1/d2/d1b/d10/d5c/dc5/d27/d3e to d1/d2/d1b/d10/d5c/dc5/d27/d3e/dc6 22 2024-04-22T00:00:20.660 INFO:tasks.workunit.client.0.smithi110.stdout:3/601: mkdir d6/d12/d16/d6f/db5/db9/dc6 0 2024-04-22T00:00:21.546 INFO:tasks.workunit.client.0.smithi110.stdout:4/554: stat d1/d35/db9/d20/d23/d1c/d40/f63 0 2024-04-22T00:00:21.593 INFO:tasks.workunit.client.0.smithi110.stdout:8/684: dwrite d5/d24/d33/d3d/d5c/fa9 [0,4194304] 0 2024-04-22T00:00:21.787 INFO:tasks.workunit.client.0.smithi110.stdout:4/555: chown d1/d35/db9/d20/d23/d1c/d47/d4f 10894707 1 2024-04-22T00:00:22.581 INFO:tasks.workunit.client.0.smithi110.stdout:1/583: read - d1/dd/d23/d48/d4e/d86/fc4 zero size 2024-04-22T00:00:22.599 INFO:tasks.workunit.client.0.smithi110.stdout:3/602: chown d6/d12/d3c/f68 82381 1 2024-04-22T00:00:22.860 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:08:03.122 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:22.903 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:08:03.100 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:22.909 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:08:03.106 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:22.922 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:08:03.184 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:22.953 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:08:03.151 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:22.957 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:08:03.155 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:23.011 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:08:03.209 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:23.028 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:08:03.290 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:23.040 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:08:03.238 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:00:23.280 INFO:tasks.workunit.client.0.smithi110.stdout:2/658: dwrite d9/d25/d1c/f28 [0,4194304] 0 2024-04-22T00:00:23.461 INFO:tasks.workunit.client.0.smithi110.stdout:3/603: chown d6/d78/fc2 7072995 1 2024-04-22T00:00:23.548 INFO:tasks.workunit.client.0.smithi110.stdout:0/636: write d0/d27/d4b/f54 [1990072,85662] 0 2024-04-22T00:00:23.654 INFO:tasks.workunit.client.0.smithi110.stdout:2/659: fdatasync d9/d25/d1c/f3c 0 2024-04-22T00:00:24.082 INFO:tasks.workunit.client.0.smithi110.stdout:5/617: dwrite d7/f27 [4194304,4194304] 0 2024-04-22T00:00:24.228 INFO:tasks.workunit.client.0.smithi110.stdout:3/604: dread d6/d12/d3c/f95 [0,4194304] 0 2024-04-22T00:00:24.304 INFO:tasks.workunit.client.0.smithi110.stdout:6/611: creat d16/d1e/fc7 x:0 0 0 2024-04-22T00:00:24.357 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-22T00:00:24.363+0000 7fef64506640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.357 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-22T00:00:24.363+0000 7f62aeef5640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.358 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-22T00:00:24.363+0000 7fcec945b640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.358 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-22T00:00:24.363+0000 7fd17b030640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.358 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-22T00:00:24.363+0000 7f6a19e03640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.365 INFO:tasks.ceph.mon.b.smithi154.stderr:2024-04-22T00:00:24.367+0000 a388640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.366 INFO:tasks.ceph.mds.f.smithi154.stderr:2024-04-22T00:00:24.367+0000 b9e7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.366 INFO:tasks.ceph.mds.b.smithi154.stderr:2024-04-22T00:00:24.367+0000 b9e7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.367 INFO:tasks.ceph.mon.b.smithi154.stderr:2024-04-22T00:00:24.367+0000 a388640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-04-22T00:00:24.367 INFO:tasks.ceph.mon.c.smithi154.stderr:2024-04-22T00:00:24.367+0000 a388640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.368 INFO:tasks.ceph.mds.d.smithi154.stderr:2024-04-22T00:00:24.367+0000 b9e7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32428) UID: 0 2024-04-22T00:00:24.368 INFO:tasks.ceph.mon.c.smithi154.stderr:2024-04-22T00:00:24.371+0000 a388640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-04-22T00:00:24.385 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-22T00:00:24.391+0000 7f6a19e03640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.386 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-04-22T00:00:24.391+0000 7fef64506640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.386 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-22T00:00:24.391+0000 7f62aeef5640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.386 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-22T00:00:24.391+0000 7fcec945b640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.387 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-22T00:00:24.391+0000 7fd17b030640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.387 INFO:tasks.ceph.mds.f.smithi154.stderr:2024-04-22T00:00:24.391+0000 b9e7640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.387 INFO:tasks.ceph.mds.b.smithi154.stderr:2024-04-22T00:00:24.391+0000 b9e7640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.388 INFO:tasks.ceph.mon.b.smithi154.stderr:2024-04-22T00:00:24.391+0000 a388640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.388 INFO:tasks.ceph.mon.c.smithi154.stderr:2024-04-22T00:00:24.391+0000 a388640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 32446) UID: 0 2024-04-22T00:00:24.388 INFO:tasks.ceph.mds.d.smithi154.stderr:2024-04-22T00:00:24.391+0000 b9e7640 -1 received signal: Hangup from (PID: 32446) UID: 0 2024-04-22T00:00:24.389 INFO:tasks.ceph.mon.b.smithi154.stderr:2024-04-22T00:00:24.391+0000 a388640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-04-22T00:00:24.389 INFO:tasks.ceph.mon.c.smithi154.stderr:2024-04-22T00:00:24.391+0000 a388640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-04-22T00:00:24.492 INFO:tasks.workunit.client.0.smithi110.stdout:4/556: rename d1/d35/db9/d12/d26 to d1/d35/db9/d20/dbf 0 2024-04-22T00:00:24.591 INFO:tasks.workunit.client.0.smithi110.stdout:2/660: rmdir d9/d1a/d1d/d4a/d6b/d3a 39 2024-04-22T00:00:24.628 INFO:tasks.workunit.client.0.smithi110.stdout:2/661: read d9/d1a/f63 [261663,109529] 0 2024-04-22T00:00:24.790 INFO:tasks.workunit.client.0.smithi110.stdout:3/605: mkdir d6/d12/d16/d30/dc7 0 2024-04-22T00:00:24.814 INFO:tasks.workunit.client.0.smithi110.stdout:3/606: chown d6/d78/f8b 2082 1 2024-04-22T00:00:24.936 INFO:tasks.workunit.client.0.smithi110.stdout:4/557: mkdir d1/d35/db9/d20/dbf/d5f/dc0 0 2024-04-22T00:00:25.401 INFO:tasks.workunit.client.0.smithi110.stdout:7/630: dwrite d10/d15/d22/fcf [0,4194304] 0 2024-04-22T00:00:25.637 INFO:tasks.workunit.client.0.smithi110.stdout:2/662: creat d9/d1a/d1d/d4e/db5/fdb x:0 0 0 2024-04-22T00:00:25.794 INFO:tasks.workunit.client.0.smithi110.stdout:3/607: mkdir d6/d12/da1/dc8 0 2024-04-22T00:00:25.914 INFO:tasks.workunit.client.0.smithi110.stdout:5/618: truncate d7/d22/d5d/f95 3273006 0 2024-04-22T00:00:26.253 INFO:tasks.workunit.client.0.smithi110.stdout:6/612: getdents d16/d1d/d38/d48/d5e/d6a/d70 0 2024-04-22T00:00:26.515 INFO:tasks.workunit.client.0.smithi110.stdout:9/621: write d1/d29/d4d/fb2 [927414,88749] 0 2024-04-22T00:00:26.584 INFO:tasks.workunit.client.0.smithi110.stdout:9/622: read d1/d29/d6f/db4/fa0 [552474,72130] 0 2024-04-22T00:00:26.679 INFO:tasks.workunit.client.0.smithi110.stdout:9/623: stat d1/d29/d2a/d2b/d58/d7b/cc0 0 2024-04-22T00:00:26.761 INFO:tasks.workunit.client.0.smithi110.stdout:7/631: rename d10/d45/d60/lba to d10/d45/d51/d58/le7 0 2024-04-22T00:00:26.990 INFO:tasks.workunit.client.0.smithi110.stdout:2/663: symlink d9/d1a/ldc 0 2024-04-22T00:00:27.105 INFO:tasks.workunit.client.0.smithi110.stdout:8/685: write d5/d4f/d79/dd1/fd6 [3574563,67267] 0 2024-04-22T00:00:27.335 INFO:tasks.workunit.client.0.smithi110.stdout:1/584: link d1/d1d/d57/d91/fa3 d1/fc7 0 2024-04-22T00:00:27.360 INFO:tasks.workunit.client.0.smithi110.stdout:1/585: chown d1/d2/d1b/f35 71572089 1 2024-04-22T00:00:27.806 INFO:tasks.workunit.client.0.smithi110.stdout:4/558: link d1/f3 d1/d35/db9/d20/d23/d1c/d47/d4f/d56/fc1 0 2024-04-22T00:00:28.136 INFO:tasks.workunit.client.0.smithi110.stdout:6/613: mknod d16/d1d/d38/d48/d5e/d6a/db6/cc8 0 2024-04-22T00:00:28.413 INFO:tasks.workunit.client.0.smithi110.stdout:1/586: creat d1/d1d/d57/d91/fc8 x:0 0 0 2024-04-22T00:00:28.439 INFO:tasks.workunit.client.0.smithi110.stdout:1/587: chown d1/dd/d23 310611 1 2024-04-22T00:00:28.486 INFO:tasks.workunit.client.0.smithi110.stdout:1/588: chown d1/d2/d1b/d10/d5c/dc5/d27 15544 1 2024-04-22T00:00:28.608 INFO:tasks.workunit.client.0.smithi110.stdout:4/559: chown d1/d35/db9/d12/l84 0 1 2024-04-22T00:00:28.631 INFO:tasks.workunit.client.0.smithi110.stdout:4/560: chown d1/d35/db9/d20/dbf/db5 4177655 1 2024-04-22T00:00:28.718 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-22T00:00:28.725+0000 7f11bb641640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.719 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-22T00:00:28.725+0000 7f407cf37640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.719 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-22T00:00:28.725+0000 7f7bf1208640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.719 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-22T00:00:28.725+0000 7f95b0152640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.720 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-22T00:00:28.725+0000 7f749d13a640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.725 INFO:tasks.ceph.mds.e.smithi110.stderr:2024-04-22T00:00:28.729+0000 b9e7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.727 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-04-22T00:00:28.729+0000 a388640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.728 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-04-22T00:00:28.729+0000 a388640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-04-22T00:00:28.728 INFO:tasks.ceph.mds.a.smithi110.stderr:2024-04-22T00:00:28.729+0000 b9e7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34508) UID: 0 2024-04-22T00:00:28.744 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-22T00:00:28.749+0000 7f11bb641640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 34509) UID: 0 2024-04-22T00:00:28.744 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-22T00:00:28.749+0000 7f7bf1208640 -1 received signal: Hangup from (PID: 34509) UID: 0 2024-04-22T00:00:28.745 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-22T00:00:28.749+0000 7f95b0152640 -1 received signal: Hangup from (PID: 34509) UID: 0 2024-04-22T00:00:28.745 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-22T00:00:28.749+0000 7f407cf37640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 34509) UID: 0 2024-04-22T00:00:28.745 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-22T00:00:28.749+0000 7f749d13a640 -1 received signal: Hangup from (PID: 34509) UID: 0 2024-04-22T00:00:28.745 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-04-22T00:00:28.749+0000 a388640 -1 received signal: Hangup from (PID: 34509) UID: 0 2024-04-22T00:00:28.746 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-04-22T00:00:28.749+0000 a388640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-04-22T00:00:28.746 INFO:tasks.ceph.mds.e.smithi110.stderr:2024-04-22T00:00:28.749+0000 b9e7640 -1 Fail to open '/proc/34509/cmdline' error = (2) No such file or directory 2024-04-22T00:00:28.746 INFO:tasks.ceph.mds.e.smithi110.stderr:2024-04-22T00:00:28.753+0000 b9e7640 -1 received signal: Hangup from (PID: 34509) UID: 0 2024-04-22T00:00:28.747 INFO:tasks.ceph.mds.a.smithi110.stderr:2024-04-22T00:00:28.749+0000 b9e7640 -1 Fail to open '/proc/34509/cmdline' error = (2) No such file or directory 2024-04-22T00:00:28.747 INFO:tasks.ceph.mds.a.smithi110.stderr:2024-04-22T00:00:28.753+0000 b9e7640 -1 received signal: Hangup from (PID: 34509) UID: 0 2024-04-22T00:00:28.759 INFO:tasks.workunit.client.0.smithi110.stdout:8/686: fdatasync d5/d24/d33/d3d/d82/da8/ff0 0 2024-04-22T00:00:28.792 INFO:tasks.ceph.mds.c.smithi110.stderr:2024-04-22T00:00:28.761+0000 b9e7640 -1 Fail to open '/proc/34508/cmdline' error = (2) No such file or directory 2024-04-22T00:00:28.792 INFO:tasks.ceph.mds.c.smithi110.stderr:2024-04-22T00:00:28.765+0000 b9e7640 -1 received signal: Hangup from (PID: 34508) UID: 0 2024-04-22T00:00:28.820 INFO:tasks.ceph.mds.c.smithi110.stderr:2024-04-22T00:00:28.821+0000 b9e7640 -1 Fail to open '/proc/34509/cmdline' error = (2) No such file or directory 2024-04-22T00:00:28.839 INFO:tasks.ceph.mds.c.smithi110.stderr:2024-04-22T00:00:28.821+0000 b9e7640 -1 received signal: Hangup from (PID: 34509) UID: 0 2024-04-22T00:00:28.846 INFO:tasks.workunit.client.0.smithi110.stdout:1/589: dread d1/d2/d14/f9d [0,4194304] 0 2024-04-22T00:00:28.902 INFO:tasks.workunit.client.0.smithi110.stdout:4/561: creat d1/d35/db9/d20/d23/d1c/dae/fc2 x:0 0 0 2024-04-22T00:00:29.473 INFO:tasks.workunit.client.0.smithi110.stdout:4/562: creat d1/d35/db9/d20/d23/fc3 x:0 0 0 2024-04-22T00:00:29.558 INFO:tasks.workunit.client.0.smithi110.stdout:8/687: truncate d5/da/f4e 1910491 0 2024-04-22T00:00:29.858 INFO:tasks.workunit.client.0.smithi110.stdout:3/608: write d6/d12/d14/d4b/f5b [1932916,53560] 0 2024-04-22T00:00:29.859 INFO:tasks.workunit.client.0.smithi110.stdout:5/619: write d7/d35/f7b [4099245,24385] 0 2024-04-22T00:00:30.380 INFO:tasks.workunit.client.0.smithi110.stdout:8/688: creat d5/da/d17/d6c/d72/da0/ff3 x:0 0 0 2024-04-22T00:00:30.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T00:00:30.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T00:00:30.435 INFO:teuthology.orchestra.run.smithi110.stderr:error: state file /var/lib/logrotate/status is already locked 2024-04-22T00:00:30.435 INFO:teuthology.orchestra.run.smithi110.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-04-22T00:00:30.436 DEBUG:teuthology.orchestra.run:got remote process result: 3 2024-04-22T00:00:30.437 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-04-22T00:00:30.439 INFO:teuthology.orchestra.run.smithi154.stderr:error: state file /var/lib/logrotate/status is already locked 2024-04-22T00:00:30.439 INFO:teuthology.orchestra.run.smithi154.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-04-22T00:00:30.463 INFO:tasks.workunit.client.0.smithi110.stdout:4/563: mkdir d1/d35/db9/d20/dc4 0 2024-04-22T00:00:30.646 INFO:tasks.workunit.client.0.smithi110.stdout:9/624: write d1/d29/d59/f88 [218852,93506] 0 2024-04-22T00:00:30.648 INFO:tasks.workunit.client.0.smithi110.stdout:3/609: read d6/d12/f1a [413842,21126] 0 2024-04-22T00:00:30.762 INFO:tasks.workunit.client.0.smithi110.stdout:5/620: symlink d7/d24/d3a/la9 0 2024-04-22T00:00:30.779 INFO:tasks.workunit.client.0.smithi110.stdout:1/590: link d1/d2/d1b/d10/d5c/d77/l9f d1/d2/d1b/d10/d5c/d77/lc9 0 2024-04-22T00:00:30.796 INFO:tasks.workunit.client.0.smithi110.stdout:7/632: write d10/d45/d60/d5e/f8b [610541,28409] 0 2024-04-22T00:00:30.882 INFO:tasks.workunit.client.0.smithi110.stdout:7/633: readlink la 0 2024-04-22T00:00:30.956 INFO:tasks.workunit.client.0.smithi110.stdout:3/610: dread d6/d12/d3c/f68 [0,4194304] 0 2024-04-22T00:00:31.211 INFO:tasks.workunit.client.0.smithi110.stdout:2/664: dwrite d9/d1a/d1d/d2b/d54/d77/f99 [0,4194304] 0 2024-04-22T00:00:31.313 INFO:tasks.workunit.client.0.smithi110.stdout:6/614: write f4 [5001034,101413] 0 2024-04-22T00:00:31.362 INFO:tasks.workunit.client.0.smithi110.stdout:2/665: read - d9/d1a/d1d/f75 zero size 2024-04-22T00:00:31.922 INFO:tasks.workunit.client.0.smithi110.stdout:1/591: creat d1/d2/d1b/d10/d5c/d77/fca x:0 0 0 2024-04-22T00:00:32.195 INFO:tasks.workunit.client.0.smithi110.stdout:3/611: symlink d6/d12/d14/lc9 0 2024-04-22T00:00:32.436 INFO:tasks.workunit.client.0.smithi110.stdout:4/564: write d1/d35/db9/d12/f65 [218795,30445] 0 2024-04-22T00:00:32.730 INFO:tasks.workunit.client.0.smithi110.stdout:9/625: write d1/d29/d59/f93 [2357618,40050] 0 2024-04-22T00:00:32.850 INFO:tasks.workunit.client.0.smithi110.stdout:0/637: dwrite d0/fc [0,4194304] 0 2024-04-22T00:00:32.970 INFO:tasks.workunit.client.0.smithi110.stdout:8/689: creat d5/da/d17/ff4 x:0 0 0 2024-04-22T00:00:33.263 INFO:tasks.workunit.client.0.smithi110.stdout:5/621: mknod d7/d22/d5b/da5/caa 0 2024-04-22T00:00:34.304 INFO:tasks.workunit.client.0.smithi110.stdout:8/690: creat d5/d24/d33/d3d/d82/ff5 x:0 0 0 2024-04-22T00:00:34.362 INFO:tasks.workunit.client.0.smithi110.stdout:9/626: dread d1/fca [0,4194304] 0 2024-04-22T00:00:34.763 INFO:tasks.workunit.client.0.smithi110.stdout:5/622: dread d7/d9/fd [0,4194304] 0 2024-04-22T00:00:34.809 INFO:tasks.workunit.client.0.smithi110.stdout:8/691: dread d5/da/d17/d6c/d72/d73/d78/f97 [0,4194304] 0 2024-04-22T00:00:34.891 INFO:tasks.workunit.client.0.smithi110.stdout:2/666: creat d9/d25/d1c/fdd x:0 0 0 2024-04-22T00:00:35.162 INFO:tasks.workunit.client.0.smithi110.stdout:9/627: rmdir d1/d29/d4d 39 2024-04-22T00:00:35.171 INFO:tasks.workunit.client.0.smithi110.stdout:7/634: link d10/c48 d10/d45/d51/d88/ce8 0 2024-04-22T00:00:35.190 INFO:tasks.workunit.client.0.smithi110.stdout:3/612: write d6/d12/d16/f39 [485451,55231] 0 2024-04-22T00:00:35.430 INFO:tasks.workunit.client.0.smithi110.stdout:4/565: dwrite d1/d35/db9/d20/fa4 [0,4194304] 0 2024-04-22T00:00:35.533 INFO:tasks.workunit.client.0.smithi110.stdout:5/623: mknod d7/d24/cab 0 2024-04-22T00:00:35.834 INFO:tasks.workunit.client.0.smithi110.stdout:6/615: dwrite d16/d1e/f6c [0,4194304] 0 2024-04-22T00:00:35.974 INFO:tasks.workunit.client.0.smithi110.stdout:0/638: symlink d0/d56/da3/le0 0 2024-04-22T00:00:36.433 INFO:tasks.workunit.client.0.smithi110.stdout:1/592: dwrite d1/d2/f25 [0,4194304] 0 2024-04-22T00:00:36.855 INFO:tasks.workunit.client.0.smithi110.stdout:9/628: read - d1/d29/d4d/f80 zero size 2024-04-22T00:00:36.856 INFO:tasks.workunit.client.0.smithi110.stdout:6/616: dread - d16/d1e/d24/d90/fc4 zero size 2024-04-22T00:00:36.942 INFO:tasks.workunit.client.0.smithi110.stdout:3/613: truncate d6/d12/d16/d6f/fad 1569515 0 2024-04-22T00:00:37.188 INFO:tasks.workunit.client.0.smithi110.stdout:8/692: dwrite d5/d24/d33/d3d/d82/da8/ff0 [0,4194304] 0 2024-04-22T00:00:37.305 INFO:tasks.workunit.client.0.smithi110.stdout:1/593: truncate d1/d1d/f68 773408 0 2024-04-22T00:00:37.474 INFO:tasks.workunit.client.0.smithi110.stdout:6/617: sync 2024-04-22T00:00:37.502 INFO:tasks.workunit.client.0.smithi110.stdout:6/618: stat d16/d1d/d38/d48/d5e/d6a/db6/cc8 0 2024-04-22T00:00:37.768 INFO:tasks.workunit.client.0.smithi110.stdout:5/624: dwrite d7/d24/d31/f45 [0,4194304] 0 2024-04-22T00:00:38.098 INFO:tasks.workunit.client.0.smithi110.stdout:0/639: mknod d0/d16/d42/d50/dbc/dc8/ce1 0 2024-04-22T00:00:38.151 INFO:tasks.workunit.client.0.smithi110.stdout:2/667: write d9/d25/d1b/f62 [429887,61041] 0 2024-04-22T00:00:38.268 INFO:tasks.workunit.client.0.smithi110.stdout:3/614: chown d6/d12/d16/d6f/lba 889 1 2024-04-22T00:00:38.650 INFO:tasks.workunit.client.0.smithi110.stdout:1/594: symlink d1/d2/d14/lcb 0 2024-04-22T00:00:38.916 INFO:tasks.workunit.client.0.smithi110.stdout:7/635: getdents d10/d45/d51/d88/d46/d69/d75 0 2024-04-22T00:00:39.427 INFO:tasks.workunit.client.0.smithi110.stdout:5/625: symlink d7/d9/d17/d48/lac 0 2024-04-22T00:00:39.578 INFO:tasks.workunit.client.0.smithi110.stdout:0/640: truncate d0/d16/f58 615909 0 2024-04-22T00:00:39.718 INFO:tasks.workunit.client.0.smithi110.stdout:2/668: dread - d9/d25/d1b/d45/fb8 zero size 2024-04-22T00:00:39.852 INFO:tasks.workunit.client.0.smithi110.stdout:4/566: getdents d1/d35/db9/d20/d23 0 2024-04-22T00:00:40.051 INFO:tasks.workunit.client.0.smithi110.stdout:3/615: creat d6/d12/d3c/d65/fca x:0 0 0 2024-04-22T00:00:40.163 INFO:tasks.workunit.client.0.smithi110.stdout:8/693: write d5/d6f/f70 [600414,16657] 0 2024-04-22T00:00:41.043 INFO:tasks.workunit.client.0.smithi110.stdout:2/669: dread d9/d1a/d1d/d2b/d5b/f79 [0,4194304] 0 2024-04-22T00:00:41.169 INFO:tasks.workunit.client.0.smithi110.stdout:4/567: rename d1/d35/db9/d20/dbf/f2d to d1/d35/db9/d20/d50/fc5 0 2024-04-22T00:00:41.333 INFO:tasks.workunit.client.0.smithi110.stdout:3/616: symlink d6/d12/d3c/d65/d91/lcb 0 2024-04-22T00:00:41.545 INFO:tasks.workunit.client.0.smithi110.stdout:1/595: unlink d1/d2/d1b/d10/d5c/dc5/d27/l3a 0 2024-04-22T00:00:41.578 INFO:tasks.workunit.client.0.smithi110.stdout:1/596: dread - d1/d2/d14/f64 zero size 2024-04-22T00:00:41.849 INFO:tasks.workunit.client.0.smithi110.stdout:9/629: getdents d1/d19 0 2024-04-22T00:00:42.145 INFO:tasks.workunit.client.0.smithi110.stdout:2/670: creat d9/d25/d1b/d60/fde x:0 0 0 2024-04-22T00:00:42.329 INFO:tasks.workunit.client.0.smithi110.stdout:4/568: dread d1/d35/db9/d20/d23/d1c/d47/d4f/d6a/f77 [0,4194304] 0 2024-04-22T00:00:42.716 INFO:tasks.workunit.client.0.smithi110.stdout:1/597: rename d1/d2/d1b/d10/d5c/dc5/d29 to d1/dd/d23/dcc 0 2024-04-22T00:00:42.754 INFO:tasks.workunit.client.0.smithi110.stdout:1/598: chown d1/d1d/d57/cac 11 1 2024-04-22T00:00:42.782 INFO:tasks.workunit.client.0.smithi110.stdout:7/636: write d10/d45/d51/f85 [1242680,41439] 0 2024-04-22T00:00:42.809 INFO:tasks.workunit.client.0.smithi110.stdout:6/619: link d16/d3d/d97/fa4 d16/fc9 0 2024-04-22T00:00:42.879 INFO:tasks.workunit.client.0.smithi110.stdout:5/626: creat d7/d9/fad x:0 0 0 2024-04-22T00:00:43.240 INFO:tasks.workunit.client.0.smithi110.stdout:2/671: fsync d9/d1a/d1d/d4e/db5/fdb 0 2024-04-22T00:00:45.281 INFO:tasks.workunit.client.0.smithi110.stdout:9/630: dread d1/f7 [0,4194304] 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:2/672: dread - d9/d1a/d1d/d7a/d91/fa3 zero size 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:8/694: write d5/f54 [3277108,39117] 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:0/641: write d0/d14/d23/fc2 [4734861,111338] 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:7/637: readlink d10/d45/d51/d88/d39/d7f/d80/l9a 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:2/673: mknod d9/d25/d1b/d45/d50/d94/cdf 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:2/674: chown d9/d1a/d1d/db4 3144444 1 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:9/631: truncate d1/d29/d2a/dc/f67 357083 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:4/569: rename d1/d35/db9/d20/d23/d1c/f6f to d1/d35/db9/d20/d23/d1c/d47/d4f/fc6 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:4/570: readlink d1/d35/db9/d20/d50/l94 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:2/675: sync 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:0/642: getdents d0/d14/d23/d6d/dde 0 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:0/643: sync 2024-04-22T00:00:45.282 INFO:tasks.workunit.client.0.smithi110.stdout:5/627: creat d7/fae x:0 0 0 2024-04-22T00:00:45.307 INFO:tasks.workunit.client.0.smithi110.stdout:8/695: truncate d5/da/d17/d60/fef 1973293 0 2024-04-22T00:00:45.628 INFO:tasks.workunit.client.0.smithi110.stdout:4/571: truncate d1/d35/db9/d20/d58/d93/d5e/f9a 5715309 0 2024-04-22T00:00:45.724 INFO:tasks.workunit.client.0.smithi110.stdout:6/620: getdents d16/d1d/d38/d48/d5e/d6a/db6 0 2024-04-22T00:00:45.751 INFO:tasks.workunit.client.0.smithi110.stdout:1/599: write d1/d2/d1b/f11 [341873,52953] 0 2024-04-22T00:00:45.857 INFO:tasks.workunit.client.0.smithi110.stdout:0/644: creat d0/d16/d42/d50/dbc/dc8/fe2 x:0 0 0 2024-04-22T00:00:45.923 INFO:tasks.workunit.client.0.smithi110.stdout:3/617: dwrite d6/d12/f8f [0,4194304] 0 2024-04-22T00:00:46.016 INFO:tasks.workunit.client.0.smithi110.stdout:5/628: fdatasync d7/d24/d37/f5f 0 2024-04-22T00:00:46.058 INFO:tasks.workunit.client.0.smithi110.stdout:8/696: fsync d5/da/d17/d7c/feb 0 2024-04-22T00:00:46.114 INFO:tasks.workunit.client.0.smithi110.stdout:5/629: sync 2024-04-22T00:00:46.897 INFO:tasks.workunit.client.0.smithi110.stdout:7/638: dwrite d10/d15/d22/f79 [0,4194304] 0 2024-04-22T00:00:47.066 INFO:tasks.workunit.client.0.smithi110.stdout:4/572: mkdir d1/d35/db9/d20/d23/d1c/d40/dc7 0 2024-04-22T00:00:47.077 INFO:tasks.workunit.client.0.smithi110.stdout:1/600: read - d1/d1d/d57/d91/fa3 zero size 2024-04-22T00:00:47.162 INFO:tasks.workunit.client.0.smithi110.stdout:3/618: rename d6/l41 to d6/d78/lcc 0 2024-04-22T00:00:47.378 INFO:tasks.workunit.client.0.smithi110.stdout:8/697: symlink d5/da/d17/d60/lf6 0 2024-04-22T00:00:47.751 INFO:tasks.workunit.client.0.smithi110.stdout:6/621: mknod d16/d1e/cca 0 2024-04-22T00:00:47.943 INFO:tasks.workunit.client.0.smithi110.stdout:0/645: dread - d0/d25/d5a/fb3 zero size 2024-04-22T00:00:48.045 INFO:tasks.workunit.client.0.smithi110.stdout:4/573: mkdir d1/d35/db9/d20/d23/d1c/d47/d4f/d56/dc8 0 2024-04-22T00:00:48.093 INFO:tasks.workunit.client.0.smithi110.stdout:2/676: write d9/d25/d1c/d82/f9f [893549,17710] 0 2024-04-22T00:00:48.161 INFO:tasks.workunit.client.0.smithi110.stdout:1/601: creat d1/d2/d1b/d10/d5c/dc5/d27/d3e/fcd x:0 0 0 2024-04-22T00:00:48.205 INFO:tasks.workunit.client.0.smithi110.stdout:9/632: dwrite d1/d29/d6f/f8a [0,4194304] 0 2024-04-22T00:00:48.312 INFO:tasks.workunit.client.0.smithi110.stdout:5/630: rename d7/d9/d17/d48/c78 to d7/d35/caf 0 2024-04-22T00:00:48.557 INFO:tasks.workunit.client.0.smithi110.stdout:6/622: mkdir d16/d1d/d38/d48/d5e/d6a/db6/dcb 0 2024-04-22T00:00:49.193 INFO:tasks.workunit.client.0.smithi110.stdout:3/619: truncate d6/d12/d3c/d65/fca 18238 0 2024-04-22T00:00:49.369 INFO:tasks.workunit.client.0.smithi110.stdout:3/620: dread - d6/d12/da1/fb4 zero size 2024-04-22T00:00:49.404 INFO:tasks.workunit.client.0.smithi110.stdout:4/574: dread d1/d35/db9/d20/d23/d1c/d40/f73 [0,4194304] 0 2024-04-22T00:00:49.477 INFO:tasks.workunit.client.0.smithi110.stdout:1/602: creat d1/d2/d30/db9/fce x:0 0 0 2024-04-22T00:00:49.694 INFO:tasks.workunit.client.0.smithi110.stdout:5/631: fsync d7/d24/d31/f81 0 2024-04-22T00:00:50.426 INFO:tasks.workunit.client.0.smithi110.stdout:7/639: dwrite d10/d15/f2e [4194304,4194304] 0 2024-04-22T00:00:50.611 INFO:tasks.workunit.client.0.smithi110.stdout:2/677: creat d9/d1a/d1d/d2b/d5b/dd2/fe0 x:0 0 0 2024-04-22T00:00:50.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/678: chown d9/d25/d1c/da0/fbb 228766 1 2024-04-22T00:00:50.662 INFO:tasks.workunit.client.0.smithi110.stdout:2/679: chown d9/f15 6925363 1 2024-04-22T00:00:50.780 INFO:tasks.workunit.client.0.smithi110.stdout:1/603: symlink d1/d1d/d57/d91/lcf 0 2024-04-22T00:00:51.126 INFO:tasks.workunit.client.0.smithi110.stdout:8/698: write d5/f6 [257868,76127] 0 2024-04-22T00:00:51.211 INFO:tasks.workunit.client.0.smithi110.stdout:8/699: stat d5/d24/d33/d3d 0 2024-04-22T00:00:51.466 INFO:tasks.workunit.client.0.smithi110.stdout:7/640: symlink d10/d45/d51/d88/d39/d7f/d80/d53/le9 0 2024-04-22T00:00:51.522 INFO:tasks.workunit.client.0.smithi110.stdout:8/700: sync 2024-04-22T00:00:51.747 INFO:tasks.workunit.client.0.smithi110.stdout:1/604: symlink d1/dd/d23/dcc/ld0 0 2024-04-22T00:00:52.034 INFO:tasks.workunit.client.0.smithi110.stdout:9/633: write d1/d29/d2a/d6/f41 [3315415,52519] 0 2024-04-22T00:00:52.656 INFO:tasks.workunit.client.0.smithi110.stdout:0/646: write d0/d2a/fc3 [994864,80452] 0 2024-04-22T00:00:52.660 INFO:tasks.workunit.client.0.smithi110.stdout:3/621: link d6/d12/d16/d30/d9c/c85 d6/d12/da1/dc8/ccd 0 2024-04-22T00:00:52.707 INFO:tasks.workunit.client.0.smithi110.stdout:1/605: mknod d1/d1d/d70/cd1 0 2024-04-22T00:00:52.795 INFO:tasks.workunit.client.0.smithi110.stdout:9/634: chown d1/d29/d2a/dc/f67 97905 1 2024-04-22T00:00:53.121 INFO:tasks.workunit.client.0.smithi110.stdout:8/701: symlink d5/d6f/dca/lf7 0 2024-04-22T00:00:53.338 INFO:tasks.workunit.client.0.smithi110.stdout:2/680: creat d9/d25/d1b/d45/d4d/fe1 x:0 0 0 2024-04-22T00:00:53.358 INFO:tasks.workunit.client.0.smithi110.stdout:5/632: getdents d7/d24/d49/d61 0 2024-04-22T00:00:53.674 INFO:tasks.workunit.client.0.smithi110.stdout:4/575: dwrite d1/d35/db9/d20/d50/f70 [0,4194304] 0 2024-04-22T00:00:53.796 INFO:tasks.workunit.client.0.smithi110.stdout:3/622: creat d6/d12/d16/d30/d9c/fce x:0 0 0 2024-04-22T00:00:53.840 INFO:tasks.workunit.client.0.smithi110.stdout:1/606: dread - d1/d1d/d4a/fb0 zero size 2024-04-22T00:00:53.871 INFO:tasks.workunit.client.0.smithi110.stdout:0/647: dread d0/d25/d5a/fc7 [0,4194304] 0 2024-04-22T00:00:54.051 INFO:tasks.workunit.client.0.smithi110.stdout:4/576: chown d1/d35/db9/d20/d23/d1c/dae 89 1 2024-04-22T00:00:54.102 INFO:tasks.workunit.client.0.smithi110.stdout:6/623: dwrite d16/d1d/f5a [0,4194304] 0 2024-04-22T00:00:54.638 INFO:tasks.workunit.client.0.smithi110.stdout:7/641: dwrite d10/d45/d60/d5e/d65/da3/fac [0,4194304] 0 2024-04-22T00:00:54.722 INFO:tasks.workunit.client.0.smithi110.stdout:3/623: symlink d6/d12/d3c/d8d/lcf 0 2024-04-22T00:00:54.743 INFO:tasks.workunit.client.0.smithi110.stdout:1/607: symlink d1/dd/d23/d48/ld2 0 2024-04-22T00:00:54.814 INFO:tasks.workunit.client.0.smithi110.stdout:0/648: symlink d0/d25/d5a/le3 0 2024-04-22T00:00:55.370 INFO:tasks.workunit.client.0.smithi110.stdout:6/624: dread d16/f63 [0,4194304] 0 2024-04-22T00:00:55.549 INFO:tasks.workunit.client.0.smithi110.stdout:8/702: link d5/d24/d33/d3d/c57 d5/da/d17/d6c/d95/cf8 0 2024-04-22T00:00:55.784 INFO:tasks.workunit.client.0.smithi110.stdout:1/608: fsync d1/d2/d1b/d10/fb5 0 2024-04-22T00:00:55.987 INFO:tasks.workunit.client.0.smithi110.stdout:9/635: write d1/d29/d2a/d6/f27 [4941608,29639] 0 2024-04-22T00:00:56.042 INFO:tasks.workunit.client.0.smithi110.stdout:0/649: chown d0/d27/c39 172619 1 2024-04-22T00:00:56.100 INFO:tasks.workunit.client.0.smithi110.stdout:9/636: dread - d1/d29/d2a/d2b/d58/da8/fbc zero size 2024-04-22T00:00:56.392 INFO:tasks.workunit.client.0.smithi110.stdout:2/681: creat d9/d25/d1b/d45/d4d/fe2 x:0 0 0 2024-04-22T00:00:56.586 INFO:tasks.workunit.client.0.smithi110.stdout:8/703: truncate d5/d24/d33/d3d/d82/da8/ff0 859935 0 2024-04-22T00:00:56.657 INFO:tasks.workunit.client.0.smithi110.stdout:5/633: dwrite d7/d9/d17/d48/d69/f8d [0,4194304] 0 2024-04-22T00:00:56.994 INFO:tasks.workunit.client.0.smithi110.stdout:7/642: creat d10/d45/d51/d88/d39/d7f/dd6/fea x:0 0 0 2024-04-22T00:00:57.037 INFO:tasks.workunit.client.0.smithi110.stdout:7/643: chown d10/d45/d51/c62 26 1 2024-04-22T00:00:57.785 INFO:tasks.workunit.client.0.smithi110.stdout:2/682: rmdir d9/d25/d1b/d45/d50/dc8 39 2024-04-22T00:00:58.390 INFO:tasks.workunit.client.0.smithi110.stdout:8/704: dwrite d5/f6 [0,4194304] 0 2024-04-22T00:00:58.697 INFO:tasks.workunit.client.0.smithi110.stdout:6/625: rmdir d16/d1d/d38/d48/d5e/d6a/db6/dcb 0 2024-04-22T00:00:58.778 INFO:tasks.workunit.client.0.smithi110.stdout:4/577: write d1/f3 [6424372,100549] 0 2024-04-22T00:00:58.899 INFO:tasks.workunit.client.0.smithi110.stdout:2/683: dread d9/d25/d1b/d45/d4d/f73 [0,4194304] 0 2024-04-22T00:00:58.899 INFO:tasks.workunit.client.0.smithi110.stdout:4/578: chown d1/d35/d6b/l6c 6983552 1 2024-04-22T00:00:59.055 INFO:tasks.workunit.client.0.smithi110.stdout:7/644: unlink d10/d45/d51/d88/d39/ca9 0 2024-04-22T00:00:59.279 INFO:tasks.workunit.client.0.smithi110.stdout:8/705: mknod d5/d6f/cf9 0 2024-04-22T00:00:59.316 INFO:tasks.workunit.client.0.smithi110.stdout:8/706: dread - d5/da/d17/d6c/d7d/f9a zero size 2024-04-22T00:00:59.389 INFO:tasks.workunit.client.0.smithi110.stdout:2/684: sync 2024-04-22T00:00:59.428 INFO:tasks.workunit.client.0.smithi110.stdout:3/624: symlink d6/ld0 0 2024-04-22T00:00:59.489 INFO:tasks.workunit.client.0.smithi110.stdout:3/625: sync 2024-04-22T00:00:59.588 INFO:tasks.workunit.client.0.smithi110.stdout:7/645: mkdir d10/d45/d60/d5e/d65/d8a/deb 0 2024-04-22T00:00:59.784 INFO:tasks.workunit.client.0.smithi110.stdout:1/609: dwrite d1/d2/d1b/d10/d5c/dc5/d27/fbf [0,4194304] 0 2024-04-22T00:01:00.014 INFO:tasks.workunit.client.0.smithi110.stdout:0/650: write d0/d27/d68/fd5 [299125,27064] 0 2024-04-22T00:01:00.051 INFO:tasks.workunit.client.0.smithi110.stdout:9/637: write d1/d29/d4d/f80 [323723,7656] 0 2024-04-22T00:01:00.193 INFO:tasks.workunit.client.0.smithi110.stdout:9/638: dread d1/fca [0,4194304] 0 2024-04-22T00:01:00.326 INFO:tasks.workunit.client.0.smithi110.stdout:9/639: dread d1/fca [0,4194304] 0 2024-04-22T00:01:00.339 INFO:tasks.workunit.client.0.smithi110.stdout:2/685: mkdir d9/d1a/d1d/d4e/de3 0 2024-04-22T00:01:00.856 INFO:tasks.workunit.client.0.smithi110.stdout:7/646: dread d10/d43/f8c [0,4194304] 0 2024-04-22T00:01:00.900 INFO:tasks.workunit.client.0.smithi110.stdout:0/651: mknod d0/d14/d23/d6d/ce4 0 2024-04-22T00:01:01.150 INFO:tasks.workunit.client.0.smithi110.stdout:5/634: write d7/d24/d31/f45 [829018,63207] 0 2024-04-22T00:01:01.710 INFO:tasks.workunit.client.0.smithi110.stdout:7/647: mknod d10/d45/d51/d88/dce/cec 0 2024-04-22T00:01:01.778 INFO:tasks.workunit.client.0.smithi110.stdout:6/626: write d16/d1d/d38/d48/d5e/d6a/f9e [614794,126640] 0 2024-04-22T00:01:01.784 INFO:tasks.workunit.client.0.smithi110.stdout:4/579: write d1/d35/db9/d20/d23/d1c/dae/fb4 [911244,81386] 0 2024-04-22T00:01:01.806 INFO:tasks.workunit.client.0.smithi110.stdout:5/635: dread - d7/d24/d37/d38/fa1 zero size 2024-04-22T00:01:01.809 INFO:tasks.workunit.client.0.smithi110.stdout:8/707: write d5/d6f/f89 [28676,15026] 0 2024-04-22T00:01:01.881 INFO:tasks.workunit.client.0.smithi110.stdout:7/648: readlink d10/d15/d22/d2c/l3c 0 2024-04-22T00:01:01.966 INFO:tasks.workunit.client.0.smithi110.stdout:4/580: chown d1/d35/db9/d20/d23/d1c/dae/fb4 44140 1 2024-04-22T00:01:02.075 INFO:tasks.workunit.client.0.smithi110.stdout:3/626: link d6/d12/d14/f60 d6/d78/fd1 0 2024-04-22T00:01:02.112 INFO:tasks.workunit.client.0.smithi110.stdout:1/610: getdents d1/d2/d1b/da7 0 2024-04-22T00:01:02.262 INFO:tasks.workunit.client.0.smithi110.stdout:5/636: dwrite d7/d9/d17/d48/d69/f8d [4194304,4194304] 0 2024-04-22T00:01:02.596 INFO:tasks.workunit.client.0.smithi110.stdout:6/627: mknod d16/d1d/d38/d48/d5e/d62/d94/ccc 0 2024-04-22T00:01:02.743 INFO:tasks.workunit.client.0.smithi110.stdout:7/649: creat d10/d45/d51/d88/d46/d69/d75/fed x:0 0 0 2024-04-22T00:01:02.843 INFO:tasks.workunit.client.0.smithi110.stdout:2/686: write f1 [2039090,12735] 0 2024-04-22T00:01:03.018 INFO:tasks.workunit.client.0.smithi110.stdout:1/611: fsync d1/dd/d23/d48/fa8 0 2024-04-22T00:01:03.074 INFO:tasks.workunit.client.0.smithi110.stdout:9/640: dwrite d1/f15 [0,4194304] 0 2024-04-22T00:01:03.348 INFO:tasks.workunit.client.0.smithi110.stdout:5/637: rmdir d7/d22/d5b 39 2024-04-22T00:01:03.462 INFO:tasks.workunit.client.0.smithi110.stdout:6/628: rmdir d16/d1d/d38/dab 39 2024-04-22T00:01:03.491 INFO:tasks.workunit.client.0.smithi110.stdout:6/629: read ff [203648,83682] 0 2024-04-22T00:01:03.558 INFO:tasks.workunit.client.0.smithi110.stdout:0/652: getdents d0/d27/d68/d7d 0 2024-04-22T00:01:03.975 INFO:tasks.workunit.client.0.smithi110.stdout:3/627: symlink d6/d12/da1/dc8/ld2 0 2024-04-22T00:01:04.602 INFO:tasks.workunit.client.0.smithi110.stdout:6/630: stat d16/l37 0 2024-04-22T00:01:04.801 INFO:tasks.workunit.client.0.smithi110.stdout:9/641: dread d1/d29/d2a/d6/fa9 [0,4194304] 0 2024-04-22T00:01:04.827 INFO:tasks.workunit.client.0.smithi110.stdout:8/708: dwrite d5/d4f/d79/fb4 [0,4194304] 0 2024-04-22T00:01:05.010 INFO:tasks.workunit.client.0.smithi110.stdout:3/628: mkdir d6/d12/d16/d6f/db5/dd3 0 2024-04-22T00:01:05.102 INFO:tasks.workunit.client.0.smithi110.stdout:5/638: mknod d7/d9/cb0 0 2024-04-22T00:01:05.160 INFO:tasks.workunit.client.0.smithi110.stdout:0/653: dread d0/d25/d5a/d63/f77 [0,4194304] 0 2024-04-22T00:01:05.181 INFO:tasks.workunit.client.0.smithi110.stdout:5/639: read d7/d24/d31/f45 [3917790,33493] 0 2024-04-22T00:01:05.331 INFO:tasks.workunit.client.0.smithi110.stdout:6/631: mknod d16/d1d/d38/d48/d5e/d6a/d70/ccd 0 2024-04-22T00:01:05.521 INFO:tasks.workunit.client.0.smithi110.stdout:8/709: creat d5/da/d88/dd4/ffa x:0 0 0 2024-04-22T00:01:05.550 INFO:tasks.workunit.client.0.smithi110.stdout:7/650: write d10/d45/d51/db1/fcd [954454,32185] 0 2024-04-22T00:01:05.635 INFO:tasks.workunit.client.0.smithi110.stdout:3/629: rmdir d6/d12/da1 39 2024-04-22T00:01:05.659 INFO:tasks.workunit.client.0.smithi110.stdout:4/581: write d1/d35/db9/f4b [2257670,76713] 0 2024-04-22T00:01:05.832 INFO:tasks.workunit.client.0.smithi110.stdout:9/642: mknod d1/ccd 0 2024-04-22T00:01:05.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/582: chown d1/d35/db9/d12/f19 28 1 2024-04-22T00:01:05.895 INFO:tasks.workunit.client.0.smithi110.stdout:2/687: dwrite d9/d1a/d7b/fc3 [0,4194304] 0 2024-04-22T00:01:06.051 INFO:tasks.workunit.client.0.smithi110.stdout:6/632: truncate d16/d3d/d40/f77 154271 0 2024-04-22T00:01:06.055 INFO:tasks.workunit.client.0.smithi110.stdout:6/633: chown d16/d3d 63 1 2024-04-22T00:01:06.565 INFO:tasks.workunit.client.0.smithi110.stdout:1/612: write d1/d2/d1b/d10/fb5 [964063,23784] 0 2024-04-22T00:01:06.647 INFO:tasks.workunit.client.0.smithi110.stdout:0/654: write d0/d14/f6e [4571728,51836] 0 2024-04-22T00:01:06.896 INFO:tasks.workunit.client.0.smithi110.stdout:5/640: symlink d7/d22/d5b/lb1 0 2024-04-22T00:01:07.081 INFO:tasks.workunit.client.0.smithi110.stdout:8/710: write d5/d24/d33/d3d/d5c/fa9 [2987133,39993] 0 2024-04-22T00:01:07.125 INFO:tasks.workunit.client.0.smithi110.stdout:9/643: dread d1/d29/d6f/f8a [0,4194304] 0 2024-04-22T00:01:07.154 INFO:tasks.workunit.client.0.smithi110.stdout:8/711: readlink d5/da/d17/d7c/dc0/lc8 0 2024-04-22T00:01:07.340 INFO:tasks.workunit.client.0.smithi110.stdout:7/651: truncate fd 486463 0 2024-04-22T00:01:07.618 INFO:tasks.workunit.client.0.smithi110.stdout:2/688: mknod d9/ce4 0 2024-04-22T00:01:07.646 INFO:tasks.workunit.client.0.smithi110.stdout:9/644: chown d1/d29/c9e 3 1 2024-04-22T00:01:08.042 INFO:tasks.workunit.client.0.smithi110.stdout:1/613: dwrite d1/dd/fb3 [0,4194304] 0 2024-04-22T00:01:08.172 INFO:tasks.workunit.client.0.smithi110.stdout:7/652: mkdir d10/d45/d51/db1/dee 0 2024-04-22T00:01:08.190 INFO:tasks.workunit.client.0.smithi110.stdout:5/641: write d7/d24/d49/f99 [894224,26350] 0 2024-04-22T00:01:08.224 INFO:tasks.workunit.client.0.smithi110.stdout:1/614: readlink d1/d2/d1b/da7/lbc 0 2024-04-22T00:01:08.307 INFO:tasks.workunit.client.0.smithi110.stdout:0/655: dwrite d0/d14/f1c [0,4194304] 0 2024-04-22T00:01:08.380 INFO:tasks.workunit.client.0.smithi110.stdout:0/656: readlink d0/d56/da3/le0 0 2024-04-22T00:01:08.794 INFO:tasks.workunit.client.0.smithi110.stdout:6/634: write d16/d1d/f4a [187190,112843] 0 2024-04-22T00:01:09.061 INFO:tasks.workunit.client.0.smithi110.stdout:8/712: dwrite d5/da/d17/d6c/d72/d73/d78/f9f [0,4194304] 0 2024-04-22T00:01:09.269 INFO:tasks.workunit.client.0.smithi110.stdout:8/713: chown d5/da/d17/d6c/d7d/c61 0 1 2024-04-22T00:01:09.303 INFO:tasks.workunit.client.0.smithi110.stdout:9/645: dread d1/d29/f2e [0,4194304] 0 2024-04-22T00:01:09.355 INFO:tasks.workunit.client.0.smithi110.stdout:9/646: chown d1/d29/d2a/d2b/f7f 3 1 2024-04-22T00:01:09.460 INFO:tasks.workunit.client.0.smithi110.stdout:5/642: fsync d7/d9/f3d 0 2024-04-22T00:01:09.656 INFO:tasks.workunit.client.0.smithi110.stdout:1/615: fsync d1/d2/d1b/f13 0 2024-04-22T00:01:10.260 INFO:tasks.workunit.client.0.smithi110.stdout:6/635: dread d16/d1d/d38/fbf [0,4194304] 0 2024-04-22T00:01:10.386 INFO:tasks.workunit.client.0.smithi110.stdout:2/689: mkdir d9/d25/de5 0 2024-04-22T00:01:10.497 INFO:tasks.workunit.client.0.smithi110.stdout:8/714: symlink d5/da/d17/d6c/d72/d73/d78/d8c/lfb 0 2024-04-22T00:01:10.742 INFO:tasks.workunit.client.0.smithi110.stdout:5/643: truncate d7/d24/d31/f81 3960328 0 2024-04-22T00:01:10.774 INFO:tasks.workunit.client.0.smithi110.stdout:5/644: chown d7/d9/d17/d48/lac 110 1 2024-04-22T00:01:10.839 INFO:tasks.workunit.client.0.smithi110.stdout:7/653: symlink d10/d45/d51/d88/lef 0 2024-04-22T00:01:11.289 INFO:tasks.workunit.client.0.smithi110.stdout:6/636: mknod d16/d1d/d38/dae/cce 0 2024-04-22T00:01:11.431 INFO:tasks.workunit.client.0.smithi110.stdout:4/583: rename d1/d35/db9/d20/d23/d1c/d47/d4f/d56/fc1 to d1/d35/db9/d20/fc9 0 2024-04-22T00:01:11.973 INFO:tasks.workunit.client.0.smithi110.stdout:5/645: fdatasync d7/d24/d37/d38/d88/f8b 0 2024-04-22T00:01:11.980 INFO:tasks.workunit.client.0.smithi110.stdout:7/654: truncate d10/d27/f82 3552715 0 2024-04-22T00:01:11.999 INFO:tasks.workunit.client.0.smithi110.stdout:0/657: link d0/d25/d5a/fb6 d0/d56/dc9/fe5 0 2024-04-22T00:01:12.119 INFO:tasks.workunit.client.0.smithi110.stdout:6/637: creat d16/d1e/d24/d90/dac/fcf x:0 0 0 2024-04-22T00:01:12.307 INFO:tasks.workunit.client.0.smithi110.stdout:3/630: rename d6/d12/d16/d6f/lba to d6/d12/d3c/d65/ld4 0 2024-04-22T00:01:12.506 INFO:tasks.workunit.client.0.smithi110.stdout:8/715: link d5/d4f/d79/fb4 d5/da/d17/d6c/d72/d73/ffc 0 2024-04-22T00:01:13.047 INFO:tasks.workunit.client.0.smithi110.stdout:9/647: dwrite d1/d29/d2a/d6/d1d/f24 [0,4194304] 0 2024-04-22T00:01:13.325 INFO:tasks.workunit.client.0.smithi110.stdout:0/658: mkdir d0/d56/da3/de6 0 2024-04-22T00:01:13.582 INFO:tasks.workunit.client.0.smithi110.stdout:6/638: unlink d16/d1e/d24/d33/f44 0 2024-04-22T00:01:13.687 INFO:tasks.workunit.client.0.smithi110.stdout:2/690: creat d9/d25/d1c/fe6 x:0 0 0 2024-04-22T00:01:13.744 INFO:tasks.workunit.client.0.smithi110.stdout:2/691: readlink d9/d1a/d7b/lba 0 2024-04-22T00:01:13.987 INFO:tasks.workunit.client.0.smithi110.stdout:1/616: write d1/d2/d1b/d10/d5c/d77/fca [588327,125864] 0 2024-04-22T00:01:14.585 INFO:tasks.workunit.client.0.smithi110.stdout:6/639: fdatasync d16/d1e/f57 0 2024-04-22T00:01:15.162 INFO:tasks.workunit.client.0.smithi110.stdout:4/584: write d1/d35/db9/d20/d23/d1c/d40/f73 [2531878,25494] 0 2024-04-22T00:01:15.984 INFO:tasks.workunit.client.0.smithi110.stdout:7/655: dwrite f9 [8388608,4194304] 0 2024-04-22T00:01:16.095 INFO:tasks.workunit.client.0.smithi110.stdout:7/656: dread - d10/d43/f91 zero size 2024-04-22T00:01:16.803 INFO:tasks.workunit.client.0.smithi110.stdout:3/631: dwrite d6/d12/d16/d30/d9c/f97 [0,4194304] 0 2024-04-22T00:01:16.965 INFO:tasks.workunit.client.0.smithi110.stdout:2/692: write d9/d25/d1b/d45/d4d/fe1 [198725,32759] 0 2024-04-22T00:01:17.602 INFO:tasks.workunit.client.0.smithi110.stdout:5/646: rename d7/d24/f56 to d7/d24/d3a/d54/fb2 0 2024-04-22T00:01:17.615 INFO:tasks.workunit.client.0.smithi110.stdout:7/657: write d10/d45/d51/d88/fb3 [302951,130798] 0 2024-04-22T00:01:17.685 INFO:tasks.workunit.client.0.smithi110.stdout:9/648: dwrite d1/d29/d6f/db4/fc9 [0,4194304] 0 2024-04-22T00:01:17.815 INFO:tasks.workunit.client.0.smithi110.stdout:3/632: symlink d6/d12/d3c/d65/d91/ld5 0 2024-04-22T00:01:17.963 INFO:tasks.workunit.client.0.smithi110.stdout:0/659: dwrite d0/d14/f5f [0,4194304] 0 2024-04-22T00:01:18.016 INFO:tasks.workunit.client.0.smithi110.stdout:8/716: dwrite d5/da/d17/d7c/f7e [0,4194304] 0 2024-04-22T00:01:18.216 INFO:tasks.workunit.client.0.smithi110.stdout:4/585: rename d1/d35/db9/d20/d23/d1c/d40/dc7 to d1/d35/db9/d20/d23/d1c/d47/d4f/d6a/dca 0 2024-04-22T00:01:18.268 INFO:tasks.workunit.client.0.smithi110.stdout:1/617: dwrite d1/dd/d23/f96 [0,4194304] 0 2024-04-22T00:01:18.284 INFO:tasks.workunit.client.0.smithi110.stdout:2/693: mkdir d9/d1a/d1d/d2b/d5b/dd2/de7 0 2024-04-22T00:01:18.516 INFO:tasks.workunit.client.0.smithi110.stdout:0/660: chown d0/d56/c7c 16374443 1 2024-04-22T00:01:18.576 INFO:tasks.workunit.client.0.smithi110.stdout:6/640: dwrite d16/d1e/d24/f4e [4194304,4194304] 0 2024-04-22T00:01:18.712 INFO:tasks.workunit.client.0.smithi110.stdout:4/586: chown d1/d35/db9/d20/d23/d1c/dae/fc2 96596 1 2024-04-22T00:01:19.008 INFO:tasks.workunit.client.0.smithi110.stdout:1/618: dread d1/d1d/d57/fb8 [0,4194304] 0 2024-04-22T00:01:19.074 INFO:tasks.workunit.client.0.smithi110.stdout:9/649: truncate d1/d29/d4d/f80 795071 0 2024-04-22T00:01:19.107 INFO:tasks.workunit.client.0.smithi110.stdout:8/717: rename d5/d24/d33/d84 to d5/d24/d33/d3d/dfd 0 2024-04-22T00:01:19.123 INFO:tasks.workunit.client.0.smithi110.stdout:2/694: truncate d9/d1a/f1e 1353483 0 2024-04-22T00:01:19.245 INFO:tasks.workunit.client.0.smithi110.stdout:3/633: truncate d6/d12/d16/d30/d67/f93 497734 0 2024-04-22T00:01:20.037 INFO:tasks.workunit.client.0.smithi110.stdout:5/647: write d7/d24/d3a/d40/f57 [1569012,126328] 0 2024-04-22T00:01:20.175 INFO:tasks.workunit.client.0.smithi110.stdout:7/658: dwrite d10/d45/d51/d88/f74 [0,4194304] 0 2024-04-22T00:01:20.817 INFO:tasks.workunit.client.0.smithi110.stdout:0/661: creat d0/d14/d23/fe7 x:0 0 0 2024-04-22T00:01:20.939 INFO:tasks.workunit.client.0.smithi110.stdout:8/718: symlink d5/d4f/lfe 0 2024-04-22T00:01:21.104 INFO:tasks.workunit.client.0.smithi110.stdout:2/695: mkdir d9/d1a/d1d/de8 0 2024-04-22T00:01:21.236 INFO:tasks.workunit.client.0.smithi110.stdout:5/648: symlink d7/d22/d5b/lb3 0 2024-04-22T00:01:21.660 INFO:tasks.workunit.client.0.smithi110.stdout:4/587: creat d1/d35/db9/d20/d58/fcb x:0 0 0 2024-04-22T00:01:21.680 INFO:tasks.workunit.client.0.smithi110.stdout:6/641: write d16/d1d/d38/d48/d5e/d62/fad [837294,19774] 0 2024-04-22T00:01:21.713 INFO:tasks.workunit.client.0.smithi110.stdout:1/619: link d1/d2/d14/f64 d1/d2/d1b/d10/d5c/d77/fd3 0 2024-04-22T00:01:21.971 INFO:tasks.workunit.client.0.smithi110.stdout:8/719: dread d5/d24/d33/d3d/d5c/d6a/fd5 [0,4194304] 0 2024-04-22T00:01:22.115 INFO:tasks.workunit.client.0.smithi110.stdout:2/696: creat d9/d1a/d7b/fe9 x:0 0 0 2024-04-22T00:01:22.525 INFO:tasks.workunit.client.0.smithi110.stdout:0/662: creat d0/d27/d4b/da0/db1/fe8 x:0 0 0 2024-04-22T00:01:22.596 INFO:tasks.workunit.client.0.smithi110.stdout:9/650: dwrite d1/d19/d42/f82 [0,4194304] 0 2024-04-22T00:01:22.601 INFO:tasks.workunit.client.0.smithi110.stdout:2/697: chown d9/d1a/d1d/d2b/d5b/dd2/de7 0 1 2024-04-22T00:01:22.746 INFO:tasks.workunit.client.0.smithi110.stdout:5/649: dread d7/d35/f96 [0,4194304] 0 2024-04-22T00:01:22.826 INFO:tasks.workunit.client.0.smithi110.stdout:1/620: dread d1/d2/d30/db9/fc2 [0,4194304] 0 2024-04-22T00:01:22.849 INFO:tasks.workunit.client.0.smithi110.stdout:8/720: mknod d5/d80/cff 0 2024-04-22T00:01:22.871 INFO:tasks.workunit.client.0.smithi110.stdout:6/642: unlink d16/d1d/d38/l6f 0 2024-04-22T00:01:22.888 INFO:tasks.workunit.client.0.smithi110.stdout:9/651: dread d1/d29/d2a/dc/f67 [0,4194304] 0 2024-04-22T00:01:22.954 INFO:tasks.workunit.client.0.smithi110.stdout:0/663: mknod d0/d16/d5d/ce9 0 2024-04-22T00:01:23.045 INFO:tasks.workunit.client.0.smithi110.stdout:4/588: creat d1/d35/db9/fcc x:0 0 0 2024-04-22T00:01:23.178 INFO:tasks.workunit.client.0.smithi110.stdout:3/634: dwrite d6/d12/d16/d30/d9c/f79 [0,4194304] 0 2024-04-22T00:01:23.221 INFO:tasks.workunit.client.0.smithi110.stdout:2/698: sync 2024-04-22T00:01:23.257 INFO:tasks.workunit.client.0.smithi110.stdout:9/652: sync 2024-04-22T00:01:23.430 INFO:tasks.workunit.client.0.smithi110.stdout:8/721: mkdir d5/da/d17/d6c/d95/d100 0 2024-04-22T00:01:23.460 INFO:tasks.workunit.client.0.smithi110.stdout:1/621: mknod d1/d2/d1b/d10/d5c/d77/cd4 0 2024-04-22T00:01:23.515 INFO:tasks.workunit.client.0.smithi110.stdout:2/699: dread d9/d1a/f63 [0,4194304] 0 2024-04-22T00:01:23.622 INFO:tasks.workunit.client.0.smithi110.stdout:7/659: dwrite d10/d45/d60/d5e/d65/da3/fb5 [4194304,4194304] 0 2024-04-22T00:01:23.754 INFO:tasks.workunit.client.0.smithi110.stdout:2/700: chown d9/d25/d1b/d45/c65 57787209 1 2024-04-22T00:01:24.168 INFO:tasks.workunit.client.0.smithi110.stdout:4/589: mkdir d1/d35/db9/d20/d23/d1c/d47/d95/dcd 0 2024-04-22T00:01:24.238 INFO:tasks.workunit.client.0.smithi110.stdout:8/722: creat d5/da/d88/dd4/f101 x:0 0 0 2024-04-22T00:01:24.287 INFO:tasks.workunit.client.0.smithi110.stdout:4/590: chown d1/f5 342610728 1 2024-04-22T00:01:24.347 INFO:tasks.workunit.client.0.smithi110.stdout:1/622: symlink d1/dd/d23/d48/d4e/d86/ld5 0 2024-04-22T00:01:25.019 INFO:tasks.workunit.client.0.smithi110.stdout:3/635: creat d6/d12/d16/d6f/db5/dd3/fd6 x:0 0 0 2024-04-22T00:01:25.075 INFO:tasks.workunit.client.0.smithi110.stdout:5/650: dwrite d7/d24/d3a/d54/fa3 [0,4194304] 0 2024-04-22T00:01:25.456 INFO:tasks.workunit.client.0.smithi110.stdout:6/643: rename d16/d1d/d38/dae to d16/d3d/d97/dd0 0 2024-04-22T00:01:25.535 INFO:tasks.workunit.client.0.smithi110.stdout:8/723: dread d5/da/d17/d60/fc1 [0,4194304] 0 2024-04-22T00:01:25.590 INFO:tasks.workunit.client.0.smithi110.stdout:0/664: write d0/d16/d42/fd8 [4119396,10186] 0 2024-04-22T00:01:25.628 INFO:tasks.workunit.client.0.smithi110.stdout:0/665: fsync d0/d16/d42/fd8 0 2024-04-22T00:01:26.519 INFO:tasks.workunit.client.0.smithi110.stdout:5/651: dread d7/d9/f33 [4194304,4194304] 0 2024-04-22T00:01:26.581 INFO:tasks.workunit.client.0.smithi110.stdout:8/724: mkdir d5/d24/d33/d3d/d5c/d6a/d102 0 2024-04-22T00:01:26.652 INFO:tasks.workunit.client.0.smithi110.stdout:2/701: dwrite d9/d25/d1c/f34 [0,4194304] 0 2024-04-22T00:01:26.663 INFO:tasks.workunit.client.0.smithi110.stdout:4/591: mknod d1/d35/db9/d20/dbf/d5f/dc0/cce 0 2024-04-22T00:01:26.781 INFO:tasks.workunit.client.0.smithi110.stdout:8/725: chown d5/d24/d33/d3d/d82/fd9 272 1 2024-04-22T00:01:26.810 INFO:tasks.workunit.client.0.smithi110.stdout:5/652: sync 2024-04-22T00:01:27.072 INFO:tasks.workunit.client.0.smithi110.stdout:9/653: getdents d1/d29/d6f 0 2024-04-22T00:01:27.336 INFO:tasks.workunit.client.0.smithi110.stdout:3/636: truncate d6/d12/f2f 1678167 0 2024-04-22T00:01:27.542 INFO:tasks.workunit.client.0.smithi110.stdout:2/702: mknod d9/d1a/d7b/cea 0 2024-04-22T00:01:27.570 INFO:tasks.workunit.client.0.smithi110.stdout:2/703: readlink d9/d1a/d1d/d2b/l7d 0 2024-04-22T00:01:27.718 INFO:tasks.workunit.client.0.smithi110.stdout:4/592: fdatasync d1/d35/db9/d20/fa4 0 2024-04-22T00:01:27.792 INFO:tasks.workunit.client.0.smithi110.stdout:8/726: unlink d5/l65 0 2024-04-22T00:01:27.896 INFO:tasks.workunit.client.0.smithi110.stdout:8/727: stat d5/d4f/f5f 0 2024-04-22T00:01:28.082 INFO:tasks.workunit.client.0.smithi110.stdout:7/660: dwrite d10/f23 [0,4194304] 0 2024-04-22T00:01:28.220 INFO:tasks.workunit.client.0.smithi110.stdout:2/704: fdatasync d9/d25/d1b/d45/d4d/fe2 0 2024-04-22T00:01:28.415 INFO:tasks.workunit.client.0.smithi110.stdout:9/654: dread d1/f15 [0,4194304] 0 2024-04-22T00:01:28.625 INFO:tasks.workunit.client.0.smithi110.stdout:2/705: dread d9/f10 [0,4194304] 0 2024-04-22T00:01:28.906 INFO:tasks.workunit.client.0.smithi110.stdout:6/644: write d16/f1b [3847026,74890] 0 2024-04-22T00:01:29.406 INFO:tasks.workunit.client.0.smithi110.stdout:3/637: link d6/d12/d16/d6f/db5/dd3/fd6 d6/d12/d3c/d65/da8/fd7 0 2024-04-22T00:01:29.946 INFO:tasks.workunit.client.0.smithi110.stdout:1/623: dwrite d1/d2/d1b/d10/d5c/d77/fd3 [0,4194304] 0 2024-04-22T00:01:30.086 INFO:tasks.workunit.client.0.smithi110.stdout:6/645: read d16/d1d/d38/d8e/f9d [1779513,25600] 0 2024-04-22T00:01:30.280 INFO:tasks.workunit.client.0.smithi110.stdout:0/666: link d0/d25/d5a/fb6 d0/d56/dc9/fea 0 2024-04-22T00:01:30.755 INFO:tasks.workunit.client.0.smithi110.stdout:3/638: dread d6/f89 [0,4194304] 0 2024-04-22T00:01:30.793 INFO:tasks.workunit.client.0.smithi110.stdout:5/653: getdents d7/d22/d5d 0 2024-04-22T00:01:30.854 INFO:tasks.workunit.client.0.smithi110.stdout:2/706: mkdir d9/d1a/d1d/d4a/d6b/d3a/d5c/deb 0 2024-04-22T00:01:31.439 INFO:tasks.workunit.client.0.smithi110.stdout:3/639: mkdir d6/d12/d16/d5d/dd8 0 2024-04-22T00:01:31.786 INFO:tasks.workunit.client.0.smithi110.stdout:6/646: rename d16/d1e/d24/c60 to d16/d3d/d40/d46/cd1 0 2024-04-22T00:01:31.840 INFO:tasks.workunit.client.0.smithi110.stdout:4/593: dwrite d1/d35/db9/d20/d58/d93/d7c/fa6 [0,4194304] 0 2024-04-22T00:01:31.994 INFO:tasks.workunit.client.0.smithi110.stdout:9/655: getdents d1/d29/d6f/db4/d79/d98 0 2024-04-22T00:01:32.319 INFO:tasks.workunit.client.0.smithi110.stdout:6/647: rename d16/d1e/l53 to d16/d1d/d38/d48/d5e/d62/ld2 0 2024-04-22T00:01:32.322 INFO:tasks.workunit.client.0.smithi110.stdout:7/661: write d10/d15/d22/d2c/fb6 [940812,23984] 0 2024-04-22T00:01:32.376 INFO:tasks.workunit.client.0.smithi110.stdout:4/594: mkdir d1/d35/db9/d20/d23/d1c/d40/dcf 0 2024-04-22T00:01:32.705 INFO:tasks.workunit.client.0.smithi110.stdout:3/640: symlink d6/d12/d16/d6f/dab/ld9 0 2024-04-22T00:01:32.769 INFO:tasks.workunit.client.0.smithi110.stdout:9/656: dread d1/d29/d2a/d6/d1d/f89 [0,4194304] 0 2024-04-22T00:01:32.865 INFO:tasks.workunit.client.0.smithi110.stdout:6/648: rmdir d16/d1d/d38 39 2024-04-22T00:01:33.321 INFO:tasks.workunit.client.0.smithi110.stdout:9/657: fdatasync d1/d29/d2a/d6/d1d/f84 0 2024-04-22T00:01:33.430 INFO:tasks.workunit.client.0.smithi110.stdout:6/649: symlink d16/d1e/da8/ld3 0 2024-04-22T00:01:33.498 INFO:tasks.workunit.client.0.smithi110.stdout:8/728: dwrite d5/d4f/f76 [0,4194304] 0 2024-04-22T00:01:33.763 INFO:tasks.workunit.client.0.smithi110.stdout:7/662: mkdir d10/d45/d51/db1/dee/df0 0 2024-04-22T00:01:33.986 INFO:tasks.workunit.client.0.smithi110.stdout:3/641: dread d6/d12/d14/d4b/f5b [0,4194304] 0 2024-04-22T00:01:34.250 INFO:tasks.workunit.client.0.smithi110.stdout:4/595: rmdir d1/d35/db9/d20/d23/d1c/d47/d4f/d6a/dca 0 2024-04-22T00:01:34.253 INFO:tasks.workunit.client.0.smithi110.stdout:9/658: dread - d1/d29/d2a/d2b/d58/fc6 zero size 2024-04-22T00:01:34.294 INFO:tasks.workunit.client.0.smithi110.stdout:1/624: write d1/d2/d30/db9/fce [344531,73512] 0 2024-04-22T00:01:34.303 INFO:tasks.workunit.client.0.smithi110.stdout:0/667: write d0/d14/d23/fe7 [1042450,9936] 0 2024-04-22T00:01:34.564 INFO:tasks.workunit.client.0.smithi110.stdout:9/659: chown d1/d29/d2a/d3c/cae 574 1 2024-04-22T00:01:34.743 INFO:tasks.workunit.client.0.smithi110.stdout:8/729: rename d5/da/d17/d6c/d95/d98/ld2 to d5/d24/d33/d3d/d82/l103 0 2024-04-22T00:01:34.765 INFO:tasks.workunit.client.0.smithi110.stdout:5/654: dwrite d7/f72 [0,4194304] 0 2024-04-22T00:01:34.900 INFO:tasks.workunit.client.0.smithi110.stdout:2/707: dwrite d9/f10 [0,4194304] 0 2024-04-22T00:01:35.255 INFO:tasks.workunit.client.0.smithi110.stdout:6/650: symlink d16/d1d/d38/d48/d5e/db1/ld4 0 2024-04-22T00:01:35.405 INFO:tasks.workunit.client.0.smithi110.stdout:1/625: creat d1/d1d/d57/d91/d8d/fd6 x:0 0 0 2024-04-22T00:01:35.530 INFO:tasks.workunit.client.0.smithi110.stdout:0/668: rename d0/d27/c88 to d0/d16/d5d/dc5/ceb 0 2024-04-22T00:01:35.711 INFO:tasks.workunit.client.0.smithi110.stdout:8/730: mkdir d5/da/d17/d6c/d72/d73/d78/d8c/d104 0 2024-04-22T00:01:35.783 INFO:tasks.workunit.client.0.smithi110.stdout:9/660: truncate d1/d29/d2a/d6/f77 687782 0 2024-04-22T00:01:35.974 INFO:tasks.workunit.client.0.smithi110.stdout:2/708: symlink d9/d1a/d7b/dab/lec 0 2024-04-22T00:01:36.292 INFO:tasks.workunit.client.0.smithi110.stdout:4/596: symlink d1/d35/db9/d20/dc4/ld0 0 2024-04-22T00:01:36.312 INFO:tasks.workunit.client.0.smithi110.stdout:1/626: symlink d1/d2/d1b/d10/d5c/ld7 0 2024-04-22T00:01:36.392 INFO:tasks.workunit.client.0.smithi110.stdout:0/669: unlink d0/d56/c7c 0 2024-04-22T00:01:36.771 INFO:tasks.workunit.client.0.smithi110.stdout:4/597: sync 2024-04-22T00:01:36.771 INFO:tasks.workunit.client.0.smithi110.stdout:1/627: sync 2024-04-22T00:01:36.803 INFO:tasks.workunit.client.0.smithi110.stdout:2/709: mknod d9/d25/d1b/d45/d50/dc8/ced 0 2024-04-22T00:01:37.029 INFO:tasks.workunit.client.0.smithi110.stdout:0/670: mknod d0/d14/d23/d6d/cec 0 2024-04-22T00:01:37.112 INFO:tasks.workunit.client.0.smithi110.stdout:5/655: link d7/d9/d17/l59 d7/d35/lb4 0 2024-04-22T00:01:37.367 INFO:tasks.workunit.client.0.smithi110.stdout:1/628: rename d1/f89 to d1/d2/d1b/d10/da2/fd8 0 2024-04-22T00:01:37.406 INFO:tasks.workunit.client.0.smithi110.stdout:1/629: chown d1/dd/d23/dcc/ld0 27 1 2024-04-22T00:01:37.441 INFO:tasks.workunit.client.0.smithi110.stdout:2/710: fdatasync d9/d1a/d1d/d2b/d54/f70 0 2024-04-22T00:01:37.491 INFO:tasks.workunit.client.0.smithi110.stdout:2/711: read d9/d25/d1b/d45/d50/d68/fb1 [119125,47502] 0 2024-04-22T00:01:37.757 INFO:tasks.workunit.client.0.smithi110.stdout:7/663: write d10/d45/f4f [857653,120993] 0 2024-04-22T00:01:37.804 INFO:tasks.workunit.client.0.smithi110.stdout:7/664: stat d10/d45/d51/d88/c96 0 2024-04-22T00:01:37.855 INFO:tasks.workunit.client.0.smithi110.stdout:0/671: rename d0/d14/d23/d3b/c3d to d0/d2a/ced 0 2024-04-22T00:01:37.883 INFO:tasks.workunit.client.0.smithi110.stdout:3/642: write d6/d12/d14/d32/f4e [10568101,123970] 0 2024-04-22T00:01:38.010 INFO:tasks.workunit.client.0.smithi110.stdout:0/672: sync 2024-04-22T00:01:38.651 INFO:tasks.workunit.client.0.smithi110.stdout:7/665: creat d10/d15/d95/ff1 x:0 0 0 2024-04-22T00:01:38.652 INFO:tasks.workunit.client.0.smithi110.stdout:2/712: rename d9/d1a/d1d/d2b/d54/f8c to d9/d25/d1b/d60/fee 0 2024-04-22T00:01:38.698 INFO:tasks.workunit.client.0.smithi110.stdout:2/713: chown d9/d1a/d1d/d4e/f9a 111591 1 2024-04-22T00:01:38.712 INFO:tasks.workunit.client.0.smithi110.stdout:2/714: readlink d9/d25/d1c/d82/lce 0 2024-04-22T00:01:38.738 INFO:tasks.workunit.client.0.smithi110.stdout:3/643: mknod d6/d12/d14/d32/cda 0 2024-04-22T00:01:39.002 INFO:tasks.workunit.client.0.smithi110.stdout:4/598: link d1/d35/db9/d20/d23/f98 d1/d35/db9/d20/dbf/d5f/fd1 0 2024-04-22T00:01:39.242 INFO:tasks.workunit.client.0.smithi110.stdout:7/666: dread - d10/d15/d22/d2c/fd9 zero size 2024-04-22T00:01:39.780 INFO:tasks.workunit.client.0.smithi110.stdout:7/667: creat d10/d45/d51/db1/ff2 x:0 0 0 2024-04-22T00:01:40.281 INFO:tasks.workunit.client.0.smithi110.stdout:2/715: creat d9/d1a/d1d/d7a/d91/dac/fef x:0 0 0 2024-04-22T00:01:40.466 INFO:tasks.workunit.client.0.smithi110.stdout:4/599: mknod d1/d35/db9/d20/d23/d1c/d47/d4f/d56/dc8/cd2 0 2024-04-22T00:01:40.495 INFO:tasks.workunit.client.0.smithi110.stdout:4/600: chown d1/d35/db9/d12/l84 1 1 2024-04-22T00:01:40.638 INFO:tasks.workunit.client.0.smithi110.stdout:7/668: readlink d10/d45/d51/d88/l30 0 2024-04-22T00:01:40.730 INFO:tasks.workunit.client.0.smithi110.stdout:2/716: truncate d9/d1a/f26 3245909 0 2024-04-22T00:01:40.744 INFO:tasks.workunit.client.0.smithi110.stdout:9/661: write d1/d29/d6f/f75 [1872751,16346] 0 2024-04-22T00:01:41.087 INFO:tasks.workunit.client.0.smithi110.stdout:9/662: dread d1/f15 [0,4194304] 0 2024-04-22T00:01:41.136 INFO:tasks.workunit.client.0.smithi110.stdout:8/731: dwrite d5/d24/d33/d3d/f46 [0,4194304] 0 2024-04-22T00:01:41.215 INFO:tasks.workunit.client.0.smithi110.stdout:6/651: write d16/d3d/fc6 [3205860,120186] 0 2024-04-22T00:01:41.835 INFO:tasks.workunit.client.0.smithi110.stdout:7/669: symlink d10/d45/d51/d88/d39/d7f/dd4/lf3 0 2024-04-22T00:01:41.882 INFO:tasks.workunit.client.0.smithi110.stdout:4/601: fdatasync d1/d35/db9/f69 0 2024-04-22T00:01:41.918 INFO:tasks.workunit.client.0.smithi110.stdout:1/630: write d1/d2/d1b/d10/f5f [2534924,11585] 0 2024-04-22T00:01:41.926 INFO:tasks.workunit.client.0.smithi110.stdout:5/656: write d7/d24/d3a/d40/fa8 [146640,59100] 0 2024-04-22T00:01:42.049 INFO:tasks.workunit.client.0.smithi110.stdout:1/631: chown d1/dd/d23/d48/d4e/d86 9 1 2024-04-22T00:01:42.159 INFO:tasks.workunit.client.0.smithi110.stdout:6/652: unlink d16/d3d/d40/d46/l73 0 2024-04-22T00:01:42.438 INFO:tasks.workunit.client.0.smithi110.stdout:8/732: creat d5/d24/d33/d3d/d82/da8/f105 x:0 0 0 2024-04-22T00:01:42.650 INFO:tasks.workunit.client.0.smithi110.stdout:0/673: write d0/d25/d5a/fb3 [534273,23762] 0 2024-04-22T00:01:43.114 INFO:tasks.workunit.client.0.smithi110.stdout:3/644: write d6/d78/f88 [2514760,12387] 0 2024-04-22T00:01:43.202 INFO:tasks.workunit.client.0.smithi110.stdout:1/632: fsync d1/d2/d1b/d10/fb5 0 2024-04-22T00:01:43.644 INFO:tasks.workunit.client.0.smithi110.stdout:0/674: rmdir d0/d16/d42/d50 39 2024-04-22T00:01:43.985 INFO:tasks.workunit.client.0.smithi110.stdout:3/645: creat d6/d12/d14/fdb x:0 0 0 2024-04-22T00:01:44.383 INFO:tasks.workunit.client.0.smithi110.stdout:1/633: dread - d1/d1d/d57/d91/d8d/fd6 zero size 2024-04-22T00:01:44.669 INFO:tasks.workunit.client.0.smithi110.stdout:6/653: unlink d16/d1d/c23 0 2024-04-22T00:01:44.931 INFO:tasks.workunit.client.0.smithi110.stdout:5/657: link d7/d24/d49/d64/c6a d7/d22/d5b/d68/cb5 0 2024-04-22T00:01:45.082 INFO:tasks.workunit.client.0.smithi110.stdout:3/646: dread d6/d12/f1a [0,4194304] 0 2024-04-22T00:01:45.268 INFO:tasks.workunit.client.0.smithi110.stdout:1/634: truncate d1/dd/d23/f54 2670455 0 2024-04-22T00:01:45.397 INFO:tasks.workunit.client.0.smithi110.stdout:2/717: write d9/d1a/d1d/d4a/d6b/d3a/f41 [1523423,58344] 0 2024-04-22T00:01:45.447 INFO:tasks.workunit.client.0.smithi110.stdout:2/718: chown d9/d25/d1c/fdd 101 1 2024-04-22T00:01:45.489 INFO:tasks.workunit.client.0.smithi110.stdout:0/675: symlink d0/d16/d42/lee 0 2024-04-22T00:01:45.580 INFO:tasks.workunit.client.0.smithi110.stdout:5/658: rename d7/d22/d5b/d68/d9d to d7/d22/d5b/da5/db6 0 2024-04-22T00:01:45.728 INFO:tasks.workunit.client.0.smithi110.stdout:3/647: read - d6/d12/d3c/d65/d91/fbf zero size 2024-04-22T00:01:45.769 INFO:tasks.workunit.client.0.smithi110.stdout:3/648: dread - d6/d12/d3c/d65/d91/fbf zero size 2024-04-22T00:01:45.794 INFO:tasks.workunit.client.0.smithi110.stdout:6/654: mknod d16/cd5 0 2024-04-22T00:01:45.832 INFO:tasks.workunit.client.0.smithi110.stdout:6/655: chown d16/d3d/d97 140726617 1 2024-04-22T00:01:45.891 INFO:tasks.workunit.client.0.smithi110.stdout:1/635: creat d1/d2/d1b/d10/d5c/d77/fd9 x:0 0 0 2024-04-22T00:01:45.951 INFO:tasks.workunit.client.0.smithi110.stdout:1/636: read d1/f26 [745783,110955] 0 2024-04-22T00:01:46.296 INFO:tasks.workunit.client.0.smithi110.stdout:0/676: fsync d0/d27/d4b/d7f/faf 0 2024-04-22T00:01:46.579 INFO:tasks.workunit.client.0.smithi110.stdout:0/677: sync 2024-04-22T00:01:46.929 INFO:tasks.workunit.client.0.smithi110.stdout:5/659: symlink d7/d22/d5b/da5/db6/lb7 0 2024-04-22T00:01:46.954 INFO:tasks.workunit.client.0.smithi110.stdout:9/663: write d1/fca [1220902,107713] 0 2024-04-22T00:01:47.107 INFO:tasks.workunit.client.0.smithi110.stdout:9/664: chown d1/f15 114 1 2024-04-22T00:01:47.132 INFO:tasks.workunit.client.0.smithi110.stdout:2/719: mkdir d9/d1a/d1d/d2b/d5b/dd2/de7/df0 0 2024-04-22T00:01:47.186 INFO:tasks.workunit.client.0.smithi110.stdout:9/665: sync 2024-04-22T00:01:47.225 INFO:tasks.workunit.client.0.smithi110.stdout:7/670: dwrite d10/d45/d60/f78 [0,4194304] 0 2024-04-22T00:01:47.630 INFO:tasks.workunit.client.0.smithi110.stdout:8/733: write d5/d24/d33/d3d/d82/fd9 [573931,103748] 0 2024-04-22T00:01:47.639 INFO:tasks.workunit.client.0.smithi110.stdout:4/602: write d1/d35/db9/d20/dbf/d5f/fd1 [309178,103499] 0 2024-04-22T00:01:47.908 INFO:tasks.workunit.client.0.smithi110.stdout:5/660: symlink d7/d24/d37/d38/lb8 0 2024-04-22T00:01:47.919 INFO:tasks.workunit.client.0.smithi110.stdout:3/649: creat d6/d12/d16/d30/dc7/fdc x:0 0 0 2024-04-22T00:01:47.933 INFO:tasks.workunit.client.0.smithi110.stdout:1/637: truncate d1/d2/d1b/d10/da2/fd8 10979 0 2024-04-22T00:01:48.112 INFO:tasks.workunit.client.0.smithi110.stdout:9/666: mknod d1/d29/d2a/d2b/d58/da8/cce 0 2024-04-22T00:01:48.304 INFO:tasks.workunit.client.0.smithi110.stdout:7/671: fdatasync d10/d45/d60/d5e/d65/da3/fd0 0 2024-04-22T00:01:49.693 INFO:tasks.workunit.client.0.smithi110.stdout:7/672: dread - d10/d45/d51/fd2 zero size 2024-04-22T00:01:50.240 INFO:tasks.workunit.client.0.smithi110.stdout:3/650: fdatasync d6/d12/d50/f66 0 2024-04-22T00:01:50.245 INFO:tasks.workunit.client.0.smithi110.stdout:1/638: stat d1/d2/d1b/d10/da2/fd8 0 2024-04-22T00:01:50.402 INFO:tasks.workunit.client.0.smithi110.stdout:7/673: rename d10/d45/d60/d5e/f8b to d10/d45/d60/d5e/d65/ff4 0 2024-04-22T00:01:50.712 INFO:tasks.workunit.client.0.smithi110.stdout:4/603: creat d1/d35/db9/d20/d58/d93/fd3 x:0 0 0 2024-04-22T00:01:50.744 INFO:tasks.workunit.client.0.smithi110.stdout:6/656: dwrite d16/d1e/d24/d90/fc4 [0,4194304] 0 2024-04-22T00:01:51.099 INFO:tasks.workunit.client.0.smithi110.stdout:1/639: truncate d1/d2/d1b/f13 3466451 0 2024-04-22T00:01:51.874 INFO:tasks.workunit.client.0.smithi110.stdout:0/678: getdents d0/d16/d42/d50/dbc 0 2024-04-22T00:01:51.925 INFO:tasks.workunit.client.0.smithi110.stdout:6/657: creat d16/d1d/d38/d8e/fd6 x:0 0 0 2024-04-22T00:01:51.933 INFO:tasks.workunit.client.0.smithi110.stdout:4/604: fsync d1/d35/db9/f8a 0 2024-04-22T00:01:52.741 INFO:tasks.workunit.client.0.smithi110.stdout:6/658: creat d16/d1d/d38/d48/d5e/d62/fd7 x:0 0 0 2024-04-22T00:01:52.772 INFO:tasks.workunit.client.0.smithi110.stdout:6/659: readlink d16/d1e/d24/d33/l42 0 2024-04-22T00:01:52.797 INFO:tasks.workunit.client.0.smithi110.stdout:0/679: truncate d0/d16/d42/d50/dbc/fcc 688841 0 2024-04-22T00:01:53.074 INFO:tasks.workunit.client.0.smithi110.stdout:2/720: mknod d9/d1a/d1d/d2b/cf1 0 2024-04-22T00:01:53.079 INFO:tasks.workunit.client.0.smithi110.stdout:1/640: fdatasync d1/d2/d1b/d10/da2/fd8 0 2024-04-22T00:01:53.138 INFO:tasks.workunit.client.0.smithi110.stdout:8/734: write d5/da/dac/fd7 [972861,58525] 0 2024-04-22T00:01:53.146 INFO:tasks.workunit.client.0.smithi110.stdout:9/667: write d1/d29/d2a/d2b/d58/f63 [123389,66014] 0 2024-04-22T00:01:53.149 INFO:tasks.workunit.client.0.smithi110.stdout:5/661: write f5 [3457504,55909] 0 2024-04-22T00:01:53.323 INFO:tasks.workunit.client.0.smithi110.stdout:8/735: chown d5/d24/d33/d3d/d82/da8/fe7 461323921 1 2024-04-22T00:01:53.471 INFO:tasks.workunit.client.0.smithi110.stdout:0/680: symlink d0/d2a/lef 0 2024-04-22T00:01:53.686 INFO:tasks.workunit.client.0.smithi110.stdout:9/668: unlink d1/d19/f4b 0 2024-04-22T00:01:53.720 INFO:tasks.workunit.client.0.smithi110.stdout:9/669: readlink d1/d29/d2a/d6/l47 0 2024-04-22T00:01:53.803 INFO:tasks.workunit.client.0.smithi110.stdout:5/662: symlink d7/d24/d37/d38/d88/lb9 0 2024-04-22T00:01:53.942 INFO:tasks.workunit.client.0.smithi110.stdout:1/641: fsync d1/d2/d1b/d10/d5c/dc5/d27/f6b 0 2024-04-22T00:01:53.963 INFO:tasks.workunit.client.0.smithi110.stdout:1/642: stat d1/d2 0 2024-04-22T00:01:54.054 INFO:tasks.workunit.client.0.smithi110.stdout:8/736: fdatasync d5/d74/fd3 0 2024-04-22T00:01:55.158 INFO:tasks.workunit.client.0.smithi110.stdout:3/651: write d6/d12/d16/d5d/f7d [331562,42107] 0 2024-04-22T00:01:55.211 INFO:tasks.workunit.client.0.smithi110.stdout:5/663: symlink d7/d35/lba 0 2024-04-22T00:01:55.548 INFO:tasks.workunit.client.0.smithi110.stdout:7/674: dwrite d10/d45/d51/d88/f8e [0,4194304] 0 2024-04-22T00:01:55.690 INFO:tasks.workunit.client.0.smithi110.stdout:8/737: stat d5/d24/d33/d3d/d82/l103 0 2024-04-22T00:01:56.139 INFO:tasks.workunit.client.0.smithi110.stdout:4/605: link d1/d35/l4c d1/d35/db9/d20/d23/d1c/d47/d4f/d56/dc8/ld4 0 2024-04-22T00:01:56.264 INFO:tasks.workunit.client.0.smithi110.stdout:3/652: unlink d6/d12/d16/f23 0 2024-04-22T00:01:56.763 INFO:tasks.workunit.client.0.smithi110.stdout:2/721: write d9/d25/d1b/d45/d4d/fe2 [165262,125554] 0 2024-04-22T00:01:57.742 INFO:tasks.workunit.client.0.smithi110.stdout:2/722: creat d9/d25/d1c/da0/ff2 x:0 0 0 2024-04-22T00:01:57.774 INFO:tasks.workunit.client.0.smithi110.stdout:6/660: dwrite d16/d3d/d40/f77 [0,4194304] 0 2024-04-22T00:01:57.936 INFO:tasks.workunit.client.0.smithi110.stdout:3/653: mknod d6/d12/d16/d5d/dd8/cdd 0 2024-04-22T00:01:58.343 INFO:tasks.workunit.client.0.smithi110.stdout:6/661: chown d16/d3d/f2d 14468 1 2024-04-22T00:01:58.786 INFO:tasks.workunit.client.0.smithi110.stdout:3/654: creat d6/d12/d14/d4b/fde x:0 0 0 2024-04-22T00:01:58.876 INFO:tasks.workunit.client.0.smithi110.stdout:5/664: write d7/d35/f7b [5094564,60069] 0 2024-04-22T00:01:58.894 INFO:tasks.workunit.client.0.smithi110.stdout:8/738: write d5/da/d17/ff4 [70139,34185] 0 2024-04-22T00:01:58.912 INFO:tasks.workunit.client.0.smithi110.stdout:7/675: write d10/d15/d22/d2c/f31 [1345190,105803] 0 2024-04-22T00:01:59.198 INFO:tasks.workunit.client.0.smithi110.stdout:6/662: creat d16/d1e/d24/d90/dac/fd8 x:0 0 0 2024-04-22T00:01:59.665 INFO:tasks.workunit.client.0.smithi110.stdout:2/723: dread d9/d25/d1c/d82/f9f [0,4194304] 0 2024-04-22T00:01:59.853 INFO:tasks.workunit.client.0.smithi110.stdout:0/681: dwrite d0/d27/d4b/da0/fd3 [0,4194304] 0 2024-04-22T00:02:00.025 INFO:tasks.workunit.client.0.smithi110.stdout:9/670: dwrite d1/d29/d59/f6d [0,4194304] 0 2024-04-22T00:02:00.046 INFO:tasks.workunit.client.0.smithi110.stdout:1/643: dwrite d1/d2/d14/f9d [0,4194304] 0 2024-04-22T00:02:00.520 INFO:tasks.workunit.client.0.smithi110.stdout:4/606: dwrite d1/d35/db9/d20/d23/fac [4194304,4194304] 0 2024-04-22T00:02:00.663 INFO:tasks.workunit.client.0.smithi110.stdout:6/663: chown d16/d1d/d38/l51 1310 1 2024-04-22T00:02:01.476 INFO:tasks.workunit.client.0.smithi110.stdout:5/665: rename d7/d9/c34 to d7/d9/d17/d48/d69/cbb 0 2024-04-22T00:02:01.674 INFO:tasks.workunit.client.0.smithi110.stdout:2/724: mknod d9/cf3 0 2024-04-22T00:02:01.876 INFO:tasks.workunit.client.0.smithi110.stdout:6/664: dread d16/d3d/f81 [0,4194304] 0 2024-04-22T00:02:02.222 INFO:tasks.workunit.client.0.smithi110.stdout:0/682: truncate d0/f17 882978 0 2024-04-22T00:02:02.240 INFO:tasks.workunit.client.0.smithi110.stdout:9/671: getdents d1/d29/d2a/d2b/d57/d97/dad 0 2024-04-22T00:02:02.497 INFO:tasks.workunit.client.0.smithi110.stdout:7/676: rename d10/d15/d22 to d10/d45/d51/db1/dc9/df5 0 2024-04-22T00:02:02.599 INFO:tasks.workunit.client.0.smithi110.stdout:5/666: truncate d7/f27 5675128 0 2024-04-22T00:02:03.020 INFO:tasks.workunit.client.0.smithi110.stdout:6/665: mkdir d16/d3d/d97/da9/dd9 0 2024-04-22T00:02:03.045 INFO:tasks.workunit.client.0.smithi110.stdout:6/666: chown d16/d3d/d97/dd0 1098 1 2024-04-22T00:02:03.106 INFO:tasks.workunit.client.0.smithi110.stdout:6/667: readlink d16/d1d/d38/d48/d5e/d6a/d70/d86/lb4 0 2024-04-22T00:02:03.186 INFO:tasks.workunit.client.0.smithi110.stdout:0/683: dread d0/d2a/fd1 [0,4194304] 0 2024-04-22T00:02:03.240 INFO:tasks.workunit.client.0.smithi110.stdout:6/668: rename d16/d1d/d38 to d16/d1d/d38/d48/d5e/dda 22 2024-04-22T00:02:03.280 INFO:tasks.workunit.client.0.smithi110.stdout:6/669: stat d16/l37 0 2024-04-22T00:02:03.477 INFO:tasks.workunit.client.0.smithi110.stdout:5/667: truncate d7/d24/d49/d64/f70 942111 0 2024-04-22T00:02:03.595 INFO:tasks.workunit.client.0.smithi110.stdout:2/725: creat d9/d1a/d1d/de8/ff4 x:0 0 0 2024-04-22T00:02:03.696 INFO:tasks.workunit.client.0.smithi110.stdout:3/655: write d6/d12/d14/f7e [1842318,22400] 0 2024-04-22T00:02:03.732 INFO:tasks.workunit.client.0.smithi110.stdout:3/656: chown d6/d78/fc5 2581 1 2024-04-22T00:02:03.909 INFO:tasks.workunit.client.0.smithi110.stdout:3/657: dread d6/d12/d14/d4b/f5b [0,4194304] 0 2024-04-22T00:02:04.250 INFO:tasks.workunit.client.0.smithi110.stdout:1/644: dwrite d1/d1d/d57/fb8 [0,4194304] 0 2024-04-22T00:02:04.738 INFO:tasks.workunit.client.0.smithi110.stdout:8/739: dwrite d5/fb3 [0,4194304] 0 2024-04-22T00:02:04.766 INFO:tasks.workunit.client.0.smithi110.stdout:0/684: rename d0/d25/d5a/fb6 to d0/d14/d23/d6d/ff0 0 2024-04-22T00:02:05.030 INFO:tasks.workunit.client.0.smithi110.stdout:4/607: dwrite d1/d35/d6b/f9b [0,4194304] 0 2024-04-22T00:02:06.110 INFO:tasks.workunit.client.0.smithi110.stdout:4/608: rename d1/d35/db9/d20/d23/d1c to d1/d35/db9/d20/d23/d1c/d47/d4f/dd5 22 2024-04-22T00:02:06.408 INFO:tasks.workunit.client.0.smithi110.stdout:9/672: write d1/d29/d2a/d2b/d58/d7b/f91 [2431590,1514] 0 2024-04-22T00:02:06.775 INFO:tasks.workunit.client.0.smithi110.stdout:7/677: dwrite d10/f34 [0,4194304] 0 2024-04-22T00:02:06.903 INFO:tasks.workunit.client.0.smithi110.stdout:4/609: fdatasync d1/f5 0 2024-04-22T00:02:06.919 INFO:tasks.workunit.client.0.smithi110.stdout:9/673: creat d1/d29/d2a/d2b/d58/d7b/fcf x:0 0 0 2024-04-22T00:02:07.004 INFO:tasks.workunit.client.0.smithi110.stdout:9/674: stat d1/d29/d6f/db4/fa0 0 2024-04-22T00:02:07.072 INFO:tasks.workunit.client.0.smithi110.stdout:0/685: mkdir d0/df1 0 2024-04-22T00:02:07.533 INFO:tasks.workunit.client.0.smithi110.stdout:6/670: write d16/d3d/d40/d46/fbb [465993,73259] 0 2024-04-22T00:02:07.887 INFO:tasks.workunit.client.0.smithi110.stdout:4/610: truncate d1/d35/db9/fcc 176431 0 2024-04-22T00:02:08.066 INFO:tasks.workunit.client.0.smithi110.stdout:8/740: write d5/d24/d33/d3d/d5c/f8b [848979,113878] 0 2024-04-22T00:02:08.128 INFO:tasks.workunit.client.0.smithi110.stdout:9/675: stat d1/d29/l46 0 2024-04-22T00:02:08.265 INFO:tasks.workunit.client.0.smithi110.stdout:5/668: dwrite d7/d24/d3a/d40/f57 [4194304,4194304] 0 2024-04-22T00:02:08.301 INFO:tasks.workunit.client.0.smithi110.stdout:3/658: dwrite d6/d12/d16/d30/f51 [0,4194304] 0 2024-04-22T00:02:08.350 INFO:tasks.workunit.client.0.smithi110.stdout:2/726: dwrite d9/d25/d1b/d45/d4d/f52 [0,4194304] 0 2024-04-22T00:02:08.460 INFO:tasks.workunit.client.0.smithi110.stdout:2/727: sync 2024-04-22T00:02:08.809 INFO:tasks.workunit.client.0.smithi110.stdout:1/645: dwrite d1/dd/fb3 [4194304,4194304] 0 2024-04-22T00:02:08.987 INFO:tasks.workunit.client.0.smithi110.stdout:8/741: symlink d5/d74/l106 0 2024-04-22T00:02:08.990 INFO:tasks.workunit.client.0.smithi110.stdout:6/671: creat d16/d3d/d97/fdb x:0 0 0 2024-04-22T00:02:09.052 INFO:tasks.workunit.client.0.smithi110.stdout:0/686: dread - d0/d16/d5d/fdf zero size 2024-04-22T00:02:09.186 INFO:tasks.workunit.client.0.smithi110.stdout:9/676: read - d1/d29/d2a/d2b/d58/da8/fbc zero size 2024-04-22T00:02:09.226 INFO:tasks.workunit.client.0.smithi110.stdout:7/678: dread d10/d15/f21 [0,4194304] 0 2024-04-22T00:02:09.470 INFO:tasks.workunit.client.0.smithi110.stdout:4/611: dwrite d1/d35/db9/d20/d50/f6e [0,4194304] 0 2024-04-22T00:02:09.583 INFO:tasks.workunit.client.0.smithi110.stdout:3/659: mknod d6/d12/d16/d30/dc7/cdf 0 2024-04-22T00:02:09.602 INFO:tasks.workunit.client.0.smithi110.stdout:8/742: fsync d5/f6 0 2024-04-22T00:02:09.624 INFO:tasks.workunit.client.0.smithi110.stdout:5/669: truncate d7/d9/fad 750110 0 2024-04-22T00:02:09.660 INFO:tasks.workunit.client.0.smithi110.stdout:1/646: mknod d1/d2/d30/d9c/cda 0 2024-04-22T00:02:09.807 INFO:tasks.workunit.client.0.smithi110.stdout:0/687: dread - d0/d27/f48 zero size 2024-04-22T00:02:10.460 INFO:tasks.workunit.client.0.smithi110.stdout:7/679: unlink d10/d45/d51/d88/d39/d7f/d80/l98 0 2024-04-22T00:02:10.478 INFO:tasks.workunit.client.0.smithi110.stdout:8/743: symlink d5/d24/d33/d3d/d82/l107 0 2024-04-22T00:02:10.532 INFO:tasks.workunit.client.0.smithi110.stdout:6/672: creat d16/fdc x:0 0 0 2024-04-22T00:02:10.644 INFO:tasks.workunit.client.0.smithi110.stdout:8/744: sync 2024-04-22T00:02:10.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/728: link d9/d1a/d1d/d2b/d54/d77/c9e d9/d25/d1c/da0/cf5 0 2024-04-22T00:02:10.720 INFO:tasks.workunit.client.0.smithi110.stdout:5/670: creat d7/d24/d3a/da7/fbc x:0 0 0 2024-04-22T00:02:11.603 INFO:tasks.workunit.client.0.smithi110.stdout:0/688: mkdir d0/d27/dcd/df2 0 2024-04-22T00:02:11.628 INFO:tasks.workunit.client.0.smithi110.stdout:3/660: creat d6/d12/da1/fe0 x:0 0 0 2024-04-22T00:02:11.706 INFO:tasks.workunit.client.0.smithi110.stdout:3/661: read d6/d12/d14/f25 [998677,45860] 0 2024-04-22T00:02:11.864 INFO:tasks.workunit.client.0.smithi110.stdout:4/612: mknod d1/d35/db9/d20/d58/cd6 0 2024-04-22T00:02:11.906 INFO:tasks.workunit.client.0.smithi110.stdout:6/673: mkdir d16/d1e/d24/d33/d85/ddd 0 2024-04-22T00:02:11.914 INFO:tasks.workunit.client.0.smithi110.stdout:8/745: unlink d5/c1c 0 2024-04-22T00:02:12.731 INFO:tasks.workunit.client.0.smithi110.stdout:1/647: rename d1/d2/d1b/d10/d5c/daa/fc1 to d1/d2/d1b/fdb 0 2024-04-22T00:02:13.148 INFO:tasks.workunit.client.0.smithi110.stdout:8/746: creat d5/d24/d33/d3d/d82/da8/f108 x:0 0 0 2024-04-22T00:02:13.730 INFO:tasks.workunit.client.0.smithi110.stdout:9/677: dwrite d1/d19/f32 [0,4194304] 0 2024-04-22T00:02:13.957 INFO:tasks.workunit.client.0.smithi110.stdout:1/648: unlink d1/dd/d23/d48/d4e/lad 0 2024-04-22T00:02:13.972 INFO:tasks.workunit.client.0.smithi110.stdout:6/674: creat d16/d1d/d38/dab/fde x:0 0 0 2024-04-22T00:02:14.044 INFO:tasks.workunit.client.0.smithi110.stdout:1/649: chown d1/d2/d1b/d10/d5c/d77/d78 544608396 1 2024-04-22T00:02:14.123 INFO:tasks.workunit.client.0.smithi110.stdout:4/613: mkdir d1/d35/db9/d20/d58/d7e/dd7 0 2024-04-22T00:02:14.420 INFO:tasks.workunit.client.0.smithi110.stdout:7/680: write d10/d45/d51/db1/dc9/df5/fe5 [55156,16489] 0 2024-04-22T00:02:14.961 INFO:tasks.workunit.client.0.smithi110.stdout:6/675: creat d16/d3d/d40/d46/fdf x:0 0 0 2024-04-22T00:02:15.058 INFO:tasks.workunit.client.0.smithi110.stdout:2/729: getdents d9/d1a/d7b 0 2024-04-22T00:02:15.311 INFO:tasks.workunit.client.0.smithi110.stdout:3/662: write d6/d12/d16/d30/f35 [3155756,100956] 0 2024-04-22T00:02:15.378 INFO:tasks.workunit.client.0.smithi110.stdout:4/614: read d1/d35/db9/d20/d23/d1c/d40/f63 [3234797,53284] 0 2024-04-22T00:02:15.445 INFO:tasks.workunit.client.0.smithi110.stdout:5/671: dwrite d7/d24/d3a/d40/fa8 [0,4194304] 0 2024-04-22T00:02:16.022 INFO:tasks.workunit.client.0.smithi110.stdout:0/689: link d0/d16/d42/d50/d83/cc4 d0/d16/d42/cf3 0 2024-04-22T00:02:16.418 INFO:tasks.workunit.client.0.smithi110.stdout:8/747: write d5/da/dac/fd7 [755207,68871] 0 2024-04-22T00:02:16.613 INFO:tasks.workunit.client.0.smithi110.stdout:6/676: chown d16/l8a 24 1 2024-04-22T00:02:17.168 INFO:tasks.workunit.client.0.smithi110.stdout:2/730: rename d9/d1a/d1d/d4e/de3 to d9/d25/d1b/d45/d50/dc8/df6 0 2024-04-22T00:02:17.469 INFO:tasks.workunit.client.0.smithi110.stdout:4/615: chown d1/d35/db9/d20/d50/l9e 102345 1 2024-04-22T00:02:17.529 INFO:tasks.workunit.client.0.smithi110.stdout:3/663: creat d6/d12/d16/d6f/db5/dd3/fe1 x:0 0 0 2024-04-22T00:02:17.746 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:09:58.008 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.782 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:09:58.044 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.802 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:09:58.000 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.803 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:09:58.000 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.810 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:09:58.008 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.823 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:09:58.021 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.915 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:09:58.177 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.940 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:09:58.138 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:17.940 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:09:58.138 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:02:18.141 INFO:tasks.workunit.client.0.smithi110.stdout:8/748: truncate d5/d24/d33/d3d/f66 2393385 0 2024-04-22T00:02:18.165 INFO:tasks.workunit.client.0.smithi110.stdout:8/749: chown d5/da/d17/c30 395998367 1 2024-04-22T00:02:18.240 INFO:tasks.workunit.client.0.smithi110.stdout:1/650: rmdir d1/d2/d1b/d10/d5c/dc5/dae 0 2024-04-22T00:02:18.774 INFO:tasks.workunit.client.0.smithi110.stdout:9/678: dwrite d1/d19/d42/f82 [0,4194304] 0 2024-04-22T00:02:18.869 INFO:tasks.workunit.client.0.smithi110.stdout:4/616: fdatasync d1/d35/db9/d20/d23/fa1 0 2024-04-22T00:02:18.939 INFO:tasks.workunit.client.0.smithi110.stdout:3/664: fsync d6/d12/d14/d4b/f63 0 2024-04-22T00:02:20.391 INFO:tasks.workunit.client.0.smithi110.stdout:3/665: fsync d6/d12/d14/f53 0 2024-04-22T00:02:20.449 INFO:tasks.workunit.client.0.smithi110.stdout:5/672: write d7/d9/f16 [258643,11063] 0 2024-04-22T00:02:20.524 INFO:tasks.workunit.client.0.smithi110.stdout:7/681: write d10/d15/f25 [783929,116259] 0 2024-04-22T00:02:21.475 INFO:tasks.workunit.client.0.smithi110.stdout:3/666: creat d6/d12/d16/d30/d9c/fe2 x:0 0 0 2024-04-22T00:02:21.623 INFO:tasks.workunit.client.0.smithi110.stdout:5/673: symlink d7/d22/d5b/da5/db6/lbd 0 2024-04-22T00:02:21.707 INFO:tasks.workunit.client.0.smithi110.stdout:6/677: dwrite d16/d1d/d38/d8e/f9d [0,4194304] 0 2024-04-22T00:02:22.036 INFO:tasks.workunit.client.0.smithi110.stdout:0/690: write d0/d14/d23/d3b/fb5 [182264,9229] 0 2024-04-22T00:02:22.153 INFO:tasks.workunit.client.0.smithi110.stdout:2/731: dwrite d9/d1a/d1d/d7a/d91/fa3 [0,4194304] 0 2024-04-22T00:02:22.288 INFO:tasks.workunit.client.0.smithi110.stdout:5/674: read - d7/f98 zero size 2024-04-22T00:02:22.602 INFO:tasks.workunit.client.0.smithi110.stdout:9/679: write d1/d29/d2a/d2b/f7f [442424,43043] 0 2024-04-22T00:02:22.854 INFO:tasks.workunit.client.0.smithi110.stdout:6/678: chown d16/d1e/d24/d90/lc1 1612 1 2024-04-22T00:02:22.960 INFO:tasks.workunit.client.0.smithi110.stdout:1/651: dwrite d1/f26 [0,4194304] 0 2024-04-22T00:02:23.066 INFO:tasks.workunit.client.0.smithi110.stdout:8/750: dwrite d5/da/d17/d7c/dc0/fcf [0,4194304] 0 2024-04-22T00:02:23.343 INFO:tasks.workunit.client.0.smithi110.stdout:5/675: creat d7/d24/d49/d61/fbe x:0 0 0 2024-04-22T00:02:23.345 INFO:tasks.workunit.client.0.smithi110.stdout:2/732: mknod d9/d1a/d1d/d2b/d5b/dd2/cf7 0 2024-04-22T00:02:23.588 INFO:tasks.workunit.client.0.smithi110.stdout:0/691: mknod d0/d56/da3/cf4 0 2024-04-22T00:02:23.641 INFO:tasks.workunit.client.0.smithi110.stdout:4/617: write d1/d35/db9/d20/dbf/f30 [2002221,113218] 0 2024-04-22T00:02:23.868 INFO:tasks.workunit.client.0.smithi110.stdout:1/652: mkdir d1/dd/d23/d48/d4e/ddc 0 2024-04-22T00:02:23.874 INFO:tasks.workunit.client.0.smithi110.stdout:6/679: fsync d16/d1d/d38/d48/d5e/d62/f7c 0 2024-04-22T00:02:23.960 INFO:tasks.workunit.client.0.smithi110.stdout:2/733: fdatasync d9/d1a/d1d/d2b/d54/fd7 0 2024-04-22T00:02:24.282 INFO:tasks.workunit.client.0.smithi110.stdout:0/692: fdatasync d0/d16/d5d/fdf 0 2024-04-22T00:02:25.465 INFO:tasks.workunit.client.0.smithi110.stdout:7/682: dwrite d10/d27/f82 [0,4194304] 0 2024-04-22T00:02:25.616 INFO:tasks.workunit.client.0.smithi110.stdout:7/683: stat d10/d45/d51/db1/ff2 0 2024-04-22T00:02:25.754 INFO:tasks.workunit.client.0.smithi110.stdout:4/618: symlink d1/d35/db9/d20/d23/d1c/d47/d4f/ld8 0 2024-04-22T00:02:26.199 INFO:tasks.workunit.client.0.smithi110.stdout:9/680: getdents d1 0 2024-04-22T00:02:26.641 INFO:tasks.workunit.client.0.smithi110.stdout:4/619: fsync d1/d35/db9/d20/dbf/d5f/fd1 0 2024-04-22T00:02:26.714 INFO:tasks.workunit.client.0.smithi110.stdout:4/620: readlink d1/d35/db9/d20/d23/d1c/d47/d4f/d56/d7a/l9d 0 2024-04-22T00:02:26.807 INFO:tasks.workunit.client.0.smithi110.stdout:9/681: mknod d1/d29/d2a/d6/d1d/cd0 0 2024-04-22T00:02:27.152 INFO:tasks.workunit.client.0.smithi110.stdout:0/693: creat d0/d16/d42/ff5 x:0 0 0 2024-04-22T00:02:27.257 INFO:tasks.workunit.client.0.smithi110.stdout:8/751: dwrite d5/d24/d33/d3d/d82/da8/fe7 [0,4194304] 0 2024-04-22T00:02:27.411 INFO:tasks.workunit.client.0.smithi110.stdout:5/676: dwrite d7/d9/d17/d48/d69/f8d [0,4194304] 0 2024-04-22T00:02:27.503 INFO:tasks.workunit.client.0.smithi110.stdout:1/653: getdents d1/d2/d30/db9 0 2024-04-22T00:02:27.605 INFO:tasks.workunit.client.0.smithi110.stdout:5/677: readlink d7/d24/d3a/d54/l62 0 2024-04-22T00:02:27.616 INFO:tasks.workunit.client.0.smithi110.stdout:0/694: read d0/fa [171561,7521] 0 2024-04-22T00:02:27.660 INFO:tasks.workunit.client.0.smithi110.stdout:5/678: readlink d7/d24/d49/d61/l65 0 2024-04-22T00:02:27.826 INFO:tasks.workunit.client.0.smithi110.stdout:3/667: rename d6/d12/f2c to d6/d12/d16/d6f/db5/dd3/fe3 0 2024-04-22T00:02:27.848 INFO:tasks.workunit.client.0.smithi110.stdout:2/734: write d9/d1a/d1d/d2b/d54/f70 [1176743,84768] 0 2024-04-22T00:02:27.876 INFO:tasks.workunit.client.0.smithi110.stdout:9/682: rename d1/d29/d6f/db4 to d1/d29/d6f/db4/d79/d98/dd1 22 2024-04-22T00:02:27.960 INFO:tasks.workunit.client.0.smithi110.stdout:5/679: sync 2024-04-22T00:02:27.985 INFO:tasks.workunit.client.0.smithi110.stdout:4/621: fdatasync d1/d35/db9/d20/d23/d1c/d47/d4f/fc6 0 2024-04-22T00:02:28.008 INFO:tasks.workunit.client.0.smithi110.stdout:3/668: sync 2024-04-22T00:02:28.031 INFO:tasks.workunit.client.0.smithi110.stdout:4/622: chown d1/fd 1 1 2024-04-22T00:02:28.041 INFO:tasks.workunit.client.0.smithi110.stdout:3/669: chown d6/d12/d14/f31 32768746 1 2024-04-22T00:02:28.123 INFO:tasks.workunit.client.0.smithi110.stdout:4/623: dread d1/d35/db9/f69 [0,4194304] 0 2024-04-22T00:02:28.130 INFO:tasks.workunit.client.0.smithi110.stdout:8/752: creat d5/da/d17/d60/f109 x:0 0 0 2024-04-22T00:02:28.686 INFO:tasks.workunit.client.0.smithi110.stdout:1/654: creat d1/d2/d30/db9/fdd x:0 0 0 2024-04-22T00:02:28.987 INFO:tasks.workunit.client.0.smithi110.stdout:2/735: rename d9/d1a/d1d/d4a/d6b/f98 to d9/d1a/d1d/d2b/d5b/dd2/de7/df0/ff8 0 2024-04-22T00:02:28.999 INFO:tasks.workunit.client.0.smithi110.stdout:6/680: write d16/fc9 [895125,124350] 0 2024-04-22T00:02:29.172 INFO:tasks.workunit.client.0.smithi110.stdout:5/680: creat d7/d22/d5b/d6f/fbf x:0 0 0 2024-04-22T00:02:29.495 INFO:tasks.workunit.client.0.smithi110.stdout:8/753: read d5/d24/d33/d3d/f66 [443945,17029] 0 2024-04-22T00:02:29.530 INFO:tasks.workunit.client.0.smithi110.stdout:7/684: dwrite d10/d45/d60/d5e/d65/f76 [0,4194304] 0 2024-04-22T00:02:29.695 INFO:tasks.workunit.client.0.smithi110.stdout:4/624: creat d1/d35/db9/d20/d58/d93/d5e/fd9 x:0 0 0 2024-04-22T00:02:30.449 INFO:tasks.workunit.client.0.smithi110.stdout:1/655: rename d1/d2/f25 to d1/dd/d23/d48/d4e/ddc/fde 0 2024-04-22T00:02:30.907 INFO:tasks.workunit.client.0.smithi110.stdout:5/681: read d7/d24/d31/f5e [12159535,15048] 0 2024-04-22T00:02:31.734 INFO:tasks.workunit.client.0.smithi110.stdout:8/754: dread d5/d24/f2c [0,4194304] 0 2024-04-22T00:02:31.934 INFO:tasks.workunit.client.0.smithi110.stdout:1/656: write d1/f26 [27453,69503] 0 2024-04-22T00:02:32.009 INFO:tasks.workunit.client.0.smithi110.stdout:5/682: rmdir d7/d22/d5b/d68 39 2024-04-22T00:02:32.037 INFO:tasks.workunit.client.0.smithi110.stdout:7/685: dread d10/d45/d51/d88/d93/fc4 [0,4194304] 0 2024-04-22T00:02:32.097 INFO:tasks.workunit.client.0.smithi110.stdout:1/657: dread - d1/d1d/d57/d91/fa3 zero size 2024-04-22T00:02:32.400 INFO:tasks.workunit.client.0.smithi110.stdout:5/683: mkdir d7/d35/dc0 0 2024-04-22T00:02:32.563 INFO:tasks.workunit.client.0.smithi110.stdout:9/683: dwrite d1/d19/d42/f6b [4194304,4194304] 0 2024-04-22T00:02:33.036 INFO:tasks.workunit.client.0.smithi110.stdout:1/658: dread d1/f7a [0,4194304] 0 2024-04-22T00:02:33.100 INFO:tasks.workunit.client.0.smithi110.stdout:5/684: dread - d7/d24/d3a/d40/f9a zero size 2024-04-22T00:02:33.288 INFO:tasks.workunit.client.0.smithi110.stdout:9/684: dwrite d1/d19/d42/f6b [0,4194304] 0 2024-04-22T00:02:33.502 INFO:tasks.workunit.client.0.smithi110.stdout:3/670: dwrite d6/d12/d16/d30/f51 [0,4194304] 0 2024-04-22T00:02:34.012 INFO:tasks.workunit.client.0.smithi110.stdout:0/695: dwrite d0/d56/dc9/fea [0,4194304] 0 2024-04-22T00:02:34.116 INFO:tasks.workunit.client.0.smithi110.stdout:9/685: mkdir d1/d29/d2a/d2b/d58/dd2 0 2024-04-22T00:02:34.273 INFO:tasks.workunit.client.0.smithi110.stdout:0/696: dread d0/d14/d23/f9e [0,4194304] 0 2024-04-22T00:02:34.349 INFO:tasks.workunit.client.0.smithi110.stdout:2/736: write d9/d1a/d1d/fa5 [3946982,39539] 0 2024-04-22T00:02:34.406 INFO:tasks.workunit.client.0.smithi110.stdout:7/686: write d10/d45/d51/d88/d46/d69/d75/fb7 [514884,56726] 0 2024-04-22T00:02:34.670 INFO:tasks.workunit.client.0.smithi110.stdout:2/737: readlink d9/d25/d1b/d45/d50/lb6 0 2024-04-22T00:02:34.895 INFO:tasks.workunit.client.0.smithi110.stdout:9/686: rmdir d1/d29/d2a/d9d 39 2024-04-22T00:02:34.929 INFO:tasks.workunit.client.0.smithi110.stdout:8/755: dwrite d5/d24/d33/d3d/f47 [0,4194304] 0 2024-04-22T00:02:35.018 INFO:tasks.workunit.client.0.smithi110.stdout:4/625: dwrite d1/f5 [4194304,4194304] 0 2024-04-22T00:02:35.299 INFO:tasks.workunit.client.0.smithi110.stdout:1/659: rename d1/d1d/d70/l84 to d1/d2/d1b/ldf 0 2024-04-22T00:02:35.320 INFO:tasks.workunit.client.0.smithi110.stdout:3/671: write d6/d12/d16/d30/dc7/fdc [679818,23263] 0 2024-04-22T00:02:35.391 INFO:tasks.workunit.client.0.smithi110.stdout:9/687: dread d1/d29/d2a/d6/d1d/f89 [0,4194304] 0 2024-04-22T00:02:35.392 INFO:tasks.workunit.client.0.smithi110.stdout:2/738: dread d9/d1a/d1d/d7a/d91/dac/fb7 [0,4194304] 0 2024-04-22T00:02:35.537 INFO:tasks.workunit.client.0.smithi110.stdout:9/688: chown d1/d29/d2a 7520 1 2024-04-22T00:02:35.576 INFO:tasks.workunit.client.0.smithi110.stdout:7/687: dread d10/d15/f25 [0,4194304] 0 2024-04-22T00:02:36.587 INFO:tasks.workunit.client.0.smithi110.stdout:4/626: unlink d1/d35/db9/d20/d23/d1c/d47/c48 0 2024-04-22T00:02:36.938 INFO:tasks.workunit.client.0.smithi110.stdout:5/685: rename d7/d24/f53 to d7/d9/d17/fc1 0 2024-04-22T00:02:36.963 INFO:tasks.workunit.client.0.smithi110.stdout:5/686: chown d7/d9/f3d 759 1 2024-04-22T00:02:38.057 INFO:tasks.workunit.client.0.smithi110.stdout:6/681: link d16/d1d/d38/d48/d5e/d6a/d70/la5 d16/le0 0 2024-04-22T00:02:38.203 INFO:tasks.workunit.client.0.smithi110.stdout:5/687: symlink d7/d24/d31/lc2 0 2024-04-22T00:02:38.352 INFO:tasks.workunit.client.0.smithi110.stdout:0/697: write d0/d16/d42/d50/d83/fcf [1199206,40360] 0 2024-04-22T00:02:38.906 INFO:tasks.workunit.client.0.smithi110.stdout:8/756: dwrite d5/da/dac/dc6/fcd [0,4194304] 0 2024-04-22T00:02:39.443 INFO:tasks.workunit.client.0.smithi110.stdout:0/698: chown d0/d16/d42/d50/lbe 3788 1 2024-04-22T00:02:39.791 INFO:tasks.workunit.client.0.smithi110.stdout:1/660: dwrite d1/d2/d1b/d10/d5c/d77/fca [0,4194304] 0 2024-04-22T00:02:39.928 INFO:tasks.workunit.client.0.smithi110.stdout:4/627: creat d1/d35/db9/fda x:0 0 0 2024-04-22T00:02:40.019 INFO:tasks.workunit.client.0.smithi110.stdout:9/689: write d1/d29/d59/f93 [1162491,85364] 0 2024-04-22T00:02:40.160 INFO:tasks.workunit.client.0.smithi110.stdout:3/672: link d6/d12/f2f d6/d12/d16/d5d/dd8/fe4 0 2024-04-22T00:02:40.222 INFO:tasks.workunit.client.0.smithi110.stdout:5/688: creat d7/d22/d5b/d86/fc3 x:0 0 0 2024-04-22T00:02:40.381 INFO:tasks.workunit.client.0.smithi110.stdout:2/739: getdents d9 0 2024-04-22T00:02:40.400 INFO:tasks.workunit.client.0.smithi110.stdout:7/688: write d10/d45/d60/d5e/d65/ff4 [491185,32474] 0 2024-04-22T00:02:40.504 INFO:tasks.workunit.client.0.smithi110.stdout:0/699: truncate d0/d16/d42/fd8 1207319 0 2024-04-22T00:02:41.001 INFO:tasks.workunit.client.0.smithi110.stdout:7/689: dwrite d10/d45/d60/d5e/d65/ff4 [0,4194304] 0 2024-04-22T00:02:41.240 INFO:tasks.workunit.client.0.smithi110.stdout:6/682: dwrite d16/d1d/d38/d48/d5e/d6a/d70/f9b [0,4194304] 0 2024-04-22T00:02:41.374 INFO:tasks.workunit.client.0.smithi110.stdout:1/661: mknod d1/d1d/d70/ce0 0 2024-04-22T00:02:41.644 INFO:tasks.workunit.client.0.smithi110.stdout:9/690: truncate d1/d29/d2a/d2b/f7f 337234 0 2024-04-22T00:02:41.671 INFO:tasks.workunit.client.0.smithi110.stdout:3/673: readlink d6/lf 0 2024-04-22T00:02:41.734 INFO:tasks.workunit.client.0.smithi110.stdout:1/662: sync 2024-04-22T00:02:41.782 INFO:tasks.workunit.client.0.smithi110.stdout:5/689: symlink d7/d24/d37/d38/lc4 0 2024-04-22T00:02:41.799 INFO:tasks.workunit.client.0.smithi110.stdout:3/674: sync 2024-04-22T00:02:42.010 INFO:tasks.workunit.client.0.smithi110.stdout:2/740: dread - d9/d25/d1b/d45/d50/f89 zero size 2024-04-22T00:02:42.144 INFO:tasks.workunit.client.0.smithi110.stdout:0/700: creat d0/d14/d23/d3b/ff6 x:0 0 0 2024-04-22T00:02:42.341 INFO:tasks.workunit.client.0.smithi110.stdout:8/757: dwrite d5/da/dac/fd7 [0,4194304] 0 2024-04-22T00:02:43.056 INFO:tasks.workunit.client.0.smithi110.stdout:6/683: dread d16/d3d/d40/f77 [0,4194304] 0 2024-04-22T00:02:43.188 INFO:tasks.workunit.client.0.smithi110.stdout:9/691: mknod d1/d29/d2a/d6/d1d/cd3 0 2024-04-22T00:02:43.328 INFO:tasks.workunit.client.0.smithi110.stdout:1/663: creat d1/dd/d23/fe1 x:0 0 0 2024-04-22T00:02:43.724 INFO:tasks.workunit.client.0.smithi110.stdout:5/690: dread d7/d35/f7b [0,4194304] 0 2024-04-22T00:02:43.763 INFO:tasks.workunit.client.0.smithi110.stdout:2/741: truncate d9/d25/d1c/fdd 653321 0 2024-04-22T00:02:43.816 INFO:tasks.workunit.client.0.smithi110.stdout:4/628: write d1/d35/db9/d20/d58/d93/fd3 [486882,1868] 0 2024-04-22T00:02:43.902 INFO:tasks.workunit.client.0.smithi110.stdout:0/701: mknod d0/d27/d68/d7d/cf7 0 2024-04-22T00:02:44.485 INFO:tasks.workunit.client.0.smithi110.stdout:1/664: creat d1/dd/d23/d48/fe2 x:0 0 0 2024-04-22T00:02:45.062 INFO:tasks.workunit.client.0.smithi110.stdout:5/691: dread d7/d9/d17/f18 [0,4194304] 0 2024-04-22T00:02:45.345 INFO:tasks.workunit.client.0.smithi110.stdout:6/684: symlink d16/d1e/d24/le1 0 2024-04-22T00:02:45.570 INFO:tasks.workunit.client.0.smithi110.stdout:1/665: rmdir d1 39 2024-04-22T00:02:45.792 INFO:tasks.workunit.client.0.smithi110.stdout:4/629: creat d1/d35/db9/d20/dbf/db5/fdb x:0 0 0 2024-04-22T00:02:45.827 INFO:tasks.workunit.client.0.smithi110.stdout:4/630: readlink d1/d35/db9/d20/l96 0 2024-04-22T00:02:46.372 INFO:tasks.workunit.client.0.smithi110.stdout:2/742: truncate d9/d1a/d1d/d2b/d5b/dd2/de7/df0/ff8 1861924 0 2024-04-22T00:02:46.609 INFO:tasks.workunit.client.0.smithi110.stdout:7/690: getdents d10/d45/d51/d88/d39 0 2024-04-22T00:02:46.852 INFO:tasks.workunit.client.0.smithi110.stdout:6/685: fdatasync d16/fc9 0 2024-04-22T00:02:47.029 INFO:tasks.workunit.client.0.smithi110.stdout:3/675: dwrite d6/d12/d50/f66 [0,4194304] 0 2024-04-22T00:02:47.191 INFO:tasks.workunit.client.0.smithi110.stdout:3/676: stat d6/d12/d16/d30/d67 0 2024-04-22T00:02:47.441 INFO:tasks.workunit.client.0.smithi110.stdout:2/743: rmdir d9/d1a/d1d/d7a/d91 39 2024-04-22T00:02:47.575 INFO:tasks.workunit.client.0.smithi110.stdout:8/758: write d5/ff [481037,110633] 0 2024-04-22T00:02:47.717 INFO:tasks.workunit.client.0.smithi110.stdout:9/692: write d1/d29/d6f/db4/fa3 [1015766,62445] 0 2024-04-22T00:02:47.767 INFO:tasks.workunit.client.0.smithi110.stdout:9/693: stat d1/d29/d2a/d2b/d58/d7b 0 2024-04-22T00:02:48.258 INFO:tasks.workunit.client.0.smithi110.stdout:3/677: unlink d6/d12/d16/d30/d9c/f42 0 2024-04-22T00:02:48.879 INFO:tasks.workunit.client.0.smithi110.stdout:2/744: dread d9/d25/d1c/d82/faf [4194304,4194304] 0 2024-04-22T00:02:50.065 INFO:tasks.workunit.client.0.smithi110.stdout:3/678: dread d6/d12/d16/d30/d9c/f97 [0,4194304] 0 2024-04-22T00:02:50.159 INFO:tasks.workunit.client.0.smithi110.stdout:5/692: dwrite d7/d24/d37/f5f [0,4194304] 0 2024-04-22T00:02:50.370 INFO:tasks.workunit.client.0.smithi110.stdout:4/631: getdents d1/d35/db9/d12 0 2024-04-22T00:02:50.539 INFO:tasks.workunit.client.0.smithi110.stdout:6/686: write d16/f1b [3532961,58537] 0 2024-04-22T00:02:50.688 INFO:tasks.workunit.client.0.smithi110.stdout:7/691: dwrite d10/d45/d51/db1/dc9/df5/fe5 [0,4194304] 0 2024-04-22T00:02:50.799 INFO:tasks.workunit.client.0.smithi110.stdout:2/745: creat d9/d1a/d1d/d2b/ff9 x:0 0 0 2024-04-22T00:02:50.811 INFO:tasks.workunit.client.0.smithi110.stdout:3/679: mknod d6/d12/d50/ce5 0 2024-04-22T00:02:51.107 INFO:tasks.workunit.client.0.smithi110.stdout:5/693: truncate d7/f72 1756411 0 2024-04-22T00:02:51.502 INFO:tasks.workunit.client.0.smithi110.stdout:6/687: symlink d16/d1d/d38/d48/d5e/le2 0 2024-04-22T00:02:51.567 INFO:tasks.workunit.client.0.smithi110.stdout:4/632: rename d1/d35/db9/d20/d23/l7 to d1/d35/db9/d20/d58/d93/d5e/ldc 0 2024-04-22T00:02:51.626 INFO:tasks.workunit.client.0.smithi110.stdout:7/692: creat d10/d45/d51/d58/ff6 x:0 0 0 2024-04-22T00:02:52.180 INFO:tasks.workunit.client.0.smithi110.stdout:3/680: symlink d6/d12/d14/le6 0 2024-04-22T00:02:52.348 INFO:tasks.workunit.client.0.smithi110.stdout:9/694: write d1/d29/d6f/f83 [3099279,78140] 0 2024-04-22T00:02:52.534 INFO:tasks.workunit.client.0.smithi110.stdout:2/746: dread d9/d25/d1b/d45/d4d/fe1 [0,4194304] 0 2024-04-22T00:02:52.621 INFO:tasks.workunit.client.0.smithi110.stdout:4/633: mkdir d1/d35/db9/d20/d58/d7e/ddd 0 2024-04-22T00:02:52.658 INFO:tasks.workunit.client.0.smithi110.stdout:8/759: dwrite d5/d24/d33/d3d/d5c/fb0 [8388608,4194304] 0 2024-04-22T00:02:52.812 INFO:tasks.workunit.client.0.smithi110.stdout:9/695: chown d1/d29/d2a/d2b/c6a 30019151 1 2024-04-22T00:02:52.874 INFO:tasks.workunit.client.0.smithi110.stdout:8/760: stat d5/d4f/f76 0 2024-04-22T00:02:53.077 INFO:tasks.workunit.client.0.smithi110.stdout:0/702: rmdir d0/d25 39 2024-04-22T00:02:53.162 INFO:tasks.workunit.client.0.smithi110.stdout:7/693: dread d10/d15/fc8 [0,4194304] 0 2024-04-22T00:02:53.215 INFO:tasks.workunit.client.0.smithi110.stdout:8/761: dread d5/da/d17/d60/fc1 [0,4194304] 0 2024-04-22T00:02:53.256 INFO:tasks.workunit.client.0.smithi110.stdout:8/762: stat d5/d4f/f76 0 2024-04-22T00:02:53.266 INFO:tasks.workunit.client.0.smithi110.stdout:7/694: chown d10/d45/d60/d5e/lcc 32302 1 2024-04-22T00:02:53.516 INFO:tasks.workunit.client.0.smithi110.stdout:1/666: creat d1/fe3 x:0 0 0 2024-04-22T00:02:53.676 INFO:tasks.workunit.client.0.smithi110.stdout:5/694: dwrite d7/d9/d17/d48/f63 [0,4194304] 0 2024-04-22T00:02:53.974 INFO:tasks.workunit.client.0.smithi110.stdout:6/688: link d16/d1d/d38/fbf d16/d1e/da8/fe3 0 2024-04-22T00:02:54.423 INFO:tasks.workunit.client.0.smithi110.stdout:8/763: rename d5/da/c13 to d5/da/d17/d6c/d7d/c10a 0 2024-04-22T00:02:54.441 INFO:tasks.workunit.client.0.smithi110.stdout:7/695: creat d10/d45/ff7 x:0 0 0 2024-04-22T00:02:54.689 INFO:tasks.workunit.client.0.smithi110.stdout:1/667: mkdir d1/d1d/d70/de4 0 2024-04-22T00:02:54.721 INFO:tasks.workunit.client.0.smithi110.stdout:1/668: stat d1/d1d/d57/f62 0 2024-04-22T00:02:55.142 INFO:tasks.workunit.client.0.smithi110.stdout:9/696: mknod d1/d29/d59/d99/cd4 0 2024-04-22T00:02:55.289 INFO:tasks.workunit.client.0.smithi110.stdout:6/689: mknod d16/d1e/da8/ce4 0 2024-04-22T00:02:55.431 INFO:tasks.workunit.client.0.smithi110.stdout:8/764: unlink d5/d24/d33/d3d/dfd/l86 0 2024-04-22T00:02:55.450 INFO:tasks.workunit.client.0.smithi110.stdout:8/765: readlink d5/d24/la2 0 2024-04-22T00:02:55.535 INFO:tasks.workunit.client.0.smithi110.stdout:7/696: rename d10/d45/d60/d5e/d65/d8a/fa5 to d10/d45/d51/d88/d39/d7f/dd6/ff8 0 2024-04-22T00:02:55.920 INFO:tasks.workunit.client.0.smithi110.stdout:3/681: getdents d6/d12/d16/d6f/dab 0 2024-04-22T00:02:56.013 INFO:tasks.workunit.client.0.smithi110.stdout:2/747: creat d9/d1a/d1d/d2b/ffa x:0 0 0 2024-04-22T00:02:56.076 INFO:tasks.workunit.client.0.smithi110.stdout:0/703: write d0/d27/f6b [2378151,48899] 0 2024-04-22T00:02:56.128 INFO:tasks.workunit.client.0.smithi110.stdout:4/634: creat d1/d35/db9/fde x:0 0 0 2024-04-22T00:02:56.245 INFO:tasks.workunit.client.0.smithi110.stdout:4/635: dread d1/d35/db9/d20/dbf/d5f/fd1 [0,4194304] 0 2024-04-22T00:02:56.806 INFO:tasks.workunit.client.0.smithi110.stdout:8/766: mkdir d5/d4f/d79/d10b 0 2024-04-22T00:02:57.511 INFO:tasks.workunit.client.0.smithi110.stdout:0/704: dread d0/d14/d23/d3b/f67 [0,4194304] 0 2024-04-22T00:02:58.242 INFO:tasks.workunit.client.0.smithi110.stdout:1/669: dwrite d1/d2/d1b/d10/f5f [4194304,4194304] 0 2024-04-22T00:02:58.675 INFO:tasks.workunit.client.0.smithi110.stdout:9/697: write d1/d29/d2a/dc/f90 [1481433,40731] 0 2024-04-22T00:02:58.933 INFO:tasks.workunit.client.0.smithi110.stdout:7/697: write d10/d45/d51/d88/dce/fda [624181,23232] 0 2024-04-22T00:02:59.150 INFO:tasks.workunit.client.0.smithi110.stdout:4/636: mknod d1/d35/db9/d20/d23/d1c/cdf 0 2024-04-22T00:02:59.181 INFO:tasks.workunit.client.0.smithi110.stdout:3/682: write d6/d12/d16/d30/fae [782674,45337] 0 2024-04-22T00:02:59.184 INFO:tasks.workunit.client.0.smithi110.stdout:5/695: link d7/d22/d5b/d68/c7c d7/d9/d17/d48/cc5 0 2024-04-22T00:02:59.192 INFO:tasks.workunit.client.0.smithi110.stdout:2/748: write d9/d25/d1b/d45/d50/d68/fb1 [1304409,76102] 0 2024-04-22T00:02:59.263 INFO:tasks.workunit.client.0.smithi110.stdout:1/670: fdatasync d1/dd/d23/f74 0 2024-04-22T00:02:59.394 INFO:tasks.workunit.client.0.smithi110.stdout:2/749: dread - d9/d1a/d1d/d4e/db5/fdb zero size 2024-04-22T00:02:59.619 INFO:tasks.workunit.client.0.smithi110.stdout:8/767: creat d5/da/d17/dbf/f10c x:0 0 0 2024-04-22T00:02:59.870 INFO:tasks.workunit.client.0.smithi110.stdout:9/698: fsync d1/d29/d2a/d6/d1d/f7c 0 2024-04-22T00:03:00.043 INFO:tasks.workunit.client.0.smithi110.stdout:0/705: creat d0/d27/dcd/df2/ff8 x:0 0 0 2024-04-22T00:03:00.410 INFO:tasks.workunit.client.0.smithi110.stdout:6/690: getdents d16/d1d/d38/d48/d5e/d6a/db6 0 2024-04-22T00:03:00.511 INFO:tasks.workunit.client.0.smithi110.stdout:5/696: creat d7/d24/d3a/da7/fc6 x:0 0 0 2024-04-22T00:03:00.657 INFO:tasks.workunit.client.0.smithi110.stdout:3/683: rename d6/d12/d3c/d65/d91/ld5 to d6/d12/d16/d30/d67/le7 0 2024-04-22T00:03:00.798 INFO:tasks.workunit.client.0.smithi110.stdout:2/750: rmdir d9/d25/d1b/d45/d50 39 2024-04-22T00:03:01.863 INFO:tasks.workunit.client.0.smithi110.stdout:7/698: mkdir d10/d45/d51/db1/dee/df0/df9 0 2024-04-22T00:03:02.069 INFO:tasks.workunit.client.0.smithi110.stdout:6/691: mknod d16/d3d/d40/d46/ce5 0 2024-04-22T00:03:02.102 INFO:tasks.workunit.client.0.smithi110.stdout:6/692: chown d16/d1e/d24/le1 277209 1 2024-04-22T00:03:02.468 INFO:tasks.workunit.client.0.smithi110.stdout:1/671: mknod d1/d2/d1b/d10/d5c/dc5/d27/d3e/dba/ce5 0 2024-04-22T00:03:02.474 INFO:tasks.workunit.client.0.smithi110.stdout:4/637: write d1/d35/db9/f69 [1531375,8363] 0 2024-04-22T00:03:02.535 INFO:tasks.workunit.client.0.smithi110.stdout:1/672: readlink d1/d2/d30/lbb 0 2024-04-22T00:03:02.690 INFO:tasks.workunit.client.0.smithi110.stdout:8/768: mknod d5/d4f/d79/d10b/c10d 0 2024-04-22T00:03:03.947 INFO:tasks.workunit.client.0.smithi110.stdout:6/693: dread d16/d1e/da8/fe3 [0,4194304] 0 2024-04-22T00:03:04.065 INFO:tasks.workunit.client.0.smithi110.stdout:1/673: fsync d1/d2/d1b/d10/d5c/dc5/d27/fbf 0 2024-04-22T00:03:04.315 INFO:tasks.workunit.client.0.smithi110.stdout:2/751: truncate d9/d25/d1b/d45/d4d/f74 624518 0 2024-04-22T00:03:04.392 INFO:tasks.workunit.client.0.smithi110.stdout:9/699: link d1/d29/d59/d99/cd4 d1/d29/d4d/cd5 0 2024-04-22T00:03:04.579 INFO:tasks.workunit.client.0.smithi110.stdout:0/706: creat d0/d16/d42/d50/ff9 x:0 0 0 2024-04-22T00:03:04.690 INFO:tasks.workunit.client.0.smithi110.stdout:3/684: link d6/d12/d16/d30/dc7/fdc d6/d12/d3c/d8d/fe8 0 2024-04-22T00:03:05.134 INFO:tasks.workunit.client.0.smithi110.stdout:6/694: mknod d16/d1d/d38/d48/d5e/db1/ce6 0 2024-04-22T00:03:05.138 INFO:tasks.workunit.client.0.smithi110.stdout:5/697: write d7/d22/d5d/f95 [949202,91204] 0 2024-04-22T00:03:05.139 INFO:tasks.workunit.client.0.smithi110.stdout:4/638: creat d1/d35/db9/d20/d23/d1c/d40/dcf/fe0 x:0 0 0 2024-04-22T00:03:05.294 INFO:tasks.workunit.client.0.smithi110.stdout:1/674: creat d1/d2/d1b/d10/d5c/dc5/d27/d3e/fe6 x:0 0 0 2024-04-22T00:03:05.599 INFO:tasks.workunit.client.0.smithi110.stdout:9/700: read d1/d29/d2a/d3c/fa6 [1092865,55793] 0 2024-04-22T00:03:06.525 INFO:tasks.workunit.client.0.smithi110.stdout:4/639: read d1/d35/db9/d20/d50/f70 [1392807,101305] 0 2024-04-22T00:03:06.567 INFO:tasks.workunit.client.0.smithi110.stdout:4/640: chown d1/d35/db9/d20/dc4/ld0 1970257 1 2024-04-22T00:03:06.704 INFO:tasks.workunit.client.0.smithi110.stdout:5/698: mknod d7/d22/d5b/d86/cc7 0 2024-04-22T00:03:07.125 INFO:tasks.workunit.client.0.smithi110.stdout:6/695: creat d16/d1d/d38/d48/d5e/fe7 x:0 0 0 2024-04-22T00:03:07.138 INFO:tasks.workunit.client.0.smithi110.stdout:1/675: creat d1/d2/d1b/d10/d5c/dc5/d27/d3e/fe7 x:0 0 0 2024-04-22T00:03:07.148 INFO:tasks.workunit.client.0.smithi110.stdout:2/752: truncate d9/d25/d1b/d45/d50/f89 120289 0 2024-04-22T00:03:07.549 INFO:tasks.workunit.client.0.smithi110.stdout:7/699: dwrite d10/d45/d51/d88/f8e [4194304,4194304] 0 2024-04-22T00:03:07.728 INFO:tasks.workunit.client.0.smithi110.stdout:3/685: fsync d6/d12/d3c/fc4 0 2024-04-22T00:03:07.890 INFO:tasks.workunit.client.0.smithi110.stdout:3/686: sync 2024-04-22T00:03:07.983 INFO:tasks.workunit.client.0.smithi110.stdout:4/641: rename d1/d35/db9/d20/d58/d93/d7c/fa6 to d1/d35/db9/d20/d23/fe1 0 2024-04-22T00:03:08.020 INFO:tasks.workunit.client.0.smithi110.stdout:8/769: write d5/d6f/f89 [437114,23428] 0 2024-04-22T00:03:08.167 INFO:tasks.workunit.client.0.smithi110.stdout:1/676: mknod d1/d1d/d57/ce8 0 2024-04-22T00:03:08.510 INFO:tasks.workunit.client.0.smithi110.stdout:5/699: dread d7/d9/f33 [0,4194304] 0 2024-04-22T00:03:08.541 INFO:tasks.workunit.client.0.smithi110.stdout:5/700: readlink d7/l84 0 2024-04-22T00:03:08.823 INFO:tasks.workunit.client.0.smithi110.stdout:0/707: write d0/d27/d4b/f54 [3065021,45616] 0 2024-04-22T00:03:08.857 INFO:tasks.workunit.client.0.smithi110.stdout:5/701: dread d7/d24/f36 [0,4194304] 0 2024-04-22T00:03:08.900 INFO:tasks.workunit.client.0.smithi110.stdout:0/708: stat d0/d56/dc9/fe5 0 2024-04-22T00:03:09.187 INFO:tasks.workunit.client.0.smithi110.stdout:7/700: mknod d10/d45/d51/d88/d39/d7f/cfa 0 2024-04-22T00:03:09.352 INFO:tasks.workunit.client.0.smithi110.stdout:3/687: chown d6/d12/d3c/d65/c86 431350 1 2024-04-22T00:03:09.379 INFO:tasks.workunit.client.0.smithi110.stdout:3/688: chown d6/d78/c7f 1 1 2024-04-22T00:03:09.403 INFO:tasks.workunit.client.0.smithi110.stdout:3/689: stat d6/d12/d16/l27 0 2024-04-22T00:03:09.656 INFO:tasks.workunit.client.0.smithi110.stdout:8/770: unlink d5/d24/d33/c48 0 2024-04-22T00:03:10.010 INFO:tasks.workunit.client.0.smithi110.stdout:1/677: rename d1/d2/d1b/d10/d5c to d1/d2/d1b/d10/d5c/dc5/d27/de9 22 2024-04-22T00:03:10.117 INFO:tasks.workunit.client.0.smithi110.stdout:0/709: mknod d0/d16/d5d/dc5/cfa 0 2024-04-22T00:03:10.191 INFO:tasks.workunit.client.0.smithi110.stdout:9/701: write d1/d29/d2a/d6/d1d/f84 [265323,109960] 0 2024-04-22T00:03:10.274 INFO:tasks.workunit.client.0.smithi110.stdout:6/696: creat d16/d1d/d38/fe8 x:0 0 0 2024-04-22T00:03:10.553 INFO:tasks.workunit.client.0.smithi110.stdout:8/771: readlink d5/da/d88/dd4/lf2 0 2024-04-22T00:03:10.615 INFO:tasks.workunit.client.0.smithi110.stdout:9/702: dread d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-22T00:03:10.730 INFO:tasks.workunit.client.0.smithi110.stdout:7/701: rename d10/d15/d95/ff1 to d10/d45/d51/d88/d39/ffb 0 2024-04-22T00:03:10.761 INFO:tasks.workunit.client.0.smithi110.stdout:7/702: read d10/f1d [2472735,56237] 0 2024-04-22T00:03:10.839 INFO:tasks.workunit.client.0.smithi110.stdout:7/703: read d10/f1d [4098978,92594] 0 2024-04-22T00:03:10.955 INFO:tasks.workunit.client.0.smithi110.stdout:1/678: symlink d1/dd/d23/d48/lea 0 2024-04-22T00:03:11.215 INFO:tasks.workunit.client.0.smithi110.stdout:4/642: write d1/f8f [522563,5028] 0 2024-04-22T00:03:11.480 INFO:tasks.workunit.client.0.smithi110.stdout:0/710: dread - d0/d14/d23/d3b/fdd zero size 2024-04-22T00:03:11.484 INFO:tasks.workunit.client.0.smithi110.stdout:5/702: write d7/d24/d3a/da7/fbc [440953,129519] 0 2024-04-22T00:03:11.526 INFO:tasks.workunit.client.0.smithi110.stdout:2/753: dwrite d9/d25/d1c/f3c [0,4194304] 0 2024-04-22T00:03:11.713 INFO:tasks.workunit.client.0.smithi110.stdout:0/711: readlink d0/d27/d68/d7d/lac 0 2024-04-22T00:03:11.734 INFO:tasks.workunit.client.0.smithi110.stdout:2/754: chown d9/d1a/d1d/d4e/cbc 109 1 2024-04-22T00:03:11.759 INFO:tasks.workunit.client.0.smithi110.stdout:0/712: chown d0/d14/d23/d6d/ce4 15472586 1 2024-04-22T00:03:11.837 INFO:tasks.workunit.client.0.smithi110.stdout:0/713: chown d0/d14/d23/d6d/da8/laa 1 1 2024-04-22T00:03:12.582 INFO:tasks.workunit.client.0.smithi110.stdout:7/704: fsync d10/d45/d51/db1/ff2 0 2024-04-22T00:03:12.806 INFO:tasks.workunit.client.0.smithi110.stdout:1/679: rename d1/d1d/d57/d91 to d1/d2/d1b/d10/d5c/d77/d78/deb 0 2024-04-22T00:03:12.947 INFO:tasks.workunit.client.0.smithi110.stdout:4/643: creat d1/d35/db9/d20/d23/d1c/d40/fe2 x:0 0 0 2024-04-22T00:03:12.988 INFO:tasks.workunit.client.0.smithi110.stdout:3/690: link d6/d12/d16/l71 d6/d12/d14/le9 0 2024-04-22T00:03:13.149 INFO:tasks.workunit.client.0.smithi110.stdout:6/697: mknod d16/d3d/d40/ce9 0 2024-04-22T00:03:13.424 INFO:tasks.workunit.client.0.smithi110.stdout:8/772: dwrite d5/f2a [0,4194304] 0 2024-04-22T00:03:14.493 INFO:tasks.workunit.client.0.smithi110.stdout:4/644: fsync d1/d35/d6b/faf 0 2024-04-22T00:03:14.497 INFO:tasks.workunit.client.0.smithi110.stdout:9/703: write d1/d29/d6f/db4/fa0 [938998,96724] 0 2024-04-22T00:03:14.559 INFO:tasks.workunit.client.0.smithi110.stdout:9/704: chown d1/d29/d2a/d6/fa9 95228402 1 2024-04-22T00:03:14.707 INFO:tasks.workunit.client.0.smithi110.stdout:4/645: sync 2024-04-22T00:03:15.108 INFO:tasks.workunit.client.0.smithi110.stdout:0/714: mkdir d0/d14/d23/d6d/dde/dfb 0 2024-04-22T00:03:15.646 INFO:tasks.workunit.client.0.smithi110.stdout:5/703: write d7/d24/d31/f5e [13574146,46753] 0 2024-04-22T00:03:15.703 INFO:tasks.workunit.client.0.smithi110.stdout:9/705: dread - d1/d29/d2a/dc/fcb zero size 2024-04-22T00:03:15.748 INFO:tasks.workunit.client.0.smithi110.stdout:5/704: sync 2024-04-22T00:03:15.822 INFO:tasks.workunit.client.0.smithi110.stdout:3/691: fsync d6/d12/d16/d30/d67/f93 0 2024-04-22T00:03:16.215 INFO:tasks.workunit.client.0.smithi110.stdout:2/755: dwrite d9/d25/d1b/d60/fde [0,4194304] 0 2024-04-22T00:03:16.633 INFO:tasks.workunit.client.0.smithi110.stdout:3/692: mkdir d6/d12/da1/dea 0 2024-04-22T00:03:17.136 INFO:tasks.workunit.client.0.smithi110.stdout:1/680: getdents d1/d2/d1b/d10/da2 0 2024-04-22T00:03:17.288 INFO:tasks.workunit.client.0.smithi110.stdout:0/715: fdatasync d0/d25/d5a/fc7 0 2024-04-22T00:03:17.370 INFO:tasks.workunit.client.0.smithi110.stdout:2/756: creat d9/d25/d1b/ffb x:0 0 0 2024-04-22T00:03:18.205 INFO:tasks.workunit.client.0.smithi110.stdout:1/681: read - d1/dd/d23/fe1 zero size 2024-04-22T00:03:18.321 INFO:tasks.workunit.client.0.smithi110.stdout:0/716: truncate d0/d14/f5f 542307 0 2024-04-22T00:03:18.327 INFO:tasks.workunit.client.0.smithi110.stdout:8/773: dwrite d5/d24/d33/d3d/d82/fd9 [0,4194304] 0 2024-04-22T00:03:18.471 INFO:tasks.workunit.client.0.smithi110.stdout:6/698: dwrite d16/d3d/d40/d46/f67 [0,4194304] 0 2024-04-22T00:03:18.502 INFO:tasks.workunit.client.0.smithi110.stdout:4/646: getdents d1/d35/db9/d20/d58/d7e 0 2024-04-22T00:03:19.210 INFO:tasks.workunit.client.0.smithi110.stdout:9/706: dwrite d1/d29/d6f/f8a [0,4194304] 0 2024-04-22T00:03:19.543 INFO:tasks.workunit.client.0.smithi110.stdout:0/717: mkdir d0/d27/dfc 0 2024-04-22T00:03:19.554 INFO:tasks.workunit.client.0.smithi110.stdout:4/647: unlink d1/d35/db9/f3d 0 2024-04-22T00:03:19.598 INFO:tasks.workunit.client.0.smithi110.stdout:6/699: dread - d16/d1d/d38/d48/d5e/fe7 zero size 2024-04-22T00:03:19.661 INFO:tasks.workunit.client.0.smithi110.stdout:3/693: dwrite d6/d12/d14/f25 [4194304,4194304] 0 2024-04-22T00:03:19.823 INFO:tasks.workunit.client.0.smithi110.stdout:6/700: chown d16/d1e/d24/f2c 244875 1 2024-04-22T00:03:20.044 INFO:tasks.workunit.client.0.smithi110.stdout:2/757: creat d9/d1a/ffc x:0 0 0 2024-04-22T00:03:20.401 INFO:tasks.workunit.client.0.smithi110.stdout:7/705: rename d10/cd1 to d10/d45/d51/d88/cfc 0 2024-04-22T00:03:20.449 INFO:tasks.workunit.client.0.smithi110.stdout:3/694: creat d6/d12/d3c/d8d/feb x:0 0 0 2024-04-22T00:03:20.579 INFO:tasks.workunit.client.0.smithi110.stdout:4/648: mknod d1/d35/db9/d20/dbf/d5f/dc0/ce3 0 2024-04-22T00:03:20.908 INFO:tasks.workunit.client.0.smithi110.stdout:9/707: mkdir d1/d29/d2a/d9d/dd6 0 2024-04-22T00:03:20.977 INFO:tasks.workunit.client.0.smithi110.stdout:2/758: read - d9/d1a/d1d/d2b/d54/d77/fca zero size 2024-04-22T00:03:21.284 INFO:tasks.workunit.client.0.smithi110.stdout:1/682: dwrite d1/d2/d30/f47 [0,4194304] 0 2024-04-22T00:03:21.405 INFO:tasks.workunit.client.0.smithi110.stdout:5/705: rename d7/d24/d3a/d54/l62 to d7/d24/d31/lc8 0 2024-04-22T00:03:21.507 INFO:tasks.workunit.client.0.smithi110.stdout:3/695: symlink d6/d12/d14/d4b/lec 0 2024-04-22T00:03:21.620 INFO:tasks.workunit.client.0.smithi110.stdout:7/706: symlink d10/d45/d51/db1/dee/df0/lfd 0 2024-04-22T00:03:21.626 INFO:tasks.workunit.client.0.smithi110.stdout:7/707: stat la 0 2024-04-22T00:03:21.765 INFO:tasks.workunit.client.0.smithi110.stdout:4/649: creat d1/d35/db9/d20/d23/d1c/dae/fe4 x:0 0 0 2024-04-22T00:03:21.931 INFO:tasks.workunit.client.0.smithi110.stdout:4/650: sync 2024-04-22T00:03:21.990 INFO:tasks.workunit.client.0.smithi110.stdout:4/651: dread d1/d35/db9/d20/d23/f98 [0,4194304] 0 2024-04-22T00:03:22.567 INFO:tasks.workunit.client.0.smithi110.stdout:0/718: rmdir d0/d27/dfc 0 2024-04-22T00:03:22.594 INFO:tasks.workunit.client.0.smithi110.stdout:0/719: readlink d0/d27/l3c 0 2024-04-22T00:03:22.715 INFO:tasks.workunit.client.0.smithi110.stdout:2/759: fdatasync d9/d25/d1b/d60/f67 0 2024-04-22T00:03:22.764 INFO:tasks.workunit.client.0.smithi110.stdout:2/760: write d9/d1a/ffc [668226,101346] 0 2024-04-22T00:03:22.802 INFO:tasks.workunit.client.0.smithi110.stdout:6/701: write d16/d1e/d24/d66/f6e [3629795,28984] 0 2024-04-22T00:03:22.892 INFO:tasks.workunit.client.0.smithi110.stdout:6/702: write d16/d3d/d40/d46/f67 [1482514,87670] 0 2024-04-22T00:03:22.919 INFO:tasks.workunit.client.0.smithi110.stdout:8/774: rename d5/d4f/lfe to d5/d4f/d79/l10e 0 2024-04-22T00:03:23.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/696: creat d6/d12/d3c/d65/d91/fed x:0 0 0 2024-04-22T00:03:23.435 INFO:tasks.workunit.client.0.smithi110.stdout:7/708: truncate d10/d45/ff7 552128 0 2024-04-22T00:03:23.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/652: unlink d1/d35/db9/d20/d58/d93/d5e/fd9 0 2024-04-22T00:03:24.554 INFO:tasks.workunit.client.0.smithi110.stdout:0/720: creat d0/d16/d42/d50/dbc/ffd x:0 0 0 2024-04-22T00:03:24.918 INFO:tasks.workunit.client.0.smithi110.stdout:2/761: rename d9/d1a/d1d/d2b/f69 to d9/d25/de5/ffd 0 2024-04-22T00:03:25.286 INFO:tasks.workunit.client.0.smithi110.stdout:5/706: creat d7/d35/dc0/fc9 x:0 0 0 2024-04-22T00:03:25.306 INFO:tasks.workunit.client.0.smithi110.stdout:8/775: creat d5/d24/d33/d3d/d82/da8/f10f x:0 0 0 2024-04-22T00:03:26.182 INFO:tasks.workunit.client.0.smithi110.stdout:4/653: dread d1/d35/db9/f4b [0,4194304] 0 2024-04-22T00:03:26.197 INFO:tasks.workunit.client.0.smithi110.stdout:0/721: truncate d0/d27/f6b 1321030 0 2024-04-22T00:03:26.344 INFO:tasks.workunit.client.0.smithi110.stdout:2/762: chown d9/d1a/d1d/d7a/ccf 1305730559 1 2024-04-22T00:03:26.517 INFO:tasks.workunit.client.0.smithi110.stdout:8/776: dread d5/da/d17/d7c/dc0/fcf [0,4194304] 0 2024-04-22T00:03:26.568 INFO:tasks.workunit.client.0.smithi110.stdout:5/707: rename d7/d22/d5b/lb1 to d7/d24/d3a/d54/lca 0 2024-04-22T00:03:26.689 INFO:tasks.workunit.client.0.smithi110.stdout:1/683: link d1/dd/d23/d48/d4e/d86/ld5 d1/d2/d14/d65/d8a/da6/lec 0 2024-04-22T00:03:27.417 INFO:tasks.workunit.client.0.smithi110.stdout:6/703: write d16/d1e/f2a [2951631,29280] 0 2024-04-22T00:03:27.558 INFO:tasks.workunit.client.0.smithi110.stdout:8/777: dread d5/d74/fb1 [0,4194304] 0 2024-04-22T00:03:27.778 INFO:tasks.workunit.client.0.smithi110.stdout:1/684: creat d1/d2/d14/fed x:0 0 0 2024-04-22T00:03:27.881 INFO:tasks.workunit.client.0.smithi110.stdout:5/708: dread d7/d24/d49/d64/f83 [0,4194304] 0 2024-04-22T00:03:27.907 INFO:tasks.workunit.client.0.smithi110.stdout:5/709: chown d7/d24/f36 198258548 1 2024-04-22T00:03:27.979 INFO:tasks.workunit.client.0.smithi110.stdout:9/708: link d1/d29/d2a/d2b/l3e d1/d52/d76/ld7 0 2024-04-22T00:03:28.466 INFO:tasks.workunit.client.0.smithi110.stdout:6/704: creat d16/d1d/d38/d48/d5e/d62/fea x:0 0 0 2024-04-22T00:03:28.543 INFO:tasks.workunit.client.0.smithi110.stdout:8/778: chown d5/d24/d33/d3d/c57 63266 1 2024-04-22T00:03:28.756 INFO:tasks.workunit.client.0.smithi110.stdout:3/697: getdents d6/d12/d16 0 2024-04-22T00:03:28.874 INFO:tasks.workunit.client.0.smithi110.stdout:8/779: sync 2024-04-22T00:03:28.906 INFO:tasks.workunit.client.0.smithi110.stdout:5/710: read d7/d24/d3a/d40/fa8 [3060616,14703] 0 2024-04-22T00:03:28.957 INFO:tasks.workunit.client.0.smithi110.stdout:8/780: chown d5/d24/d33/d3d/d82/l107 28 1 2024-04-22T00:03:29.103 INFO:tasks.workunit.client.0.smithi110.stdout:9/709: creat d1/d29/d2a/d2b/d58/fd8 x:0 0 0 2024-04-22T00:03:29.458 INFO:tasks.workunit.client.0.smithi110.stdout:4/654: creat d1/fe5 x:0 0 0 2024-04-22T00:03:29.594 INFO:tasks.workunit.client.0.smithi110.stdout:6/705: unlink d16/l37 0 2024-04-22T00:03:29.819 INFO:tasks.workunit.client.0.smithi110.stdout:3/698: fsync d6/d12/d14/f53 0 2024-04-22T00:03:29.819 INFO:tasks.workunit.client.0.smithi110.stdout:1/685: getdents d1/d2/d1b/d10/da2 0 2024-04-22T00:03:29.880 INFO:tasks.workunit.client.0.smithi110.stdout:3/699: chown d6/d12/da1/fe0 14146 1 2024-04-22T00:03:29.933 INFO:tasks.workunit.client.0.smithi110.stdout:5/711: creat d7/d24/d37/d38/d88/fcb x:0 0 0 2024-04-22T00:03:30.249 INFO:tasks.workunit.client.0.smithi110.stdout:8/781: rename d5/da/d17/l2e to d5/d24/d33/d3d/d5c/d6a/l110 0 2024-04-22T00:03:30.297 INFO:tasks.workunit.client.0.smithi110.stdout:2/763: write d9/d25/d1c/f28 [3822398,16690] 0 2024-04-22T00:03:30.410 INFO:tasks.workunit.client.0.smithi110.stdout:4/655: mkdir d1/d35/db9/d12/de6 0 2024-04-22T00:03:30.653 INFO:tasks.workunit.client.0.smithi110.stdout:3/700: mkdir d6/d12/d3c/d8d/dee 0 2024-04-22T00:03:30.665 INFO:tasks.workunit.client.0.smithi110.stdout:5/712: mknod d7/d24/d3a/d54/ccc 0 2024-04-22T00:03:30.709 INFO:tasks.workunit.client.0.smithi110.stdout:7/709: getdents d10/d45/d51/d88/d39/d7f/d80/d53 0 2024-04-22T00:03:30.936 INFO:tasks.workunit.client.0.smithi110.stdout:2/764: rename d9/d25/d1b/d45/d8e/cc2 to d9/d25/d1b/d45/d8e/dd5/cfe 0 2024-04-22T00:03:30.965 INFO:tasks.workunit.client.0.smithi110.stdout:0/722: write d0/d2a/fdc [874521,30947] 0 2024-04-22T00:03:31.000 INFO:tasks.workunit.client.0.smithi110.stdout:4/656: creat d1/d35/db9/d20/d58/d7e/fe7 x:0 0 0 2024-04-22T00:03:31.115 INFO:tasks.workunit.client.0.smithi110.stdout:2/765: sync 2024-04-22T00:03:31.165 INFO:tasks.workunit.client.0.smithi110.stdout:0/723: sync 2024-04-22T00:03:32.136 INFO:tasks.workunit.client.0.smithi110.stdout:6/706: link d16/d1d/d38/d48/d5e/d6a/db6/cc8 d16/d1e/d24/d7b/ceb 0 2024-04-22T00:03:32.670 INFO:tasks.workunit.client.0.smithi110.stdout:9/710: write d1/d29/d2a/d6/d1d/f24 [4670617,1206] 0 2024-04-22T00:03:32.935 INFO:tasks.workunit.client.0.smithi110.stdout:5/713: fdatasync d7/d24/d49/d64/f70 0 2024-04-22T00:03:33.119 INFO:tasks.workunit.client.0.smithi110.stdout:1/686: write d1/d2/d14/f9d [4647507,3375] 0 2024-04-22T00:03:33.285 INFO:tasks.workunit.client.0.smithi110.stdout:6/707: mkdir d16/d1e/d24/d90/dec 0 2024-04-22T00:03:33.361 INFO:tasks.workunit.client.0.smithi110.stdout:9/711: chown d1/d19/fb5 7166 1 2024-04-22T00:03:33.729 INFO:tasks.workunit.client.0.smithi110.stdout:8/782: dwrite d5/da/d17/d6c/d95/fa6 [0,4194304] 0 2024-04-22T00:03:33.847 INFO:tasks.workunit.client.0.smithi110.stdout:1/687: rename d1/d2/d30/f47 to d1/d2/d1b/d10/da2/fee 0 2024-04-22T00:03:33.969 INFO:tasks.workunit.client.0.smithi110.stdout:6/708: fsync d16/fbe 0 2024-04-22T00:03:33.998 INFO:tasks.workunit.client.0.smithi110.stdout:6/709: dread - d16/d1e/d24/f2c zero size 2024-04-22T00:03:34.269 INFO:tasks.workunit.client.0.smithi110.stdout:7/710: dwrite d10/d45/d51/d88/f6d [0,4194304] 0 2024-04-22T00:03:34.319 INFO:tasks.workunit.client.0.smithi110.stdout:3/701: getdents d6/d12 0 2024-04-22T00:03:34.462 INFO:tasks.workunit.client.0.smithi110.stdout:2/766: write d9/d1a/d1d/fa9 [965124,26539] 0 2024-04-22T00:03:34.498 INFO:tasks.workunit.client.0.smithi110.stdout:0/724: write d0/d14/d23/d3b/f67 [1693610,111240] 0 2024-04-22T00:03:34.606 INFO:tasks.workunit.client.0.smithi110.stdout:8/783: mkdir d5/da/d17/d6c/d95/d111 0 2024-04-22T00:03:34.607 INFO:tasks.workunit.client.0.smithi110.stdout:4/657: getdents d1/d35/db9/d20/d23/d1c/d47/d95 0 2024-04-22T00:03:34.726 INFO:tasks.workunit.client.0.smithi110.stdout:1/688: fdatasync d1/d2/d1b/d10/d5c/d77/fd3 0 2024-04-22T00:03:35.377 INFO:tasks.workunit.client.0.smithi110.stdout:7/711: creat d10/d45/d51/d88/d46/d69/ffe x:0 0 0 2024-04-22T00:03:35.758 INFO:tasks.workunit.client.0.smithi110.stdout:2/767: rename d9/f15 to d9/d1a/d7b/dab/dc1/fff 0 2024-04-22T00:03:35.931 INFO:tasks.workunit.client.0.smithi110.stdout:8/784: truncate d5/da/d17/d6c/fb5 290218 0 2024-04-22T00:03:36.259 INFO:tasks.workunit.client.0.smithi110.stdout:5/714: getdents d7/d22/d5b/d6f 0 2024-04-22T00:03:36.764 INFO:tasks.workunit.client.0.smithi110.stdout:7/712: dread f5 [0,4194304] 0 2024-04-22T00:03:37.036 INFO:tasks.workunit.client.0.smithi110.stdout:8/785: creat d5/da/d17/d6c/d95/f112 x:0 0 0 2024-04-22T00:03:37.278 INFO:tasks.workunit.client.0.smithi110.stdout:7/713: read d10/d15/fc5 [12042195,82562] 0 2024-04-22T00:03:37.493 INFO:tasks.workunit.client.0.smithi110.stdout:8/786: creat d5/d24/d33/d3d/d5c/f113 x:0 0 0 2024-04-22T00:03:37.528 INFO:tasks.workunit.client.0.smithi110.stdout:9/712: dwrite d1/d29/d6f/db4/fc9 [0,4194304] 0 2024-04-22T00:03:37.810 INFO:tasks.workunit.client.0.smithi110.stdout:7/714: rename d10/d15/fc8 to d10/d45/d60/d5e/fff 0 2024-04-22T00:03:37.881 INFO:tasks.workunit.client.0.smithi110.stdout:9/713: read d1/d29/d2a/d2b/f7f [63736,57960] 0 2024-04-22T00:03:37.919 INFO:tasks.workunit.client.0.smithi110.stdout:6/710: write d16/d1d/f5a [54427,102969] 0 2024-04-22T00:03:37.960 INFO:tasks.workunit.client.0.smithi110.stdout:6/711: chown d16/d1d/d38/d48/d5e/db1/ld4 0 1 2024-04-22T00:03:38.585 INFO:tasks.workunit.client.0.smithi110.stdout:3/702: dwrite d6/d12/d16/d30/fae [0,4194304] 0 2024-04-22T00:03:38.723 INFO:tasks.workunit.client.0.smithi110.stdout:8/787: rename d5/da/d17/d6c/d72/d73/d78 to d5/da/d17/d6c/d7d/d114 0 2024-04-22T00:03:38.785 INFO:tasks.workunit.client.0.smithi110.stdout:7/715: fsync d10/d45/d51/d88/d46/d69/d75/fed 0 2024-04-22T00:03:38.894 INFO:tasks.workunit.client.0.smithi110.stdout:9/714: mkdir d1/d29/d6f/dd9 0 2024-04-22T00:03:39.182 INFO:tasks.workunit.client.0.smithi110.stdout:8/788: stat d5/da/d17/d6c/d72/d73 0 2024-04-22T00:03:39.191 INFO:tasks.workunit.client.0.smithi110.stdout:4/658: dwrite d1/d35/db9/d20/fc9 [4194304,4194304] 0 2024-04-22T00:03:39.216 INFO:tasks.workunit.client.0.smithi110.stdout:6/712: symlink d16/d1d/d38/d48/d5e/d6a/d70/d74/led 0 2024-04-22T00:03:39.374 INFO:tasks.workunit.client.0.smithi110.stdout:5/715: write d7/d9/fad [1295204,106802] 0 2024-04-22T00:03:39.378 INFO:tasks.workunit.client.0.smithi110.stdout:0/725: dwrite d0/d14/d23/f9e [0,4194304] 0 2024-04-22T00:03:39.594 INFO:tasks.workunit.client.0.smithi110.stdout:1/689: dwrite d1/dd/d23/d48/fa8 [0,4194304] 0 2024-04-22T00:03:39.713 INFO:tasks.workunit.client.0.smithi110.stdout:8/789: readlink d5/d24/d33/d3d/d82/l107 0 2024-04-22T00:03:40.148 INFO:tasks.workunit.client.0.smithi110.stdout:3/703: dread d6/d12/d16/d30/f35 [0,4194304] 0 2024-04-22T00:03:40.190 INFO:tasks.workunit.client.0.smithi110.stdout:3/704: dread - d6/d12/d3c/d65/da8/fd7 zero size 2024-04-22T00:03:40.217 INFO:tasks.workunit.client.0.smithi110.stdout:3/705: chown d6/d12/d16/d30/dc7 110656477 1 2024-04-22T00:03:41.175 INFO:tasks.workunit.client.0.smithi110.stdout:8/790: fdatasync d5/da/d17/d6c/fad 0 2024-04-22T00:03:41.274 INFO:tasks.workunit.client.0.smithi110.stdout:7/716: symlink d10/d45/d60/l100 0 2024-04-22T00:03:41.548 INFO:tasks.workunit.client.0.smithi110.stdout:9/715: write d1/d29/d2a/d6/fe [1571333,86158] 0 2024-04-22T00:03:41.641 INFO:tasks.workunit.client.0.smithi110.stdout:4/659: write d1/d35/fb6 [964355,44900] 0 2024-04-22T00:03:41.835 INFO:tasks.workunit.client.0.smithi110.stdout:5/716: mknod d7/d24/d37/ccd 0 2024-04-22T00:03:42.379 INFO:tasks.workunit.client.0.smithi110.stdout:8/791: rmdir d5/da/d17/d7c 39 2024-04-22T00:03:42.400 INFO:tasks.workunit.client.0.smithi110.stdout:6/713: write d16/d1e/d24/f5d [2778206,90813] 0 2024-04-22T00:03:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:8/792: stat d5/da/d88/dd4/ffa 0 2024-04-22T00:03:43.239 INFO:tasks.workunit.client.0.smithi110.stdout:5/717: mknod d7/d9/d17/d48/cce 0 2024-04-22T00:03:43.522 INFO:tasks.workunit.client.0.smithi110.stdout:1/690: link d1/l1c d1/d1d/d70/lef 0 2024-04-22T00:03:43.586 INFO:tasks.workunit.client.0.smithi110.stdout:0/726: write d0/d16/d42/d50/dbc/fcc [1610436,42643] 0 2024-04-22T00:03:43.681 INFO:tasks.workunit.client.0.smithi110.stdout:0/727: write d0/d14/d23/f9e [1395109,69518] 0 2024-04-22T00:03:44.068 INFO:tasks.workunit.client.0.smithi110.stdout:3/706: write d6/d12/d16/d6f/fa4 [446039,116763] 0 2024-04-22T00:03:44.607 INFO:tasks.workunit.client.0.smithi110.stdout:5/718: truncate d7/d24/d37/f87 1043536 0 2024-04-22T00:03:44.860 INFO:tasks.workunit.client.0.smithi110.stdout:2/768: rename d9/d25/d1c/fdd to d9/d1a/f100 0 2024-04-22T00:03:45.225 INFO:tasks.workunit.client.0.smithi110.stdout:1/691: dread d1/d2/d1b/f35 [0,4194304] 0 2024-04-22T00:03:45.601 INFO:tasks.workunit.client.0.smithi110.stdout:4/660: dwrite d1/d35/db9/d20/d23/d1c/d47/d4f/fc6 [0,4194304] 0 2024-04-22T00:03:45.718 INFO:tasks.workunit.client.0.smithi110.stdout:3/707: unlink d6/d78/c7f 0 2024-04-22T00:03:46.054 INFO:tasks.workunit.client.0.smithi110.stdout:6/714: dwrite d16/d3d/d97/fa4 [0,4194304] 0 2024-04-22T00:03:46.285 INFO:tasks.workunit.client.0.smithi110.stdout:7/717: rename d10/d45/d51/d88/d39/d7f/dd4 to d10/d15/d95/d101 0 2024-04-22T00:03:46.799 INFO:tasks.workunit.client.0.smithi110.stdout:9/716: getdents d1/d19/d42 0 2024-04-22T00:03:47.530 INFO:tasks.workunit.client.0.smithi110.stdout:6/715: mknod d16/d1d/d38/d48/d5e/cee 0 2024-04-22T00:03:47.737 INFO:tasks.workunit.client.0.smithi110.stdout:1/692: mkdir d1/d2/d30/d8b/dc3/df0 0 2024-04-22T00:03:48.033 INFO:tasks.workunit.client.0.smithi110.stdout:8/793: dwrite d5/da/d17/d6c/d7d/d114/d8c/fce [0,4194304] 0 2024-04-22T00:03:48.163 INFO:tasks.workunit.client.0.smithi110.stdout:5/719: write d7/d24/d49/d61/f8f [121809,70191] 0 2024-04-22T00:03:48.359 INFO:tasks.workunit.client.0.smithi110.stdout:9/717: truncate d1/f7 5409550 0 2024-04-22T00:03:48.554 INFO:tasks.workunit.client.0.smithi110.stdout:5/720: dread d7/d9/f3d [0,4194304] 0 2024-04-22T00:03:48.610 INFO:tasks.workunit.client.0.smithi110.stdout:6/716: symlink d16/d1e/d24/d33/lef 0 2024-04-22T00:03:48.736 INFO:tasks.workunit.client.0.smithi110.stdout:2/769: link d9/d25/d1b/d45/d50/l5a d9/d1a/d1d/d2b/d5b/l101 0 2024-04-22T00:03:48.859 INFO:tasks.workunit.client.0.smithi110.stdout:3/708: write d6/f89 [4526036,86200] 0 2024-04-22T00:03:49.166 INFO:tasks.workunit.client.0.smithi110.stdout:0/728: dwrite d0/d16/d5d/dc5/fca [0,4194304] 0 2024-04-22T00:03:49.311 INFO:tasks.workunit.client.0.smithi110.stdout:1/693: mkdir d1/d2/d1b/d10/d5c/d77/df1 0 2024-04-22T00:03:49.448 INFO:tasks.workunit.client.0.smithi110.stdout:0/729: stat d0/d56/dc9/fea 0 2024-04-22T00:03:49.498 INFO:tasks.workunit.client.0.smithi110.stdout:8/794: chown d5/d24/d33/d3d/d5c/d6a/l110 94 1 2024-04-22T00:03:49.580 INFO:tasks.workunit.client.0.smithi110.stdout:9/718: rmdir d1/d29/d2a/d2b/d57 39 2024-04-22T00:03:49.760 INFO:tasks.workunit.client.0.smithi110.stdout:4/661: dwrite d1/d35/db9/f41 [8388608,4194304] 0 2024-04-22T00:03:49.849 INFO:tasks.workunit.client.0.smithi110.stdout:0/730: sync 2024-04-22T00:03:50.255 INFO:tasks.workunit.client.0.smithi110.stdout:7/718: dwrite d10/d45/d51/db1/dc9/df5/d2c/fb0 [0,4194304] 0 2024-04-22T00:03:50.467 INFO:tasks.workunit.client.0.smithi110.stdout:2/770: truncate d9/d25/d1b/d45/d4d/fe1 624356 0 2024-04-22T00:03:50.471 INFO:tasks.workunit.client.0.smithi110.stdout:4/662: dread - d1/d35/db9/d20/d23/d1c/d47/d95/fbb zero size 2024-04-22T00:03:50.559 INFO:tasks.workunit.client.0.smithi110.stdout:6/717: dread d16/d1e/d24/d66/f6e [0,4194304] 0 2024-04-22T00:03:50.574 INFO:tasks.workunit.client.0.smithi110.stdout:8/795: dread d5/da/d17/d6c/d7d/d114/d8c/fce [0,4194304] 0 2024-04-22T00:03:50.717 INFO:tasks.workunit.client.0.smithi110.stdout:8/796: dread - d5/da/d17/d6c/d7d/f9a zero size 2024-04-22T00:03:50.756 INFO:tasks.workunit.client.0.smithi110.stdout:3/709: mkdir d6/d12/d16/d6f/db5/def 0 2024-04-22T00:03:51.377 INFO:tasks.workunit.client.0.smithi110.stdout:0/731: fsync d0/d27/d4b/da0/fd3 0 2024-04-22T00:03:51.646 INFO:tasks.workunit.client.0.smithi110.stdout:6/718: unlink d16/d1d/d38/d48/d5e/d6a/f92 0 2024-04-22T00:03:51.666 INFO:tasks.workunit.client.0.smithi110.stdout:2/771: rename d9/d1a/d1d/c24 to d9/d1a/d1d/d2b/d5b/c102 0 2024-04-22T00:03:51.868 INFO:tasks.workunit.client.0.smithi110.stdout:4/663: truncate d1/d35/db9/d12/f18 3986014 0 2024-04-22T00:03:52.327 INFO:tasks.workunit.client.0.smithi110.stdout:5/721: write d7/d24/d37/d38/d88/fcb [405534,85657] 0 2024-04-22T00:03:52.374 INFO:tasks.workunit.client.0.smithi110.stdout:5/722: chown d7/d24/d3a/d54 14509964 1 2024-04-22T00:03:52.688 INFO:tasks.workunit.client.0.smithi110.stdout:7/719: fdatasync d10/d45/d51/d88/d39/f92 0 2024-04-22T00:03:53.076 INFO:tasks.workunit.client.0.smithi110.stdout:6/719: rename d16/d3d/d40/d46/fdf to d16/d1e/d24/d33/d85/ff0 0 2024-04-22T00:03:53.525 INFO:tasks.workunit.client.0.smithi110.stdout:4/664: dread d1/d35/db9/d20/dbf/f38 [0,4194304] 0 2024-04-22T00:03:53.782 INFO:tasks.workunit.client.0.smithi110.stdout:5/723: fdatasync d7/d24/d31/f5e 0 2024-04-22T00:03:54.188 INFO:tasks.workunit.client.0.smithi110.stdout:1/694: dwrite d1/d2/d1b/d10/d5c/d77/d78/f9b [0,4194304] 0 2024-04-22T00:03:54.369 INFO:tasks.workunit.client.0.smithi110.stdout:6/720: creat d16/d3d/d97/da9/ff1 x:0 0 0 2024-04-22T00:03:54.680 INFO:tasks.workunit.client.0.smithi110.stdout:9/719: dwrite d1/d29/d2a/d2b/d58/d7b/fcf [0,4194304] 0 2024-04-22T00:03:55.393 INFO:tasks.workunit.client.0.smithi110.stdout:5/724: rename d7/d22/d5b/da5/caa to d7/d22/d5b/d68/ccf 0 2024-04-22T00:03:55.688 INFO:tasks.workunit.client.0.smithi110.stdout:3/710: getdents d6/d12/d3c 0 2024-04-22T00:03:55.713 INFO:tasks.workunit.client.0.smithi110.stdout:3/711: stat d6/d12/d14/lc9 0 2024-04-22T00:03:55.934 INFO:tasks.workunit.client.0.smithi110.stdout:0/732: write d0/d2a/fc3 [5088101,67018] 0 2024-04-22T00:03:55.962 INFO:tasks.workunit.client.0.smithi110.stdout:9/720: mkdir d1/d29/d4d/dac/dbf/dda 0 2024-04-22T00:03:56.358 INFO:tasks.workunit.client.0.smithi110.stdout:1/695: dread d1/dd/fb3 [0,4194304] 0 2024-04-22T00:03:56.481 INFO:tasks.workunit.client.0.smithi110.stdout:6/721: dread d16/d1d/d38/d48/d5e/d62/f8d [0,4194304] 0 2024-04-22T00:03:56.657 INFO:tasks.workunit.client.0.smithi110.stdout:2/772: dwrite d9/d25/d1c/f3c [0,4194304] 0 2024-04-22T00:03:56.813 INFO:tasks.workunit.client.0.smithi110.stdout:2/773: chown d9/d1a/d1d/d2b/d5b/dd2 1047240 1 2024-04-22T00:03:56.879 INFO:tasks.workunit.client.0.smithi110.stdout:0/733: dread - d0/d25/d5a/d63/fd4 zero size 2024-04-22T00:03:57.023 INFO:tasks.workunit.client.0.smithi110.stdout:2/774: sync 2024-04-22T00:03:57.219 INFO:tasks.workunit.client.0.smithi110.stdout:8/797: dwrite d5/da/d17/d60/fef [0,4194304] 0 2024-04-22T00:03:57.425 INFO:tasks.workunit.client.0.smithi110.stdout:7/720: write d10/d45/d51/d88/d39/d7f/d80/d53/fbd [251613,116202] 0 2024-04-22T00:03:57.488 INFO:tasks.workunit.client.0.smithi110.stdout:4/665: write d1/d35/db9/d20/dbf/f30 [1031390,100861] 0 2024-04-22T00:03:57.530 INFO:tasks.workunit.client.0.smithi110.stdout:7/721: stat d10/d45/d51/db1/dc9/df5/f6b 0 2024-04-22T00:03:57.630 INFO:tasks.workunit.client.0.smithi110.stdout:7/722: dread fd [0,4194304] 0 2024-04-22T00:03:57.656 INFO:tasks.workunit.client.0.smithi110.stdout:7/723: chown d10/d45/fa6 75741896 1 2024-04-22T00:03:57.675 INFO:tasks.workunit.client.0.smithi110.stdout:7/724: chown d10/d45/d60/d5e/d65 282951887 1 2024-04-22T00:03:57.837 INFO:tasks.workunit.client.0.smithi110.stdout:2/775: creat d9/d1a/d1d/d4e/db5/f103 x:0 0 0 2024-04-22T00:03:58.015 INFO:tasks.workunit.client.0.smithi110.stdout:9/721: creat d1/d29/d2a/d2b/fdb x:0 0 0 2024-04-22T00:03:58.043 INFO:tasks.workunit.client.0.smithi110.stdout:9/722: chown d1/d29/d2a/c66 486359 1 2024-04-22T00:03:59.088 INFO:tasks.workunit.client.0.smithi110.stdout:1/696: getdents d1/d2/d14/d65/d8a 0 2024-04-22T00:03:59.210 INFO:tasks.workunit.client.0.smithi110.stdout:6/722: link d16/l29 d16/d1e/d24/d66/lf2 0 2024-04-22T00:03:59.292 INFO:tasks.workunit.client.0.smithi110.stdout:1/697: dread d1/dd/fb3 [4194304,4194304] 0 2024-04-22T00:03:59.730 INFO:tasks.workunit.client.0.smithi110.stdout:9/723: mknod d1/d29/d2a/d9d/dd6/cdc 0 2024-04-22T00:03:59.898 INFO:tasks.workunit.client.0.smithi110.stdout:9/724: sync 2024-04-22T00:04:00.282 INFO:tasks.workunit.client.0.smithi110.stdout:3/712: dwrite d6/d12/d14/d4b/fa0 [0,4194304] 0 2024-04-22T00:04:00.310 INFO:tasks.workunit.client.0.smithi110.stdout:5/725: dwrite d7/d9/d17/f51 [0,4194304] 0 2024-04-22T00:04:00.552 INFO:tasks.workunit.client.0.smithi110.stdout:6/723: rmdir d16/d1e 39 2024-04-22T00:04:00.563 INFO:tasks.workunit.client.0.smithi110.stdout:5/726: chown d7/d35/f7b 2 1 2024-04-22T00:04:00.784 INFO:tasks.workunit.client.0.smithi110.stdout:2/776: write d9/d1a/f63 [369856,56762] 0 2024-04-22T00:04:00.865 INFO:tasks.workunit.client.0.smithi110.stdout:7/725: write d10/d45/d51/db1/dc9/df5/f42 [248013,44324] 0 2024-04-22T00:04:00.880 INFO:tasks.workunit.client.0.smithi110.stdout:4/666: write d1/d35/db9/d20/d23/d1c/d47/d95/fbc [423965,58605] 0 2024-04-22T00:04:00.898 INFO:tasks.workunit.client.0.smithi110.stdout:1/698: dread d1/f40 [0,4194304] 0 2024-04-22T00:04:01.112 INFO:tasks.workunit.client.0.smithi110.stdout:0/734: dwrite d0/d14/d23/d3b/f67 [0,4194304] 0 2024-04-22T00:04:01.213 INFO:tasks.workunit.client.0.smithi110.stdout:7/726: chown d10/d43 273979 1 2024-04-22T00:04:01.292 INFO:tasks.workunit.client.0.smithi110.stdout:9/725: symlink d1/d29/d6f/db4/d79/d98/ldd 0 2024-04-22T00:04:01.352 INFO:tasks.workunit.client.0.smithi110.stdout:8/798: dwrite d5/da/dac/fd7 [0,4194304] 0 2024-04-22T00:04:01.492 INFO:tasks.workunit.client.0.smithi110.stdout:3/713: creat d6/d12/d16/d6f/db5/db9/ff0 x:0 0 0 2024-04-22T00:04:01.822 INFO:tasks.workunit.client.0.smithi110.stdout:2/777: creat d9/d1a/d1d/d2b/d5b/f104 x:0 0 0 2024-04-22T00:04:02.239 INFO:tasks.workunit.client.0.smithi110.stdout:9/726: symlink d1/d29/d4d/dac/dbf/lde 0 2024-04-22T00:04:02.309 INFO:tasks.workunit.client.0.smithi110.stdout:5/727: write d7/d35/f4c [1865249,17108] 0 2024-04-22T00:04:02.494 INFO:tasks.workunit.client.0.smithi110.stdout:6/724: rename d16/d1e/d24/d33/c87 to d16/d1e/da8/cf3 0 2024-04-22T00:04:02.585 INFO:tasks.workunit.client.0.smithi110.stdout:3/714: mknod d6/d12/d16/d30/d67/cf1 0 2024-04-22T00:04:02.728 INFO:tasks.workunit.client.0.smithi110.stdout:8/799: truncate d5/d24/d33/d3d/d82/da8/f108 1030481 0 2024-04-22T00:04:02.977 INFO:tasks.workunit.client.0.smithi110.stdout:2/778: fdatasync d9/d1a/d1d/d2b/d5b/f7c 0 2024-04-22T00:04:03.089 INFO:tasks.workunit.client.0.smithi110.stdout:1/699: dwrite d1/d1d/d4a/fb0 [0,4194304] 0 2024-04-22T00:04:03.513 INFO:tasks.workunit.client.0.smithi110.stdout:7/727: rename d10/d45/d60/cde to d10/d45/d51/d88/dce/c102 0 2024-04-22T00:04:03.554 INFO:tasks.workunit.client.0.smithi110.stdout:6/725: truncate d16/d1e/d24/d33/f34 4751463 0 2024-04-22T00:04:03.561 INFO:tasks.workunit.client.0.smithi110.stdout:5/728: dread - d7/d22/d5b/d86/fc3 zero size 2024-04-22T00:04:03.598 INFO:tasks.workunit.client.0.smithi110.stdout:3/715: creat d6/d12/d16/d30/d9c/ff2 x:0 0 0 2024-04-22T00:04:03.638 INFO:tasks.workunit.client.0.smithi110.stdout:0/735: dwrite d0/d27/d4b/da0/db1/fe8 [0,4194304] 0 2024-04-22T00:04:03.657 INFO:tasks.workunit.client.0.smithi110.stdout:1/700: read d1/d2/d1b/d10/fb5 [304676,53786] 0 2024-04-22T00:04:04.930 INFO:tasks.workunit.client.0.smithi110.stdout:9/727: write d1/d19/fb5 [891369,111190] 0 2024-04-22T00:04:05.331 INFO:tasks.workunit.client.0.smithi110.stdout:6/726: readlink d16/l29 0 2024-04-22T00:04:05.497 INFO:tasks.workunit.client.0.smithi110.stdout:6/727: sync 2024-04-22T00:04:05.832 INFO:tasks.workunit.client.0.smithi110.stdout:3/716: dread d6/d12/d16/d30/d9c/f79 [0,4194304] 0 2024-04-22T00:04:05.926 INFO:tasks.workunit.client.0.smithi110.stdout:7/728: dread d10/d45/d51/d88/d39/d7f/d80/fa8 [0,4194304] 0 2024-04-22T00:04:06.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/728: fdatasync d1/d29/d6f/db4/fa0 0 2024-04-22T00:04:06.332 INFO:tasks.workunit.client.0.smithi110.stdout:4/667: getdents d1/d35/db9/d20/d23/d1c/d47/d4f 0 2024-04-22T00:04:06.355 INFO:tasks.workunit.client.0.smithi110.stdout:8/800: dwrite d5/d24/d33/d3d/f64 [0,4194304] 0 2024-04-22T00:04:06.416 INFO:tasks.workunit.client.0.smithi110.stdout:4/668: sync 2024-04-22T00:04:06.724 INFO:tasks.workunit.client.0.smithi110.stdout:1/701: unlink d1/d2/f2d 0 2024-04-22T00:04:06.936 INFO:tasks.workunit.client.0.smithi110.stdout:6/728: creat d16/d1d/d38/d48/d5e/d62/d94/ff4 x:0 0 0 2024-04-22T00:04:07.282 INFO:tasks.workunit.client.0.smithi110.stdout:7/729: creat d10/d45/d51/d88/d46/d69/f103 x:0 0 0 2024-04-22T00:04:07.317 INFO:tasks.workunit.client.0.smithi110.stdout:7/730: chown d10/d45/d60/d5e/lc2 12167653 1 2024-04-22T00:04:08.156 INFO:tasks.workunit.client.0.smithi110.stdout:9/729: rmdir d1/d29/d2a/d9d/dd6 39 2024-04-22T00:04:08.280 INFO:tasks.workunit.client.0.smithi110.stdout:9/730: readlink d1/d52/d76/lba 0 2024-04-22T00:04:08.348 INFO:tasks.workunit.client.0.smithi110.stdout:2/779: rename d9/d25/d1c/da0/cd9 to d9/c105 0 2024-04-22T00:04:08.499 INFO:tasks.workunit.client.0.smithi110.stdout:4/669: mknod d1/d35/db9/d20/d23/d1c/d47/d4f/d56/d7a/ce8 0 2024-04-22T00:04:08.531 INFO:tasks.workunit.client.0.smithi110.stdout:0/736: dwrite d0/d16/d42/d50/dbc/fcc [0,4194304] 0 2024-04-22T00:04:08.771 INFO:tasks.workunit.client.0.smithi110.stdout:1/702: mknod d1/d2/d30/d9c/cf2 0 2024-04-22T00:04:08.808 INFO:tasks.workunit.client.0.smithi110.stdout:6/729: rmdir d16/d3d/d97/da9 39 2024-04-22T00:04:09.131 INFO:tasks.workunit.client.0.smithi110.stdout:7/731: dread d10/d45/f4f [0,4194304] 0 2024-04-22T00:04:10.083 INFO:tasks.workunit.client.0.smithi110.stdout:9/731: creat d1/d29/d6f/db4/fdf x:0 0 0 2024-04-22T00:04:10.103 INFO:tasks.workunit.client.0.smithi110.stdout:5/729: getdents d7/d24/d49/d61 0 2024-04-22T00:04:10.163 INFO:tasks.workunit.client.0.smithi110.stdout:5/730: chown d7/d9/d17/d48/d69/d6d 21975076 1 2024-04-22T00:04:10.640 INFO:tasks.workunit.client.0.smithi110.stdout:6/730: mknod d16/d1d/d38/d48/cf5 0 2024-04-22T00:04:10.662 INFO:tasks.workunit.client.0.smithi110.stdout:1/703: chown d1/d2/d1b/d10/d5c/d77/d78/c87 0 1 2024-04-22T00:04:11.042 INFO:tasks.workunit.client.0.smithi110.stdout:7/732: unlink d10/d15/c16 0 2024-04-22T00:04:11.081 INFO:tasks.workunit.client.0.smithi110.stdout:7/733: chown d10/d45/d51/d88/d46/fdd 0 1 2024-04-22T00:04:11.330 INFO:tasks.workunit.client.0.smithi110.stdout:8/801: dwrite d5/d24/f2c [0,4194304] 0 2024-04-22T00:04:11.516 INFO:tasks.workunit.client.0.smithi110.stdout:2/780: fdatasync d9/d25/d1b/d45/d50/d68/da4/fa2 0 2024-04-22T00:04:11.549 INFO:tasks.workunit.client.0.smithi110.stdout:8/802: sync 2024-04-22T00:04:11.957 INFO:tasks.workunit.client.0.smithi110.stdout:4/670: rename d1/d35/db9/d20/d23/d1c/d47/d4f/d56/dc8/ld4 to d1/d35/db9/d20/d23/d1c/d40/le9 0 2024-04-22T00:04:12.430 INFO:tasks.workunit.client.0.smithi110.stdout:1/704: mknod d1/dd/d23/d48/d4e/cf3 0 2024-04-22T00:04:12.462 INFO:tasks.workunit.client.0.smithi110.stdout:1/705: read d1/dd/fb3 [6060224,34737] 0 2024-04-22T00:04:12.542 INFO:tasks.workunit.client.0.smithi110.stdout:1/706: chown d1/dd/d23/d48/d4e/cf3 232 1 2024-04-22T00:04:12.606 INFO:tasks.workunit.client.0.smithi110.stdout:3/717: link d6/d12/d14/d32/f37 d6/d12/d16/ff3 0 2024-04-22T00:04:12.981 INFO:tasks.workunit.client.0.smithi110.stdout:3/718: sync 2024-04-22T00:04:13.360 INFO:tasks.workunit.client.0.smithi110.stdout:8/803: creat d5/da/dac/dc6/f115 x:0 0 0 2024-04-22T00:04:13.411 INFO:tasks.workunit.client.0.smithi110.stdout:9/732: mkdir d1/d29/d2a/d9d/de0 0 2024-04-22T00:04:13.444 INFO:tasks.workunit.client.0.smithi110.stdout:9/733: dread - d1/d29/d2a/dc/fcb zero size 2024-04-22T00:04:13.783 INFO:tasks.workunit.client.0.smithi110.stdout:4/671: creat d1/d35/db9/d20/d23/d1c/d47/d4f/d56/d7a/fea x:0 0 0 2024-04-22T00:04:13.790 INFO:tasks.workunit.client.0.smithi110.stdout:0/737: write d0/d16/f18 [1126457,67000] 0 2024-04-22T00:04:14.017 INFO:tasks.workunit.client.0.smithi110.stdout:4/672: dread d1/d35/db9/d20/f2c [0,4194304] 0 2024-04-22T00:04:14.070 INFO:tasks.workunit.client.0.smithi110.stdout:4/673: chown d1/d35/db9/d20/dbf/d5f/dc0/ce3 1 1 2024-04-22T00:04:14.157 INFO:tasks.workunit.client.0.smithi110.stdout:1/707: mknod d1/d2/d30/d9c/cf4 0 2024-04-22T00:04:14.206 INFO:tasks.workunit.client.0.smithi110.stdout:1/708: chown d1/d2/d1b/d10/d5c/d77/df1 1873432 1 2024-04-22T00:04:14.603 INFO:tasks.workunit.client.0.smithi110.stdout:8/804: read - d5/da/d88/fe1 zero size 2024-04-22T00:04:14.799 INFO:tasks.workunit.client.0.smithi110.stdout:9/734: truncate d1/d29/d2a/d2b/d58/d7b/f91 625134 0 2024-04-22T00:04:15.288 INFO:tasks.workunit.client.0.smithi110.stdout:3/719: truncate d6/d12/d16/d30/dc7/fdc 667942 0 2024-04-22T00:04:15.311 INFO:tasks.workunit.client.0.smithi110.stdout:5/731: write d7/d22/d5b/d86/fc3 [889638,69611] 0 2024-04-22T00:04:15.751 INFO:tasks.workunit.client.0.smithi110.stdout:8/805: creat d5/da/dac/dc6/f116 x:0 0 0 2024-04-22T00:04:15.910 INFO:tasks.workunit.client.0.smithi110.stdout:9/735: mknod d1/d29/d6f/db4/d79/d98/ce1 0 2024-04-22T00:04:15.959 INFO:tasks.workunit.client.0.smithi110.stdout:6/731: write d16/d3d/d97/fa0 [2572604,54792] 0 2024-04-22T00:04:16.027 INFO:tasks.workunit.client.0.smithi110.stdout:4/674: mkdir d1/d35/db9/d20/d58/d7e/ddd/deb 0 2024-04-22T00:04:16.263 INFO:tasks.workunit.client.0.smithi110.stdout:3/720: readlink d6/d12/d14/d4b/l6b 0 2024-04-22T00:04:16.300 INFO:tasks.workunit.client.0.smithi110.stdout:3/721: chown d6/d12/d16/d30/d9c/f79 3 1 2024-04-22T00:04:16.392 INFO:tasks.workunit.client.0.smithi110.stdout:5/732: chown d7/d24/d3a/d54/fb2 362604 1 2024-04-22T00:04:16.805 INFO:tasks.workunit.client.0.smithi110.stdout:9/736: fsync d1/d29/d2a/d6/fe 0 2024-04-22T00:04:17.127 INFO:tasks.workunit.client.0.smithi110.stdout:4/675: mkdir d1/d35/d6b/dec 0 2024-04-22T00:04:17.180 INFO:tasks.workunit.client.0.smithi110.stdout:9/737: dread d1/d29/d2a/d6/fe [0,4194304] 0 2024-04-22T00:04:17.365 INFO:tasks.workunit.client.0.smithi110.stdout:3/722: dread d6/d12/d16/d30/fae [0,4194304] 0 2024-04-22T00:04:18.198 INFO:tasks.workunit.client.0.smithi110.stdout:9/738: unlink d1/d29/d2a/d6/d1d/cd0 0 2024-04-22T00:04:18.236 INFO:tasks.workunit.client.0.smithi110.stdout:7/734: write d10/d45/d51/d88/d39/ffb [337430,63973] 0 2024-04-22T00:04:18.347 INFO:tasks.workunit.client.0.smithi110.stdout:3/723: creat d6/d12/d14/d4b/ff4 x:0 0 0 2024-04-22T00:04:18.383 INFO:tasks.workunit.client.0.smithi110.stdout:3/724: read - d6/d12/d16/d5d/fa5 zero size 2024-04-22T00:04:18.424 INFO:tasks.workunit.client.0.smithi110.stdout:2/781: link d9/d25/d1c/da0/cf5 d9/d1a/d1d/d7a/d91/dac/c106 0 2024-04-22T00:04:18.464 INFO:tasks.workunit.client.0.smithi110.stdout:2/782: stat d9/d25/d1b/d45/d50/d94/cdf 0 2024-04-22T00:04:19.024 INFO:tasks.workunit.client.0.smithi110.stdout:0/738: dwrite d0/d25/d5a/fb3 [0,4194304] 0 2024-04-22T00:04:19.157 INFO:tasks.workunit.client.0.smithi110.stdout:9/739: fsync d1/d29/d2a/d3c/fa6 0 2024-04-22T00:04:19.232 INFO:tasks.workunit.client.0.smithi110.stdout:2/783: mkdir d9/d1a/d1d/d2b/d5b/d107 0 2024-04-22T00:04:19.270 INFO:tasks.workunit.client.0.smithi110.stdout:7/735: chown d10/d45/d51/d88/d39/d7f/dd6/ff8 8042 1 2024-04-22T00:04:19.503 INFO:tasks.workunit.client.0.smithi110.stdout:6/732: link d16/fbe d16/d1e/ff6 0 2024-04-22T00:04:19.575 INFO:tasks.workunit.client.0.smithi110.stdout:3/725: dread d6/d12/d50/f64 [0,4194304] 0 2024-04-22T00:04:19.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/733: chown d16/d1d/d38/d48/d5e/d6a/d70 682487 1 2024-04-22T00:04:20.130 INFO:tasks.workunit.client.0.smithi110.stdout:8/806: write d5/da/d17/d6c/d72/da0/ff3 [288097,78521] 0 2024-04-22T00:04:20.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/726: creat d6/d12/d16/d30/ff5 x:0 0 0 2024-04-22T00:04:20.311 INFO:tasks.workunit.client.0.smithi110.stdout:0/739: dread d0/d25/fa5 [0,4194304] 0 2024-04-22T00:04:20.548 INFO:tasks.workunit.client.0.smithi110.stdout:1/709: dwrite d1/d2/d30/f98 [0,4194304] 0 2024-04-22T00:04:20.593 INFO:tasks.workunit.client.0.smithi110.stdout:7/736: dread d10/d45/d51/d88/d46/fa0 [0,4194304] 0 2024-04-22T00:04:20.752 INFO:tasks.workunit.client.0.smithi110.stdout:2/784: fsync d9/d1a/d1d/d4e/f5f 0 2024-04-22T00:04:20.951 INFO:tasks.workunit.client.0.smithi110.stdout:3/727: symlink d6/d12/d16/d5d/lf6 0 2024-04-22T00:04:21.065 INFO:tasks.workunit.client.0.smithi110.stdout:3/728: dread d6/d12/d3c/f68 [0,4194304] 0 2024-04-22T00:04:21.405 INFO:tasks.workunit.client.0.smithi110.stdout:0/740: dread d0/d14/d23/f24 [0,4194304] 0 2024-04-22T00:04:21.814 INFO:tasks.workunit.client.0.smithi110.stdout:1/710: read d1/dd/d23/d48/d4e/ddc/fde [575385,117320] 0 2024-04-22T00:04:21.878 INFO:tasks.workunit.client.0.smithi110.stdout:4/676: write d1/d35/db9/fda [331727,52665] 0 2024-04-22T00:04:21.986 INFO:tasks.workunit.client.0.smithi110.stdout:7/737: fsync d10/d45/d51/d58/ff6 0 2024-04-22T00:04:22.002 INFO:tasks.workunit.client.0.smithi110.stdout:5/733: dwrite d7/d22/d5b/d6f/fbf [0,4194304] 0 2024-04-22T00:04:22.192 INFO:tasks.workunit.client.0.smithi110.stdout:2/785: creat d9/d25/d1b/d45/d50/dc8/f108 x:0 0 0 2024-04-22T00:04:22.244 INFO:tasks.workunit.client.0.smithi110.stdout:3/729: mknod d6/d12/d14/cf7 0 2024-04-22T00:04:22.348 INFO:tasks.workunit.client.0.smithi110.stdout:0/741: mknod d0/d16/cfe 0 2024-04-22T00:04:22.383 INFO:tasks.workunit.client.0.smithi110.stdout:0/742: readlink d0/d16/d42/d50/d83/l91 0 2024-04-22T00:04:22.956 INFO:tasks.workunit.client.0.smithi110.stdout:5/734: mknod d7/d9/d17/d48/d69/cd0 0 2024-04-22T00:04:23.063 INFO:tasks.workunit.client.0.smithi110.stdout:7/738: symlink d10/d45/d51/d88/d39/d7f/l104 0 2024-04-22T00:04:23.146 INFO:tasks.workunit.client.0.smithi110.stdout:7/739: write d10/d45/d51/d88/d39/ffb [774884,106294] 0 2024-04-22T00:04:23.253 INFO:tasks.workunit.client.0.smithi110.stdout:3/730: creat d6/d12/ff8 x:0 0 0 2024-04-22T00:04:23.265 INFO:tasks.workunit.client.0.smithi110.stdout:7/740: dread d10/d45/d51/d88/d46/fa0 [0,4194304] 0 2024-04-22T00:04:23.314 INFO:tasks.workunit.client.0.smithi110.stdout:3/731: readlink d6/d12/d16/l52 0 2024-04-22T00:04:23.579 INFO:tasks.workunit.client.0.smithi110.stdout:0/743: symlink d0/d16/d5d/dc5/lff 0 2024-04-22T00:04:24.205 INFO:tasks.workunit.client.0.smithi110.stdout:5/735: truncate d7/d24/d37/d38/fa1 393943 0 2024-04-22T00:04:24.311 INFO:tasks.workunit.client.0.smithi110.stdout:9/740: mkdir d1/de2 0 2024-04-22T00:04:24.537 INFO:tasks.workunit.client.0.smithi110.stdout:7/741: mknod d10/d45/d51/d88/d39/d7f/c105 0 2024-04-22T00:04:24.609 INFO:tasks.workunit.client.0.smithi110.stdout:3/732: mknod d6/d12/d16/d6f/db5/dd3/cf9 0 2024-04-22T00:04:24.753 INFO:tasks.workunit.client.0.smithi110.stdout:8/807: link d5/d24/d33/d3d/d5c/fb0 d5/da/d17/d7c/dc0/f117 0 2024-04-22T00:04:24.854 INFO:tasks.workunit.client.0.smithi110.stdout:6/734: write d16/d3d/f43 [3532853,128806] 0 2024-04-22T00:04:25.330 INFO:tasks.workunit.client.0.smithi110.stdout:3/733: rename d6/d12/d16/d6f/db5/dd3/fd6 to d6/d12/d16/d6f/d7a/ffa 0 2024-04-22T00:04:25.359 INFO:tasks.workunit.client.0.smithi110.stdout:3/734: chown d6/d12/d14/lc9 6046 1 2024-04-22T00:04:25.389 INFO:tasks.workunit.client.0.smithi110.stdout:3/735: readlink d6/d12/d16/d6f/dab/ld9 0 2024-04-22T00:04:25.499 INFO:tasks.workunit.client.0.smithi110.stdout:0/744: mkdir d0/d27/d4b/da0/d100 0 2024-04-22T00:04:25.833 INFO:tasks.workunit.client.0.smithi110.stdout:6/735: read d16/f1b [2974093,127709] 0 2024-04-22T00:04:25.964 INFO:tasks.workunit.client.0.smithi110.stdout:1/711: getdents d1/d2/d1b/d10/d5c/dc5/d27/d3e/dba 0 2024-04-22T00:04:26.391 INFO:tasks.workunit.client.0.smithi110.stdout:8/808: mknod d5/d24/d33/d3d/dfd/dbc/c118 0 2024-04-22T00:04:26.431 INFO:tasks.workunit.client.0.smithi110.stdout:8/809: readlink d5/da/d17/d6c/d7d/l99 0 2024-04-22T00:04:27.997 INFO:tasks.workunit.client.0.smithi110.stdout:4/677: dwrite d1/d35/db9/d20/d23/f98 [0,4194304] 0 2024-04-22T00:04:28.146 INFO:tasks.workunit.client.0.smithi110.stdout:1/712: dread d1/d2/d14/f9d [0,4194304] 0 2024-04-22T00:04:28.153 INFO:tasks.workunit.client.0.smithi110.stdout:6/736: dread d16/d1d/d38/fbf [0,4194304] 0 2024-04-22T00:04:28.187 INFO:tasks.workunit.client.0.smithi110.stdout:3/736: link d6/d12/d3c/c40 d6/d12/d16/d6f/db5/db9/dc6/cfb 0 2024-04-22T00:04:28.222 INFO:tasks.workunit.client.0.smithi110.stdout:5/736: write d7/d24/d31/f45 [2690742,88515] 0 2024-04-22T00:04:28.407 INFO:tasks.workunit.client.0.smithi110.stdout:3/737: stat d6/d12/d14/d4b 0 2024-04-22T00:04:28.465 INFO:tasks.workunit.client.0.smithi110.stdout:6/737: readlink d16/d1d/d38/d48/d5e/lb3 0 2024-04-22T00:04:28.606 INFO:tasks.workunit.client.0.smithi110.stdout:2/786: dwrite d9/d1a/d1d/d2b/d54/d77/fca [0,4194304] 0 2024-04-22T00:04:28.713 INFO:tasks.workunit.client.0.smithi110.stdout:3/738: readlink d6/d12/d16/d5d/lb6 0 2024-04-22T00:04:28.773 INFO:tasks.workunit.client.0.smithi110.stdout:3/739: readlink d6/l81 0 2024-04-22T00:04:29.123 INFO:tasks.workunit.client.0.smithi110.stdout:4/678: dread d1/d35/db9/fb3 [0,4194304] 0 2024-04-22T00:04:29.374 INFO:tasks.workunit.client.0.smithi110.stdout:0/745: link d0/d16/c66 d0/d27/d4b/da0/c101 0 2024-04-22T00:04:29.502 INFO:tasks.workunit.client.0.smithi110.stdout:6/738: creat d16/d3d/d97/dd0/ff7 x:0 0 0 2024-04-22T00:04:29.981 INFO:tasks.workunit.client.0.smithi110.stdout:4/679: symlink d1/d35/d6b/led 0 2024-04-22T00:04:30.351 INFO:tasks.workunit.client.0.smithi110.stdout:2/787: mkdir d9/d1a/d1d/d4a/d109 0 2024-04-22T00:04:30.591 INFO:tasks.workunit.client.0.smithi110.stdout:6/739: fsync f4 0 2024-04-22T00:04:30.609 INFO:tasks.workunit.client.0.smithi110.stdout:8/810: dwrite d5/da/d17/d60/f109 [0,4194304] 0 2024-04-22T00:04:31.351 INFO:tasks.workunit.client.0.smithi110.stdout:2/788: symlink d9/d1a/d7b/dab/l10a 0 2024-04-22T00:04:31.528 INFO:tasks.workunit.client.0.smithi110.stdout:6/740: readlink d16/d1d/d38/l75 0 2024-04-22T00:04:32.122 INFO:tasks.workunit.client.0.smithi110.stdout:5/737: rename d7/d24/d31/f81 to d7/d24/d49/fd1 0 2024-04-22T00:04:32.336 INFO:tasks.workunit.client.0.smithi110.stdout:0/746: rmdir d0/d14/d23/d6d/dde/dfb 0 2024-04-22T00:04:32.378 INFO:tasks.workunit.client.0.smithi110.stdout:2/789: readlink d9/d1a/d1d/d2b/l2e 0 2024-04-22T00:04:32.466 INFO:tasks.workunit.client.0.smithi110.stdout:2/790: read - d9/d25/d1b/d45/fb8 zero size 2024-04-22T00:04:32.483 INFO:tasks.workunit.client.0.smithi110.stdout:3/740: getdents d6/d12/da1 0 2024-04-22T00:04:32.669 INFO:tasks.workunit.client.0.smithi110.stdout:1/713: rename d1/d2/d30/d9c/fc0 to d1/d2/d14/d65/d8a/ff5 0 2024-04-22T00:04:32.851 INFO:tasks.workunit.client.0.smithi110.stdout:5/738: mknod d7/d22/d5b/d68/cd2 0 2024-04-22T00:04:32.870 INFO:tasks.workunit.client.0.smithi110.stdout:0/747: mknod d0/d14/d23/d6d/c102 0 2024-04-22T00:04:32.927 INFO:tasks.workunit.client.0.smithi110.stdout:5/739: stat d7/d24/d49/f99 0 2024-04-22T00:04:32.937 INFO:tasks.workunit.client.0.smithi110.stdout:0/748: readlink d0/d27/d68/d7d/lac 0 2024-04-22T00:04:33.191 INFO:tasks.workunit.client.0.smithi110.stdout:7/742: unlink d10/d45/d51/d88/ce8 0 2024-04-22T00:04:33.214 INFO:tasks.workunit.client.0.smithi110.stdout:3/741: fsync d6/d12/d16/d30/d9c/f61 0 2024-04-22T00:04:33.356 INFO:tasks.workunit.client.0.smithi110.stdout:4/680: rename d1/d35/db9/d20/d23/d1c/d47/d95/fbc to d1/d35/db9/d20/dbf/d5f/fee 0 2024-04-22T00:04:33.472 INFO:tasks.workunit.client.0.smithi110.stdout:4/681: sync 2024-04-22T00:04:33.606 INFO:tasks.workunit.client.0.smithi110.stdout:6/741: creat d16/d3d/ff8 x:0 0 0 2024-04-22T00:04:33.759 INFO:tasks.workunit.client.0.smithi110.stdout:5/740: fdatasync d7/d24/d49/d61/f8f 0 2024-04-22T00:04:33.860 INFO:tasks.workunit.client.0.smithi110.stdout:0/749: unlink d0/d27/d68/d7d/cf7 0 2024-04-22T00:04:34.158 INFO:tasks.workunit.client.0.smithi110.stdout:2/791: mkdir d9/d25/d1b/d45/d10b 0 2024-04-22T00:04:34.422 INFO:tasks.workunit.client.0.smithi110.stdout:9/741: write d1/d29/d2a/d2b/d58/d7b/f91 [211691,105868] 0 2024-04-22T00:04:34.664 INFO:tasks.workunit.client.0.smithi110.stdout:4/682: mknod d1/d35/db9/d20/d58/d93/d7c/cef 0 2024-04-22T00:04:34.728 INFO:tasks.workunit.client.0.smithi110.stdout:4/683: read d1/d35/db9/d20/dbf/f3f [2176929,54801] 0 2024-04-22T00:04:35.149 INFO:tasks.workunit.client.0.smithi110.stdout:5/741: unlink d7/l71 0 2024-04-22T00:04:35.239 INFO:tasks.workunit.client.0.smithi110.stdout:6/742: dread d16/d3d/f30 [0,4194304] 0 2024-04-22T00:04:35.625 INFO:tasks.workunit.client.0.smithi110.stdout:0/750: dread d0/d14/f6e [0,4194304] 0 2024-04-22T00:04:35.753 INFO:tasks.workunit.client.0.smithi110.stdout:9/742: chown d1/l18 1 1 2024-04-22T00:04:35.891 INFO:tasks.workunit.client.0.smithi110.stdout:7/743: rename d10/d45/d51/d88/d46/ce0 to d10/d45/d60/d5e/d65/c106 0 2024-04-22T00:04:35.954 INFO:tasks.workunit.client.0.smithi110.stdout:8/811: dwrite d5/da/d17/d7c/dc0/fec [0,4194304] 0 2024-04-22T00:04:36.698 INFO:tasks.workunit.client.0.smithi110.stdout:5/742: mkdir d7/d24/d37/d38/d88/dd3 0 2024-04-22T00:04:37.057 INFO:tasks.workunit.client.0.smithi110.stdout:6/743: dread d16/d1d/d38/f98 [0,4194304] 0 2024-04-22T00:04:37.135 INFO:tasks.workunit.client.0.smithi110.stdout:9/743: chown d1/d29/d2a/dc/c36 281711468 1 2024-04-22T00:04:37.276 INFO:tasks.workunit.client.0.smithi110.stdout:7/744: fdatasync d10/d45/d51/d88/d46/d69/ffe 0 2024-04-22T00:04:37.510 INFO:tasks.workunit.client.0.smithi110.stdout:4/684: fsync d1/d35/db9/d20/d50/fc5 0 2024-04-22T00:04:37.859 INFO:tasks.workunit.client.0.smithi110.stdout:6/744: mkdir d16/d3d/d97/dd0/df9 0 2024-04-22T00:04:38.152 INFO:tasks.workunit.client.0.smithi110.stdout:9/744: read d1/d29/d4d/f68 [678040,60445] 0 2024-04-22T00:04:38.366 INFO:tasks.workunit.client.0.smithi110.stdout:7/745: rename d10/d45/d51/d88/d39/d7f/d80/d53/fbd to d10/d45/d51/d88/d46/d69/d75/f107 0 2024-04-22T00:04:38.660 INFO:tasks.workunit.client.0.smithi110.stdout:4/685: dread d1/d35/db9/d20/dbf/d5f/fd1 [0,4194304] 0 2024-04-22T00:04:38.778 INFO:tasks.workunit.client.0.smithi110.stdout:5/743: symlink d7/d24/d49/ld4 0 2024-04-22T00:04:38.854 INFO:tasks.workunit.client.0.smithi110.stdout:9/745: readlink d1/d29/l3d 0 2024-04-22T00:04:39.089 INFO:tasks.workunit.client.0.smithi110.stdout:3/742: dwrite d6/d78/f8b [0,4194304] 0 2024-04-22T00:04:39.093 INFO:tasks.workunit.client.0.smithi110.stdout:7/746: rmdir d10/d45/d51/d88/d39/d7f/dd6 39 2024-04-22T00:04:39.107 INFO:tasks.workunit.client.0.smithi110.stdout:4/686: rmdir d1/d35/db9/d20/d23/d1c/d47/d95 39 2024-04-22T00:04:39.248 INFO:tasks.workunit.client.0.smithi110.stdout:1/714: write d1/dd/d23/f54 [558975,38711] 0 2024-04-22T00:04:39.338 INFO:tasks.workunit.client.0.smithi110.stdout:5/744: mknod d7/d35/dc0/cd5 0 2024-04-22T00:04:39.526 INFO:tasks.workunit.client.0.smithi110.stdout:9/746: mknod d1/d29/d2a/d2b/d58/ce3 0 2024-04-22T00:04:39.736 INFO:tasks.workunit.client.0.smithi110.stdout:6/745: creat d16/d1e/ffa x:0 0 0 2024-04-22T00:04:40.087 INFO:tasks.workunit.client.0.smithi110.stdout:1/715: symlink d1/d2/d14/d65/lf6 0 2024-04-22T00:04:40.185 INFO:tasks.workunit.client.0.smithi110.stdout:7/747: rename d10/d45/d51/d88/d46/d69/ffe to d10/d15/d95/f108 0 2024-04-22T00:04:40.308 INFO:tasks.workunit.client.0.smithi110.stdout:2/792: write d9/d1a/d1d/d2b/d54/d77/f99 [5123517,31643] 0 2024-04-22T00:04:40.406 INFO:tasks.workunit.client.0.smithi110.stdout:5/745: rmdir d7/d9/d17/d48/d69/d6d 39 2024-04-22T00:04:40.530 INFO:tasks.workunit.client.0.smithi110.stdout:2/793: sync 2024-04-22T00:04:40.594 INFO:tasks.workunit.client.0.smithi110.stdout:2/794: chown d9/d25/d1b/d45/d50/d68/da4/fa2 459042 1 2024-04-22T00:04:40.844 INFO:tasks.workunit.client.0.smithi110.stdout:1/716: mknod d1/d2/d30/db9/cf7 0 2024-04-22T00:04:40.922 INFO:tasks.workunit.client.0.smithi110.stdout:7/748: mknod d10/d45/d60/d5e/c109 0 2024-04-22T00:04:41.187 INFO:tasks.workunit.client.0.smithi110.stdout:5/746: mkdir d7/d35/dd6 0 2024-04-22T00:04:41.753 INFO:tasks.workunit.client.0.smithi110.stdout:0/751: dwrite d0/d16/d42/d50/ff9 [0,4194304] 0 2024-04-22T00:04:41.770 INFO:tasks.workunit.client.0.smithi110.stdout:1/717: unlink d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/lb7 0 2024-04-22T00:04:41.861 INFO:tasks.workunit.client.0.smithi110.stdout:7/749: mkdir d10/d15/d95/d10a 0 2024-04-22T00:04:42.852 INFO:tasks.workunit.client.0.smithi110.stdout:7/750: truncate d10/d45/f4f 561772 0 2024-04-22T00:04:43.023 INFO:tasks.workunit.client.0.smithi110.stdout:1/718: symlink d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/lf8 0 2024-04-22T00:04:43.073 INFO:tasks.workunit.client.0.smithi110.stdout:1/719: chown d1/d2/d1b/d10/d5c/dc5/cbe 2 1 2024-04-22T00:04:43.576 INFO:tasks.workunit.client.0.smithi110.stdout:7/751: symlink d10/d43/l10b 0 2024-04-22T00:04:43.577 INFO:tasks.workunit.client.0.smithi110.stdout:0/752: fsync d0/d16/d42/d50/d83/fbf 0 2024-04-22T00:04:43.820 INFO:tasks.workunit.client.0.smithi110.stdout:1/720: symlink d1/dd/d23/dcc/lf9 0 2024-04-22T00:04:44.046 INFO:tasks.workunit.client.0.smithi110.stdout:4/687: write f0 [4105431,33436] 0 2024-04-22T00:04:44.052 INFO:tasks.workunit.client.0.smithi110.stdout:8/812: mknod d5/da/d17/c119 0 2024-04-22T00:04:44.059 INFO:tasks.workunit.client.0.smithi110.stdout:3/743: write d6/d78/fc5 [1042358,8371] 0 2024-04-22T00:04:44.108 INFO:tasks.workunit.client.0.smithi110.stdout:6/746: write d16/d3d/d40/f5b [439023,87117] 0 2024-04-22T00:04:44.120 INFO:tasks.workunit.client.0.smithi110.stdout:9/747: write d1/f15 [3188183,120162] 0 2024-04-22T00:04:44.623 INFO:tasks.workunit.client.0.smithi110.stdout:7/752: creat d10/d45/d51/d88/dce/f10c x:0 0 0 2024-04-22T00:04:44.782 INFO:tasks.workunit.client.0.smithi110.stdout:0/753: symlink d0/d16/d42/d50/dbc/dc8/l103 0 2024-04-22T00:04:44.927 INFO:tasks.workunit.client.0.smithi110.stdout:1/721: fdatasync d1/f40 0 2024-04-22T00:04:45.017 INFO:tasks.workunit.client.0.smithi110.stdout:3/744: fsync f1 0 2024-04-22T00:04:45.159 INFO:tasks.workunit.client.0.smithi110.stdout:5/747: dwrite d7/d35/f7b [4194304,4194304] 0 2024-04-22T00:04:45.294 INFO:tasks.workunit.client.0.smithi110.stdout:4/688: unlink d1/d35/db9/d20/d23/d1c/d47/d4f/fb1 0 2024-04-22T00:04:45.317 INFO:tasks.workunit.client.0.smithi110.stdout:6/747: truncate d16/d3d/d40/d46/f56 747166 0 2024-04-22T00:04:45.439 INFO:tasks.workunit.client.0.smithi110.stdout:5/748: dread - d7/d24/d49/d61/fbe zero size 2024-04-22T00:04:45.470 INFO:tasks.workunit.client.0.smithi110.stdout:5/749: chown d7/d24/d49/d61/c90 234784316 1 2024-04-22T00:04:45.572 INFO:tasks.workunit.client.0.smithi110.stdout:6/748: sync 2024-04-22T00:04:45.927 INFO:tasks.workunit.client.0.smithi110.stdout:2/795: dwrite d9/d25/d1b/d45/d50/d68/da4/f93 [4194304,4194304] 0 2024-04-22T00:04:46.361 INFO:tasks.workunit.client.0.smithi110.stdout:3/745: mkdir d6/d12/d3c/d65/dfc 0 2024-04-22T00:04:46.365 INFO:tasks.workunit.client.0.smithi110.stdout:1/722: fsync d1/dd/d23/f54 0 2024-04-22T00:04:46.783 INFO:tasks.workunit.client.0.smithi110.stdout:4/689: creat d1/d35/db9/d12/ff0 x:0 0 0 2024-04-22T00:04:46.933 INFO:tasks.workunit.client.0.smithi110.stdout:0/754: mkdir d0/d27/d4b/da0/d100/d104 0 2024-04-22T00:04:47.132 INFO:tasks.workunit.client.0.smithi110.stdout:6/749: rename d16/d1e/ffa to d16/d1e/d24/d90/dec/ffb 0 2024-04-22T00:04:47.365 INFO:tasks.workunit.client.0.smithi110.stdout:1/723: creat d1/d1d/d4a/ffa x:0 0 0 2024-04-22T00:04:47.535 INFO:tasks.workunit.client.0.smithi110.stdout:5/750: mkdir d7/d24/d37/dd7 0 2024-04-22T00:04:47.683 INFO:tasks.workunit.client.0.smithi110.stdout:0/755: read d0/d16/d5d/f5e [787086,21165] 0 2024-04-22T00:04:47.887 INFO:tasks.workunit.client.0.smithi110.stdout:3/746: rename d6/d12/d16/d30/f35 to d6/d12/d3c/d8d/dee/ffd 0 2024-04-22T00:04:47.927 INFO:tasks.workunit.client.0.smithi110.stdout:3/747: chown d6/d12/d3c/c3d 510938 1 2024-04-22T00:04:47.948 INFO:tasks.workunit.client.0.smithi110.stdout:3/748: chown d6/d12/c7b 27588454 1 2024-04-22T00:04:48.078 INFO:tasks.workunit.client.0.smithi110.stdout:6/750: truncate d16/d1d/d38/d8e/f9f 1280520 0 2024-04-22T00:04:48.967 INFO:tasks.workunit.client.0.smithi110.stdout:2/796: link d9/d25/d1b/c3f d9/d1a/d1d/d2b/d5b/dd2/c10c 0 2024-04-22T00:04:49.001 INFO:tasks.workunit.client.0.smithi110.stdout:6/751: creat d16/d1d/d38/d48/d5e/ffc x:0 0 0 2024-04-22T00:04:49.282 INFO:tasks.workunit.client.0.smithi110.stdout:0/756: mknod d0/d14/c105 0 2024-04-22T00:04:49.407 INFO:tasks.workunit.client.0.smithi110.stdout:7/753: write d10/d45/f52 [5544290,22092] 0 2024-04-22T00:04:49.679 INFO:tasks.workunit.client.0.smithi110.stdout:9/748: dwrite d1/d29/d4d/f68 [0,4194304] 0 2024-04-22T00:04:50.165 INFO:tasks.workunit.client.0.smithi110.stdout:8/813: dwrite d5/d24/d33/d3d/d82/da8/f108 [0,4194304] 0 2024-04-22T00:04:50.479 INFO:tasks.workunit.client.0.smithi110.stdout:4/690: rename d1/d35/db9/d20/dbf/d5f/c8b to d1/d35/db9/d20/cf1 0 2024-04-22T00:04:50.680 INFO:tasks.workunit.client.0.smithi110.stdout:7/754: readlink d10/d45/d51/d88/d46/le2 0 2024-04-22T00:04:50.800 INFO:tasks.workunit.client.0.smithi110.stdout:9/749: dread - d1/d29/d6f/db4/fdf zero size 2024-04-22T00:04:51.159 INFO:tasks.workunit.client.0.smithi110.stdout:8/814: read d5/d24/d33/d3d/f64 [1054733,94144] 0 2024-04-22T00:04:51.201 INFO:tasks.workunit.client.0.smithi110.stdout:8/815: chown d5/da/d17/d6c/d95/d98 42836 1 2024-04-22T00:04:51.981 INFO:tasks.workunit.client.0.smithi110.stdout:3/749: rename d6/d12/d16/d30/fae to d6/d12/d3c/d65/ffe 0 2024-04-22T00:04:52.202 INFO:tasks.workunit.client.0.smithi110.stdout:4/691: dread d1/f3 [0,4194304] 0 2024-04-22T00:04:52.647 INFO:tasks.workunit.client.0.smithi110.stdout:3/750: creat d6/d12/d16/d5d/dd8/fff x:0 0 0 2024-04-22T00:04:52.670 INFO:tasks.workunit.client.0.smithi110.stdout:1/724: write d1/d2/d14/d65/d8a/ff5 [310237,117191] 0 2024-04-22T00:04:52.756 INFO:tasks.workunit.client.0.smithi110.stdout:1/725: chown d1/f26 252 1 2024-04-22T00:04:52.885 INFO:tasks.workunit.client.0.smithi110.stdout:1/726: dread - d1/dd/d23/f74 zero size 2024-04-22T00:04:53.107 INFO:tasks.workunit.client.0.smithi110.stdout:5/751: dwrite d7/d24/d37/d38/fa1 [0,4194304] 0 2024-04-22T00:04:53.611 INFO:tasks.workunit.client.0.smithi110.stdout:2/797: write d9/d25/d1b/d45/f48 [1578005,84093] 0 2024-04-22T00:04:53.730 INFO:tasks.workunit.client.0.smithi110.stdout:1/727: creat d1/d2/d1b/d10/d5c/d77/d78/ffb x:0 0 0 2024-04-22T00:04:53.978 INFO:tasks.workunit.client.0.smithi110.stdout:6/752: dwrite d16/fdc [0,4194304] 0 2024-04-22T00:04:54.264 INFO:tasks.workunit.client.0.smithi110.stdout:0/757: write d0/d16/d42/d50/d83/fbf [106509,97114] 0 2024-04-22T00:04:54.483 INFO:tasks.workunit.client.0.smithi110.stdout:5/752: getdents d7/d24/d37/d38/d88/dd3 0 2024-04-22T00:04:54.613 INFO:tasks.workunit.client.0.smithi110.stdout:2/798: truncate d9/d25/d1b/ffb 326876 0 2024-04-22T00:04:54.762 INFO:tasks.workunit.client.0.smithi110.stdout:7/755: dwrite d10/d15/fc5 [8388608,4194304] 0 2024-04-22T00:04:54.907 INFO:tasks.workunit.client.0.smithi110.stdout:8/816: dwrite d5/da/d17/d60/f109 [0,4194304] 0 2024-04-22T00:04:55.014 INFO:tasks.workunit.client.0.smithi110.stdout:1/728: truncate d1/d2/d14/f9d 2219852 0 2024-04-22T00:04:55.070 INFO:tasks.workunit.client.0.smithi110.stdout:6/753: read d16/d1e/da8/fc0 [13784,84979] 0 2024-04-22T00:04:55.116 INFO:tasks.workunit.client.0.smithi110.stdout:4/692: write d1/d35/db9/d12/f64 [4687640,45096] 0 2024-04-22T00:04:55.288 INFO:tasks.workunit.client.0.smithi110.stdout:1/729: sync 2024-04-22T00:04:55.390 INFO:tasks.workunit.client.0.smithi110.stdout:9/750: creat d1/d29/fe4 x:0 0 0 2024-04-22T00:04:55.448 INFO:tasks.workunit.client.0.smithi110.stdout:2/799: chown d9/f76 31795 1 2024-04-22T00:04:55.559 INFO:tasks.workunit.client.0.smithi110.stdout:5/753: read d7/d24/d37/d38/d88/fcb [35031,97703] 0 2024-04-22T00:04:55.815 INFO:tasks.workunit.client.0.smithi110.stdout:3/751: write d6/d12/d14/f31 [614754,99064] 0 2024-04-22T00:04:56.069 INFO:tasks.workunit.client.0.smithi110.stdout:6/754: mknod d16/d1d/d38/d8e/cfd 0 2024-04-22T00:04:56.291 INFO:tasks.workunit.client.0.smithi110.stdout:4/693: rename d1/d35/db9 to d1/d35/d6b/df2 0 2024-04-22T00:04:56.548 INFO:tasks.workunit.client.0.smithi110.stdout:9/751: mknod d1/d29/d6f/ce5 0 2024-04-22T00:04:56.689 INFO:tasks.workunit.client.0.smithi110.stdout:2/800: stat d9/f49 0 2024-04-22T00:04:57.005 INFO:tasks.workunit.client.0.smithi110.stdout:5/754: symlink d7/d24/d37/d38/ld8 0 2024-04-22T00:04:57.051 INFO:tasks.workunit.client.0.smithi110.stdout:5/755: dread - d7/d24/d49/d61/fbe zero size 2024-04-22T00:04:57.354 INFO:tasks.workunit.client.0.smithi110.stdout:3/752: symlink d6/d12/d50/l100 0 2024-04-22T00:04:57.426 INFO:tasks.workunit.client.0.smithi110.stdout:8/817: creat d5/da/d17/d6c/d95/daa/f11a x:0 0 0 2024-04-22T00:04:57.543 INFO:tasks.workunit.client.0.smithi110.stdout:6/755: dread d16/d3d/d40/d46/fbb [0,4194304] 0 2024-04-22T00:04:58.234 INFO:tasks.workunit.client.0.smithi110.stdout:3/753: fdatasync d6/d12/d14/d4b/fa0 0 2024-04-22T00:04:58.333 INFO:tasks.workunit.client.0.smithi110.stdout:8/818: mkdir d5/d24/d33/d3d/d5c/d11b 0 2024-04-22T00:04:58.357 INFO:tasks.workunit.client.0.smithi110.stdout:0/758: dwrite d0/d2a/fc3 [4194304,4194304] 0 2024-04-22T00:04:58.504 INFO:tasks.workunit.client.0.smithi110.stdout:8/819: chown d5/d24/c11 224737 1 2024-04-22T00:04:58.562 INFO:tasks.workunit.client.0.smithi110.stdout:3/754: dread d6/d12/d16/f39 [0,4194304] 0 2024-04-22T00:04:58.645 INFO:tasks.workunit.client.0.smithi110.stdout:1/730: write d1/d2/d1b/d10/d5c/d77/d78/f9b [3604814,56231] 0 2024-04-22T00:04:59.114 INFO:tasks.workunit.client.0.smithi110.stdout:7/756: write d10/d45/d51/d88/d39/fe1 [1927596,44680] 0 2024-04-22T00:04:59.154 INFO:tasks.workunit.client.0.smithi110.stdout:2/801: write d9/d1a/d1d/d2b/f56 [595337,97938] 0 2024-04-22T00:04:59.168 INFO:tasks.workunit.client.0.smithi110.stdout:9/752: write d1/d29/d6f/db4/fa0 [1474474,39605] 0 2024-04-22T00:04:59.252 INFO:tasks.workunit.client.0.smithi110.stdout:5/756: truncate d7/d9/d17/f2c 2833128 0 2024-04-22T00:04:59.508 INFO:tasks.workunit.client.0.smithi110.stdout:3/755: creat d6/d12/d16/d30/d9c/f101 x:0 0 0 2024-04-22T00:05:00.259 INFO:tasks.workunit.client.0.smithi110.stdout:6/756: unlink d16/d3d/l83 0 2024-04-22T00:05:00.526 INFO:tasks.workunit.client.0.smithi110.stdout:4/694: mknod d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/cf3 0 2024-04-22T00:05:00.603 INFO:tasks.workunit.client.0.smithi110.stdout:7/757: creat d10/d45/d60/d5e/d65/da3/f10d x:0 0 0 2024-04-22T00:05:00.637 INFO:tasks.workunit.client.0.smithi110.stdout:2/802: read d9/d25/f2f [4422053,122350] 0 2024-04-22T00:05:01.038 INFO:tasks.workunit.client.0.smithi110.stdout:4/695: dread d1/d35/d6b/df2/d20/d50/f70 [0,4194304] 0 2024-04-22T00:05:01.223 INFO:tasks.workunit.client.0.smithi110.stdout:6/757: fsync d16/f54 0 2024-04-22T00:05:01.519 INFO:tasks.workunit.client.0.smithi110.stdout:9/753: mknod d1/d29/d2a/d2b/d57/d97/ce6 0 2024-04-22T00:05:01.546 INFO:tasks.workunit.client.0.smithi110.stdout:9/754: chown d1/d29/d59/c86 16122035 1 2024-04-22T00:05:01.663 INFO:tasks.workunit.client.0.smithi110.stdout:8/820: symlink d5/l11c 0 2024-04-22T00:05:02.498 INFO:tasks.workunit.client.0.smithi110.stdout:1/731: dwrite d1/dd/d23/f96 [0,4194304] 0 2024-04-22T00:05:02.895 INFO:tasks.workunit.client.0.smithi110.stdout:5/757: write d7/d9/f33 [2143822,97965] 0 2024-04-22T00:05:02.931 INFO:tasks.workunit.client.0.smithi110.stdout:9/755: creat d1/d29/d2a/d2b/d58/da8/fe7 x:0 0 0 2024-04-22T00:05:03.032 INFO:tasks.workunit.client.0.smithi110.stdout:8/821: dread d5/d24/d33/d3d/fe4 [0,4194304] 0 2024-04-22T00:05:03.133 INFO:tasks.workunit.client.0.smithi110.stdout:0/759: write d0/d16/d42/fd8 [1710246,122518] 0 2024-04-22T00:05:03.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/760: chown d0/d14/d23/d3b/c80 188442 1 2024-04-22T00:05:03.491 INFO:tasks.workunit.client.0.smithi110.stdout:6/758: mkdir d16/d1d/d38/dfe 0 2024-04-22T00:05:03.500 INFO:tasks.workunit.client.0.smithi110.stdout:3/756: dwrite d6/d12/d3c/f68 [0,4194304] 0 2024-04-22T00:05:03.632 INFO:tasks.workunit.client.0.smithi110.stdout:9/756: mknod d1/d29/d2a/d2b/d57/d97/ce8 0 2024-04-22T00:05:03.719 INFO:tasks.workunit.client.0.smithi110.stdout:4/696: chown d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8/cd2 111798390 1 2024-04-22T00:05:03.760 INFO:tasks.workunit.client.0.smithi110.stdout:6/759: chown d16/d3d/d97/dd0/fb0 24901 1 2024-04-22T00:05:03.774 INFO:tasks.workunit.client.0.smithi110.stdout:3/757: read d6/d12/d16/d30/d9c/f79 [3113203,79553] 0 2024-04-22T00:05:03.871 INFO:tasks.workunit.client.0.smithi110.stdout:8/822: mknod d5/d24/d33/d3d/d5c/c11d 0 2024-04-22T00:05:03.942 INFO:tasks.workunit.client.0.smithi110.stdout:8/823: chown d5/d4f/d79/d10b/c10d 198 1 2024-04-22T00:05:03.999 INFO:tasks.workunit.client.0.smithi110.stdout:6/760: sync 2024-04-22T00:05:04.356 INFO:tasks.workunit.client.0.smithi110.stdout:0/761: mkdir d0/d56/da3/d106 0 2024-04-22T00:05:04.376 INFO:tasks.workunit.client.0.smithi110.stdout:0/762: readlink d0/d27/l72 0 2024-04-22T00:05:04.537 INFO:tasks.workunit.client.0.smithi110.stdout:7/758: getdents d10/d45/d60/d5e/d65 0 2024-04-22T00:05:04.966 INFO:tasks.workunit.client.0.smithi110.stdout:4/697: symlink d1/d35/d6b/df2/d20/d23/d1c/dae/lf4 0 2024-04-22T00:05:05.046 INFO:tasks.workunit.client.0.smithi110.stdout:4/698: sync 2024-04-22T00:05:05.273 INFO:tasks.workunit.client.0.smithi110.stdout:8/824: rmdir d5/d6f 39 2024-04-22T00:05:05.450 INFO:tasks.workunit.client.0.smithi110.stdout:2/803: write d9/d1a/d1d/d2b/ff9 [182213,34386] 0 2024-04-22T00:05:05.594 INFO:tasks.workunit.client.0.smithi110.stdout:0/763: read d0/f2c [3341979,86247] 0 2024-04-22T00:05:05.663 INFO:tasks.workunit.client.0.smithi110.stdout:0/764: sync 2024-04-22T00:05:05.747 INFO:tasks.workunit.client.0.smithi110.stdout:5/758: rename d7/d24/d37/d38/lb8 to d7/d24/d37/ld9 0 2024-04-22T00:05:05.935 INFO:tasks.workunit.client.0.smithi110.stdout:9/757: unlink d1/d29/d2a/d3c/c51 0 2024-04-22T00:05:06.592 INFO:tasks.workunit.client.0.smithi110.stdout:3/758: symlink d6/d12/d3c/d65/dfc/l102 0 2024-04-22T00:05:06.767 INFO:tasks.workunit.client.0.smithi110.stdout:8/825: fdatasync d5/da/d17/d7c/f87 0 2024-04-22T00:05:06.947 INFO:tasks.workunit.client.0.smithi110.stdout:3/759: dread d6/d12/f8f [0,4194304] 0 2024-04-22T00:05:06.986 INFO:tasks.workunit.client.0.smithi110.stdout:2/804: mknod d9/d25/d1b/d45/d50/d94/c10d 0 2024-04-22T00:05:06.998 INFO:tasks.workunit.client.0.smithi110.stdout:1/732: write d1/d2/d1b/f13 [243092,6483] 0 2024-04-22T00:05:07.135 INFO:tasks.workunit.client.0.smithi110.stdout:2/805: chown d9/d25/d1c/f28 842 1 2024-04-22T00:05:07.781 INFO:tasks.workunit.client.0.smithi110.stdout:9/758: dread d1/d29/d4d/f8e [0,4194304] 0 2024-04-22T00:05:07.917 INFO:tasks.workunit.client.0.smithi110.stdout:7/759: rename d10/d45/d51/d88/d39/f5b to d10/d43/f10e 0 2024-04-22T00:05:08.166 INFO:tasks.workunit.client.0.smithi110.stdout:5/759: unlink d7/d24/d37/l94 0 2024-04-22T00:05:08.329 INFO:tasks.workunit.client.0.smithi110.stdout:2/806: truncate d9/d25/d1c/d82/faf 7467070 0 2024-04-22T00:05:08.390 INFO:tasks.workunit.client.0.smithi110.stdout:8/826: dread d5/da/d17/d6c/d7d/d114/f9f [0,4194304] 0 2024-04-22T00:05:08.422 INFO:tasks.workunit.client.0.smithi110.stdout:9/759: rmdir d1/d29/d6f/db4/d79/d98 39 2024-04-22T00:05:08.719 INFO:tasks.workunit.client.0.smithi110.stdout:6/761: dwrite d16/d1d/d38/dab/fde [0,4194304] 0 2024-04-22T00:05:08.732 INFO:tasks.workunit.client.0.smithi110.stdout:0/765: rename d0/d27/d68/d7d/lac to d0/d27/d4b/da0/da4/l107 0 2024-04-22T00:05:09.218 INFO:tasks.workunit.client.0.smithi110.stdout:5/760: dread d7/d9/f21 [0,4194304] 0 2024-04-22T00:05:09.232 INFO:tasks.workunit.client.0.smithi110.stdout:4/699: write d1/d35/d6b/df2/d20/d50/f6e [1366974,111334] 0 2024-04-22T00:05:09.389 INFO:tasks.workunit.client.0.smithi110.stdout:3/760: rename d6/d12/d16/c74 to d6/d12/d14/d32/c103 0 2024-04-22T00:05:09.558 INFO:tasks.workunit.client.0.smithi110.stdout:9/760: truncate d1/d29/d59/f93 4977803 0 2024-04-22T00:05:09.680 INFO:tasks.workunit.client.0.smithi110.stdout:2/807: mknod d9/d25/d1c/c10e 0 2024-04-22T00:05:09.855 INFO:tasks.workunit.client.0.smithi110.stdout:5/761: mkdir d7/d22/d5b/da5/db6/dda 0 2024-04-22T00:05:10.133 INFO:tasks.workunit.client.0.smithi110.stdout:4/700: truncate d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/fe0 739836 0 2024-04-22T00:05:10.312 INFO:tasks.workunit.client.0.smithi110.stdout:3/761: symlink d6/d12/d50/l104 0 2024-04-22T00:05:10.929 INFO:tasks.workunit.client.0.smithi110.stdout:9/761: dread d1/d29/d6f/db4/fa3 [0,4194304] 0 2024-04-22T00:05:10.970 INFO:tasks.workunit.client.0.smithi110.stdout:0/766: creat d0/d56/f108 x:0 0 0 2024-04-22T00:05:11.077 INFO:tasks.workunit.client.0.smithi110.stdout:9/762: read d1/d29/d2a/d2b/d58/f95 [323680,43860] 0 2024-04-22T00:05:11.488 INFO:tasks.workunit.client.0.smithi110.stdout:2/808: truncate d9/fc5 11837424 0 2024-04-22T00:05:11.666 INFO:tasks.workunit.client.0.smithi110.stdout:5/762: mkdir d7/d24/d49/ddb 0 2024-04-22T00:05:11.970 INFO:tasks.workunit.client.0.smithi110.stdout:0/767: fdatasync d0/f2c 0 2024-04-22T00:05:12.154 INFO:tasks.workunit.client.0.smithi110.stdout:7/760: write d10/d45/d60/d5e/d65/da3/fac [4620334,75306] 0 2024-04-22T00:05:12.290 INFO:tasks.workunit.client.0.smithi110.stdout:4/701: mkdir d1/d35/d6b/df2/d20/df5 0 2024-04-22T00:05:12.501 INFO:tasks.workunit.client.0.smithi110.stdout:2/809: creat d9/d1a/d1d/d4a/d78/f10f x:0 0 0 2024-04-22T00:05:12.595 INFO:tasks.workunit.client.0.smithi110.stdout:8/827: write d5/d24/d33/d3d/d82/ff5 [751717,128504] 0 2024-04-22T00:05:12.660 INFO:tasks.workunit.client.0.smithi110.stdout:5/763: read d7/d24/d31/f45 [3163144,113032] 0 2024-04-22T00:05:13.416 INFO:tasks.workunit.client.0.smithi110.stdout:7/761: read fd [1653423,19170] 0 2024-04-22T00:05:13.527 INFO:tasks.workunit.client.0.smithi110.stdout:9/763: unlink d1/d29/laa 0 2024-04-22T00:05:13.561 INFO:tasks.workunit.client.0.smithi110.stdout:9/764: stat d1/d29/d2a/d6/d1d/f84 0 2024-04-22T00:05:13.860 INFO:tasks.workunit.client.0.smithi110.stdout:6/762: dwrite d16/d3d/d40/d46/f56 [0,4194304] 0 2024-04-22T00:05:13.877 INFO:tasks.workunit.client.0.smithi110.stdout:5/764: mkdir d7/d24/d3a/d40/ddc 0 2024-04-22T00:05:13.900 INFO:tasks.workunit.client.0.smithi110.stdout:8/828: truncate d5/d24/d33/f4d 1284792 0 2024-04-22T00:05:14.054 INFO:tasks.workunit.client.0.smithi110.stdout:2/810: dread d9/d25/d1b/d60/f83 [0,4194304] 0 2024-04-22T00:05:14.178 INFO:tasks.workunit.client.0.smithi110.stdout:7/762: truncate d10/d45/d51/d88/dce/f10c 792679 0 2024-04-22T00:05:14.183 INFO:tasks.workunit.client.0.smithi110.stdout:3/762: write d6/f6a [4436449,83970] 0 2024-04-22T00:05:14.208 INFO:tasks.workunit.client.0.smithi110.stdout:2/811: read d9/d1a/d1d/d4a/d6b/fc7 [1871,69732] 0 2024-04-22T00:05:14.316 INFO:tasks.workunit.client.0.smithi110.stdout:3/763: write d6/d12/d3c/fc4 [4878838,35090] 0 2024-04-22T00:05:14.445 INFO:tasks.workunit.client.0.smithi110.stdout:4/702: mkdir d1/d35/df6 0 2024-04-22T00:05:14.762 INFO:tasks.workunit.client.0.smithi110.stdout:5/765: chown d7/f58 846573202 1 2024-04-22T00:05:14.929 INFO:tasks.workunit.client.0.smithi110.stdout:0/768: creat d0/d56/f109 x:0 0 0 2024-04-22T00:05:15.544 INFO:tasks.workunit.client.0.smithi110.stdout:7/763: dread f9 [4194304,4194304] 0 2024-04-22T00:05:15.581 INFO:tasks.workunit.client.0.smithi110.stdout:7/764: stat d10/d45/d51/db1/dc9/df5 0 2024-04-22T00:05:15.897 INFO:tasks.workunit.client.0.smithi110.stdout:7/765: dread d10/d15/f21 [0,4194304] 0 2024-04-22T00:05:16.034 INFO:tasks.workunit.client.0.smithi110.stdout:8/829: creat d5/d6f/dca/f11e x:0 0 0 2024-04-22T00:05:16.481 INFO:tasks.workunit.client.0.smithi110.stdout:0/769: fsync d0/d16/d5d/f90 0 2024-04-22T00:05:16.592 INFO:tasks.workunit.client.0.smithi110.stdout:2/812: mkdir d9/d1a/d1d/d7a/d110 0 2024-04-22T00:05:16.666 INFO:tasks.workunit.client.0.smithi110.stdout:9/765: stat d1/d19/l1c 0 2024-04-22T00:05:16.789 INFO:tasks.workunit.client.0.smithi110.stdout:1/733: rename d1/d2/l5 to d1/d2/d30/d9c/lfc 0 2024-04-22T00:05:17.001 INFO:tasks.workunit.client.0.smithi110.stdout:4/703: mkdir d1/d35/d6b/df2/d20/d58/d93/df7 0 2024-04-22T00:05:17.120 INFO:tasks.workunit.client.0.smithi110.stdout:1/734: dread d1/d2/d1b/f35 [0,4194304] 0 2024-04-22T00:05:17.242 INFO:tasks.workunit.client.0.smithi110.stdout:8/830: mknod d5/da/d17/d6c/d95/c11f 0 2024-04-22T00:05:18.057 INFO:tasks.workunit.client.0.smithi110.stdout:4/704: symlink d1/d35/d6b/df2/d20/d23/d1c/dae/lf8 0 2024-04-22T00:05:18.227 INFO:tasks.workunit.client.0.smithi110.stdout:7/766: unlink d10/d45/d51/d88/d39/d7f/dd6/fea 0 2024-04-22T00:05:19.033 INFO:tasks.workunit.client.0.smithi110.stdout:6/763: dwrite d16/d1d/d38/f4f [4194304,4194304] 0 2024-04-22T00:05:19.176 INFO:tasks.workunit.client.0.smithi110.stdout:6/764: stat d16/d1d/d38/d48/d5e/cc2 0 2024-04-22T00:05:19.493 INFO:tasks.workunit.client.0.smithi110.stdout:7/767: creat d10/d45/d51/d88/d46/d69/d75/f10f x:0 0 0 2024-04-22T00:05:19.643 INFO:tasks.workunit.client.0.smithi110.stdout:7/768: chown d10/d45/d51/fd2 159 1 2024-04-22T00:05:19.687 INFO:tasks.workunit.client.0.smithi110.stdout:5/766: link d7/d24/d3a/da7/fc6 d7/d22/d5b/fdd 0 2024-04-22T00:05:19.767 INFO:tasks.workunit.client.0.smithi110.stdout:7/769: dread - d10/d43/f91 zero size 2024-04-22T00:05:19.776 INFO:tasks.workunit.client.0.smithi110.stdout:3/764: dwrite d6/d78/f8b [0,4194304] 0 2024-04-22T00:05:19.806 INFO:tasks.workunit.client.0.smithi110.stdout:0/770: creat d0/d27/d4b/da0/f10a x:0 0 0 2024-04-22T00:05:19.947 INFO:tasks.workunit.client.0.smithi110.stdout:2/813: creat d9/d1a/d1d/d7a/f111 x:0 0 0 2024-04-22T00:05:20.197 INFO:tasks.workunit.client.0.smithi110.stdout:9/766: link d1/d29/d2a/d2b/f7f d1/d29/d2a/d2b/d57/d97/dad/fe9 0 2024-04-22T00:05:20.265 INFO:tasks.workunit.client.0.smithi110.stdout:9/767: chown d1/d29/d4d/dac/cbb 9313 1 2024-04-22T00:05:20.358 INFO:tasks.workunit.client.0.smithi110.stdout:6/765: fdatasync d16/d3d/d40/d46/f89 0 2024-04-22T00:05:21.117 INFO:tasks.workunit.client.0.smithi110.stdout:2/814: chown d9/d25/d1c/c43 15333018 1 2024-04-22T00:05:21.397 INFO:tasks.workunit.client.0.smithi110.stdout:0/771: rename d0/d16/cfe to d0/d2a/c10b 0 2024-04-22T00:05:21.958 INFO:tasks.workunit.client.0.smithi110.stdout:7/770: truncate d10/d45/d51/d88/dce/f10c 1573459 0 2024-04-22T00:05:22.423 INFO:tasks.workunit.client.0.smithi110.stdout:0/772: fsync d0/d14/d23/d3b/fb5 0 2024-04-22T00:05:22.430 INFO:tasks.workunit.client.0.smithi110.stdout:2/815: dread d9/d25/d1c/f28 [0,4194304] 0 2024-04-22T00:05:22.526 INFO:tasks.workunit.client.0.smithi110.stdout:8/831: write d5/ff [849766,51478] 0 2024-04-22T00:05:22.920 INFO:tasks.workunit.client.0.smithi110.stdout:1/735: dwrite d1/d2/d1b/d10/d5c/dc5/d27/d3e/fe7 [0,4194304] 0 2024-04-22T00:05:23.182 INFO:tasks.workunit.client.0.smithi110.stdout:2/816: mkdir d9/d1a/d1d/d2b/d5b/d112 0 2024-04-22T00:05:23.432 INFO:tasks.workunit.client.0.smithi110.stdout:6/766: creat d16/d1e/d24/fff x:0 0 0 2024-04-22T00:05:23.453 INFO:tasks.workunit.client.0.smithi110.stdout:4/705: write d1/d35/d6b/df2/d20/d50/fa3 [55315,102072] 0 2024-04-22T00:05:23.516 INFO:tasks.workunit.client.0.smithi110.stdout:6/767: chown d16/d1e/d24/d90 31479657 1 2024-04-22T00:05:23.781 INFO:tasks.workunit.client.0.smithi110.stdout:7/771: creat d10/d45/d60/d5e/d65/d8a/deb/f110 x:0 0 0 2024-04-22T00:05:24.225 INFO:tasks.workunit.client.0.smithi110.stdout:1/736: truncate d1/d2/d1b/d10/d5c/dc5/d27/f6b 4720960 0 2024-04-22T00:05:24.478 INFO:tasks.workunit.client.0.smithi110.stdout:6/768: read d16/d1d/d38/d8e/f9f [312152,31939] 0 2024-04-22T00:05:24.850 INFO:tasks.workunit.client.0.smithi110.stdout:1/737: mkdir d1/d2/d14/dfd 0 2024-04-22T00:05:25.077 INFO:tasks.workunit.client.0.smithi110.stdout:1/738: chown d1/dd/d23/d48/d4e/ddc/fde 6109917 1 2024-04-22T00:05:25.177 INFO:tasks.workunit.client.0.smithi110.stdout:6/769: mknod d16/d1e/d24/d66/c100 0 2024-04-22T00:05:25.220 INFO:tasks.workunit.client.0.smithi110.stdout:3/765: dwrite d6/d12/d16/d6f/fa4 [0,4194304] 0 2024-04-22T00:05:25.403 INFO:tasks.workunit.client.0.smithi110.stdout:5/767: creat d7/fde x:0 0 0 2024-04-22T00:05:25.463 INFO:tasks.workunit.client.0.smithi110.stdout:3/766: chown d6/d12/d16/d30/dc7 4857563 1 2024-04-22T00:05:25.858 INFO:tasks.workunit.client.0.smithi110.stdout:9/768: dwrite d1/d29/d6f/f8a [0,4194304] 0 2024-04-22T00:05:26.296 INFO:tasks.workunit.client.0.smithi110.stdout:4/706: link d1/d35/d6b/df2/d12/f65 d1/d35/d6b/df2/d20/df5/ff9 0 2024-04-22T00:05:26.451 INFO:tasks.workunit.client.0.smithi110.stdout:5/768: mknod d7/d24/d3a/d54/cdf 0 2024-04-22T00:05:27.362 INFO:tasks.workunit.client.0.smithi110.stdout:8/832: dwrite d5/d24/f2c [0,4194304] 0 2024-04-22T00:05:27.372 INFO:tasks.workunit.client.0.smithi110.stdout:3/767: truncate d6/d12/d3c/d8d/dee/ffd 5110648 0 2024-04-22T00:05:27.712 INFO:tasks.workunit.client.0.smithi110.stdout:8/833: dread d5/da/d17/d6c/d7d/d114/d8c/f83 [0,4194304] 0 2024-04-22T00:05:27.958 INFO:tasks.workunit.client.0.smithi110.stdout:0/773: write d0/f41 [1396329,111739] 0 2024-04-22T00:05:28.195 INFO:tasks.workunit.client.0.smithi110.stdout:2/817: dwrite d9/d1a/d1d/d2b/d54/f70 [0,4194304] 0 2024-04-22T00:05:28.313 INFO:tasks.workunit.client.0.smithi110.stdout:3/768: truncate d6/d12/d14/d4b/fde 76549 0 2024-04-22T00:05:28.518 INFO:tasks.workunit.client.0.smithi110.stdout:3/769: dread d6/d12/d3c/f95 [0,4194304] 0 2024-04-22T00:05:28.540 INFO:tasks.workunit.client.0.smithi110.stdout:8/834: creat d5/da/d17/d7c/dc0/f120 x:0 0 0 2024-04-22T00:05:28.673 INFO:tasks.workunit.client.0.smithi110.stdout:7/772: write d10/d43/f10e [4120210,34989] 0 2024-04-22T00:05:29.491 INFO:tasks.workunit.client.0.smithi110.stdout:7/773: rmdir d10/d45/d51/d88/d46/d69/d75 39 2024-04-22T00:05:29.762 INFO:tasks.workunit.client.0.smithi110.stdout:1/739: write d1/d2/d1b/d10/da2/fee [3208762,74654] 0 2024-04-22T00:05:30.276 INFO:tasks.workunit.client.0.smithi110.stdout:5/769: dwrite d7/d9/d17/f18 [16777216,4194304] 0 2024-04-22T00:05:30.475 INFO:tasks.workunit.client.0.smithi110.stdout:4/707: write d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d6a/f77 [250111,91979] 0 2024-04-22T00:05:30.480 INFO:tasks.workunit.client.0.smithi110.stdout:9/769: write d1/f7 [886924,65747] 0 2024-04-22T00:05:30.763 INFO:tasks.workunit.client.0.smithi110.stdout:2/818: write d9/d25/d1b/d45/f80 [986124,98] 0 2024-04-22T00:05:30.771 INFO:tasks.workunit.client.0.smithi110.stdout:0/774: write d0/d16/d42/d50/f89 [195028,54911] 0 2024-04-22T00:05:30.798 INFO:tasks.workunit.client.0.smithi110.stdout:8/835: mkdir d5/d121 0 2024-04-22T00:05:30.804 INFO:tasks.workunit.client.0.smithi110.stdout:3/770: write d6/d12/d3c/f68 [4907851,120398] 0 2024-04-22T00:05:30.841 INFO:tasks.workunit.client.0.smithi110.stdout:6/770: symlink d16/l101 0 2024-04-22T00:05:31.575 INFO:tasks.workunit.client.0.smithi110.stdout:7/774: dread d10/d45/d51/d88/d46/d69/d75/f107 [0,4194304] 0 2024-04-22T00:05:31.607 INFO:tasks.workunit.client.0.smithi110.stdout:5/770: creat d7/d22/d5b/d6f/fe0 x:0 0 0 2024-04-22T00:05:31.787 INFO:tasks.workunit.client.0.smithi110.stdout:4/708: symlink d1/d35/d6b/df2/d20/d50/lfa 0 2024-04-22T00:05:31.888 INFO:tasks.workunit.client.0.smithi110.stdout:9/770: truncate d1/d29/d6f/db4/f9a 825781 0 2024-04-22T00:05:32.261 INFO:tasks.workunit.client.0.smithi110.stdout:6/771: dread d16/d1e/f6c [0,4194304] 0 2024-04-22T00:05:32.454 INFO:tasks.workunit.client.0.smithi110.stdout:0/775: dread - d0/d16/d42/d50/dbc/ffd zero size 2024-04-22T00:05:32.463 INFO:tasks.workunit.client.0.smithi110.stdout:8/836: dread - d5/d24/d33/d3d/d82/da8/f105 zero size 2024-04-22T00:05:32.538 INFO:tasks.workunit.client.0.smithi110.stdout:3/771: creat d6/d12/d16/d6f/db5/f105 x:0 0 0 2024-04-22T00:05:32.644 INFO:tasks.workunit.client.0.smithi110.stdout:7/775: creat d10/d45/d51/d88/dce/f111 x:0 0 0 2024-04-22T00:05:33.182 INFO:tasks.workunit.client.0.smithi110.stdout:6/772: chown d16/d1d/f2f 60247 1 2024-04-22T00:05:33.304 INFO:tasks.workunit.client.0.smithi110.stdout:0/776: mknod d0/d27/d68/d7d/c10c 0 2024-04-22T00:05:33.427 INFO:tasks.workunit.client.0.smithi110.stdout:8/837: unlink d5/d74/faf 0 2024-04-22T00:05:33.466 INFO:tasks.workunit.client.0.smithi110.stdout:8/838: chown d5/da/dac/dc6/f115 12662029 1 2024-04-22T00:05:33.640 INFO:tasks.workunit.client.0.smithi110.stdout:1/740: link d1/d2/d14/f9d d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/ffe 0 2024-04-22T00:05:33.677 INFO:tasks.workunit.client.0.smithi110.stdout:2/819: write d9/d1a/d1d/d4a/d78/f10f [25226,113319] 0 2024-04-22T00:05:33.716 INFO:tasks.workunit.client.0.smithi110.stdout:3/772: dread d6/d78/f88 [0,4194304] 0 2024-04-22T00:05:33.927 INFO:tasks.workunit.client.0.smithi110.stdout:4/709: rename d1/d35/d6b/df2/d20/d23/fe1 to d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8/ffb 0 2024-04-22T00:05:34.150 INFO:tasks.workunit.client.0.smithi110.stdout:6/773: dread d16/fdc [0,4194304] 0 2024-04-22T00:05:34.292 INFO:tasks.workunit.client.0.smithi110.stdout:5/771: write d7/d24/d31/f5e [9618624,122263] 0 2024-04-22T00:05:34.349 INFO:tasks.workunit.client.0.smithi110.stdout:5/772: write d7/d9/d17/f18 [7924151,97074] 0 2024-04-22T00:05:34.524 INFO:tasks.workunit.client.0.smithi110.stdout:9/771: write d1/d29/d2a/d2b/d58/f63 [3573307,8906] 0 2024-04-22T00:05:34.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/773: symlink d6/d12/l106 0 2024-04-22T00:05:34.813 INFO:tasks.workunit.client.0.smithi110.stdout:1/741: creat d1/d2/d1b/d10/d5c/d77/d78/fff x:0 0 0 2024-04-22T00:05:34.914 INFO:tasks.workunit.client.0.smithi110.stdout:2/820: symlink d9/d1a/d1d/d4a/d6b/d3a/d5c/l113 0 2024-04-22T00:05:35.133 INFO:tasks.workunit.client.0.smithi110.stdout:2/821: readlink d9/d25/d1c/da0/lb2 0 2024-04-22T00:05:35.154 INFO:tasks.workunit.client.0.smithi110.stdout:4/710: rename d1/l1e to d1/d35/d6b/df2/d20/d58/d93/d5e/lfc 0 2024-04-22T00:05:35.203 INFO:tasks.workunit.client.0.smithi110.stdout:1/742: dread d1/dd/d23/d48/d4e/ddc/fde [0,4194304] 0 2024-04-22T00:05:35.242 INFO:tasks.workunit.client.0.smithi110.stdout:6/774: fsync d16/d1d/d38/d48/d5e/d62/f8d 0 2024-04-22T00:05:35.265 INFO:tasks.workunit.client.0.smithi110.stdout:1/743: chown d1/d2/d30/db9 1 1 2024-04-22T00:05:35.386 INFO:tasks.workunit.client.0.smithi110.stdout:2/822: sync 2024-04-22T00:05:35.681 INFO:tasks.workunit.client.0.smithi110.stdout:7/776: write d10/d45/d51/d88/d46/fa0 [753219,62350] 0 2024-04-22T00:05:35.684 INFO:tasks.workunit.client.0.smithi110.stdout:5/773: fdatasync d7/d9/f21 0 2024-04-22T00:05:35.768 INFO:tasks.workunit.client.0.smithi110.stdout:5/774: fsync d7/d9/d17/f18 0 2024-04-22T00:05:36.094 INFO:tasks.workunit.client.0.smithi110.stdout:5/775: dwrite d7/d9/d17/f18 [16777216,4194304] 0 2024-04-22T00:05:36.228 INFO:tasks.workunit.client.0.smithi110.stdout:8/839: write d5/da/d17/d6c/d7d/f69 [5305914,109290] 0 2024-04-22T00:05:36.294 INFO:tasks.workunit.client.0.smithi110.stdout:5/776: read d7/d24/d49/d64/f83 [1933877,108633] 0 2024-04-22T00:05:36.317 INFO:tasks.workunit.client.0.smithi110.stdout:3/774: rename d6/d12/d50/l59 to d6/d12/d3c/d65/da8/l107 0 2024-04-22T00:05:36.551 INFO:tasks.workunit.client.0.smithi110.stdout:3/775: dread f1 [0,4194304] 0 2024-04-22T00:05:36.919 INFO:tasks.workunit.client.0.smithi110.stdout:1/744: mknod d1/d2/d30/d8b/dc3/c100 0 2024-04-22T00:05:37.052 INFO:tasks.workunit.client.0.smithi110.stdout:2/823: symlink d9/d25/de5/l114 0 2024-04-22T00:05:38.131 INFO:tasks.workunit.client.0.smithi110.stdout:0/777: link d0/d27/d4b/da0/c101 d0/d56/da3/c10d 0 2024-04-22T00:05:38.719 INFO:tasks.workunit.client.0.smithi110.stdout:4/711: creat d1/d35/df6/ffd x:0 0 0 2024-04-22T00:05:38.770 INFO:tasks.workunit.client.0.smithi110.stdout:6/775: dwrite d16/d1d/d38/d8e/fd6 [0,4194304] 0 2024-04-22T00:05:39.500 INFO:tasks.workunit.client.0.smithi110.stdout:2/824: truncate d9/f49 5214631 0 2024-04-22T00:05:40.490 INFO:tasks.workunit.client.0.smithi110.stdout:9/772: rmdir d1/d29/d2a/d2b/d58/dd2 0 2024-04-22T00:05:40.491 INFO:tasks.workunit.client.0.smithi110.stdout:0/778: mknod d0/d16/d5d/c10e 0 2024-04-22T00:05:40.736 INFO:tasks.workunit.client.0.smithi110.stdout:8/840: write d5/d24/d33/d3d/fe4 [695112,2225] 0 2024-04-22T00:05:41.087 INFO:tasks.workunit.client.0.smithi110.stdout:3/776: write d6/d12/d16/d30/d9c/f79 [2408823,95581] 0 2024-04-22T00:05:41.253 INFO:tasks.workunit.client.0.smithi110.stdout:7/777: link d10/d45/d51/d88/d46/l6c d10/d45/d51/d88/d39/d7f/dd6/l112 0 2024-04-22T00:05:41.296 INFO:tasks.workunit.client.0.smithi110.stdout:7/778: chown d10/d45/d51/db1/dc9/df5/l5c 179938037 1 2024-04-22T00:05:41.955 INFO:tasks.workunit.client.0.smithi110.stdout:6/776: mkdir d16/d3d/d97/d102 0 2024-04-22T00:05:41.972 INFO:tasks.workunit.client.0.smithi110.stdout:6/777: chown d16/d3d/d97 5 1 2024-04-22T00:05:42.168 INFO:tasks.workunit.client.0.smithi110.stdout:2/825: mknod d9/d25/d1b/d45/d10b/c115 0 2024-04-22T00:05:42.176 INFO:tasks.workunit.client.0.smithi110.stdout:8/841: rmdir d5/da/d17/d6c/d72/d73 39 2024-04-22T00:05:42.358 INFO:tasks.workunit.client.0.smithi110.stdout:8/842: readlink d5/d24/d33/d3d/d82/l103 0 2024-04-22T00:05:42.456 INFO:tasks.workunit.client.0.smithi110.stdout:8/843: readlink d5/d74/l106 0 2024-04-22T00:05:42.821 INFO:tasks.workunit.client.0.smithi110.stdout:1/745: dwrite d1/d2/d1b/d10/d5c/dc5/d27/fbf [4194304,4194304] 0 2024-04-22T00:05:42.821 INFO:tasks.workunit.client.0.smithi110.stdout:5/777: rename d7/f98 to d7/d24/d31/fe1 0 2024-04-22T00:05:42.821 INFO:tasks.workunit.client.0.smithi110.stdout:7/779: truncate d10/d45/d51/d88/d39/d7f/d80/fa8 927369 0 2024-04-22T00:05:43.649 INFO:tasks.workunit.client.0.smithi110.stdout:4/712: rename d1/d35/d6b/df2/d20/d23/c99 to d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/d7a/cfe 0 2024-04-22T00:05:44.090 INFO:tasks.workunit.client.0.smithi110.stdout:7/780: creat d10/d45/d60/d5e/d65/d8a/deb/f113 x:0 0 0 2024-04-22T00:05:44.571 INFO:tasks.workunit.client.0.smithi110.stdout:6/778: rename d16/d1e/d24/d66/lf2 to d16/d1d/d38/d48/d5e/d6a/l103 0 2024-04-22T00:05:45.234 INFO:tasks.workunit.client.0.smithi110.stdout:7/781: unlink d10/d45/d51/d88/d93/cc1 0 2024-04-22T00:05:45.267 INFO:tasks.workunit.client.0.smithi110.stdout:0/779: write d0/d14/f32 [2435704,3364] 0 2024-04-22T00:05:45.357 INFO:tasks.workunit.client.0.smithi110.stdout:6/779: truncate d16/d1e/d24/d33/f68 644068 0 2024-04-22T00:05:45.950 INFO:tasks.workunit.client.0.smithi110.stdout:3/777: dwrite d6/d12/d14/f2e [0,4194304] 0 2024-04-22T00:05:46.319 INFO:tasks.workunit.client.0.smithi110.stdout:0/780: mkdir d0/d56/d10f 0 2024-04-22T00:05:46.577 INFO:tasks.workunit.client.0.smithi110.stdout:2/826: write d9/d25/d1c/da0/ff2 [704237,27488] 0 2024-04-22T00:05:46.843 INFO:tasks.workunit.client.0.smithi110.stdout:3/778: mknod d6/d12/d14/d32/c108 0 2024-04-22T00:05:46.853 INFO:tasks.workunit.client.0.smithi110.stdout:0/781: truncate d0/d27/d4b/f54 852799 0 2024-04-22T00:05:46.890 INFO:tasks.workunit.client.0.smithi110.stdout:0/782: stat d0/d56/l9c 0 2024-04-22T00:05:47.627 INFO:tasks.workunit.client.0.smithi110.stdout:2/827: fdatasync d9/d25/d1b/d45/d8e/fda 0 2024-04-22T00:05:47.635 INFO:tasks.workunit.client.0.smithi110.stdout:4/713: write d1/d35/d6b/df2/f8a [3913448,69508] 0 2024-04-22T00:05:47.647 INFO:tasks.workunit.client.0.smithi110.stdout:1/746: write d1/f40 [2265797,127931] 0 2024-04-22T00:05:47.650 INFO:tasks.workunit.client.0.smithi110.stdout:5/778: write d7/d9/d17/fc1 [242598,115710] 0 2024-04-22T00:05:47.687 INFO:tasks.workunit.client.0.smithi110.stdout:6/780: write d16/d1e/f6c [5168278,69472] 0 2024-04-22T00:05:47.689 INFO:tasks.workunit.client.0.smithi110.stdout:7/782: write d10/d27/f29 [4088536,70442] 0 2024-04-22T00:05:47.936 INFO:tasks.workunit.client.0.smithi110.stdout:1/747: chown d1/d2/d30/d8b 1675772 1 2024-04-22T00:05:48.091 INFO:tasks.workunit.client.0.smithi110.stdout:8/844: dwrite d5/d24/d33/f4d [0,4194304] 0 2024-04-22T00:05:48.409 INFO:tasks.workunit.client.0.smithi110.stdout:0/783: mkdir d0/d56/d10f/d110 0 2024-04-22T00:05:48.598 INFO:tasks.workunit.client.0.smithi110.stdout:3/779: dread d6/d12/d3c/d65/ffe [0,4194304] 0 2024-04-22T00:05:48.678 INFO:tasks.workunit.client.0.smithi110.stdout:9/773: creat d1/fea x:0 0 0 2024-04-22T00:05:48.688 INFO:tasks.workunit.client.0.smithi110.stdout:2/828: creat d9/d25/d1c/da0/f116 x:0 0 0 2024-04-22T00:05:48.988 INFO:tasks.workunit.client.0.smithi110.stdout:1/748: creat d1/d2/d1b/d10/d5c/f101 x:0 0 0 2024-04-22T00:05:49.154 INFO:tasks.workunit.client.0.smithi110.stdout:6/781: truncate d16/d1e/ff6 900110 0 2024-04-22T00:05:50.001 INFO:tasks.workunit.client.0.smithi110.stdout:4/714: mknod d1/d35/d6b/df2/d20/d58/d93/df7/cff 0 2024-04-22T00:05:50.319 INFO:tasks.workunit.client.0.smithi110.stdout:7/783: rename d10/d45/d51/d88/d39/lc0 to d10/d15/d95/d10a/l114 0 2024-04-22T00:05:50.499 INFO:tasks.workunit.client.0.smithi110.stdout:6/782: rmdir d16/d3d/d97 39 2024-04-22T00:05:50.777 INFO:tasks.workunit.client.0.smithi110.stdout:9/774: mkdir d1/d29/d59/d99/deb 0 2024-04-22T00:05:51.510 INFO:tasks.workunit.client.0.smithi110.stdout:7/784: unlink f9 0 2024-04-22T00:05:51.771 INFO:tasks.workunit.client.0.smithi110.stdout:3/780: write d6/d12/d16/f5e [2129185,74153] 0 2024-04-22T00:05:51.926 INFO:tasks.workunit.client.0.smithi110.stdout:6/783: mknod d16/d1d/d38/d48/d5e/d62/d94/c104 0 2024-04-22T00:05:51.988 INFO:tasks.workunit.client.0.smithi110.stdout:6/784: stat d16/d1d/d38/d48/d5e/d6a/db6 0 2024-04-22T00:05:52.285 INFO:tasks.workunit.client.0.smithi110.stdout:5/779: getdents d7/d24/d49/d64 0 2024-04-22T00:05:52.335 INFO:tasks.workunit.client.0.smithi110.stdout:2/829: dwrite d9/d1a/d1d/d4a/d6b/d3a/d5c/f97 [0,4194304] 0 2024-04-22T00:05:52.622 INFO:tasks.workunit.client.0.smithi110.stdout:7/785: symlink d10/d27/l115 0 2024-04-22T00:05:52.664 INFO:tasks.workunit.client.0.smithi110.stdout:8/845: getdents d5/da/d17/d6c/d7d 0 2024-04-22T00:05:52.821 INFO:tasks.workunit.client.0.smithi110.stdout:0/784: getdents d0/d14 0 2024-04-22T00:05:52.865 INFO:tasks.workunit.client.0.smithi110.stdout:1/749: write d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/ffe [1765470,74203] 0 2024-04-22T00:05:53.020 INFO:tasks.workunit.client.0.smithi110.stdout:3/781: creat d6/d12/d16/d5d/f109 x:0 0 0 2024-04-22T00:05:53.261 INFO:tasks.workunit.client.0.smithi110.stdout:7/786: dread d10/d43/f8c [0,4194304] 0 2024-04-22T00:05:53.877 INFO:tasks.workunit.client.0.smithi110.stdout:5/780: unlink d7/d22/d5b/l77 0 2024-04-22T00:05:54.004 INFO:tasks.workunit.client.0.smithi110.stdout:8/846: fsync d5/f6 0 2024-04-22T00:05:54.074 INFO:tasks.workunit.client.0.smithi110.stdout:4/715: write d1/d35/d6b/df2/fcc [1073778,41813] 0 2024-04-22T00:05:54.862 INFO:tasks.workunit.client.0.smithi110.stdout:3/782: creat d6/d12/d16/d30/dc7/f10a x:0 0 0 2024-04-22T00:05:55.283 INFO:tasks.workunit.client.0.smithi110.stdout:7/787: creat d10/d45/d60/d5e/d65/d8a/deb/f116 x:0 0 0 2024-04-22T00:05:55.298 INFO:tasks.workunit.client.0.smithi110.stdout:9/775: write d1/f15 [1325972,91368] 0 2024-04-22T00:05:55.471 INFO:tasks.workunit.client.0.smithi110.stdout:2/830: symlink d9/l117 0 2024-04-22T00:05:55.571 INFO:tasks.workunit.client.0.smithi110.stdout:5/781: fdatasync d7/d22/d5b/d6f/fbf 0 2024-04-22T00:05:55.710 INFO:tasks.workunit.client.0.smithi110.stdout:5/782: stat d7/d35/l9e 0 2024-04-22T00:05:55.851 INFO:tasks.workunit.client.0.smithi110.stdout:6/785: dwrite d16/d3d/d40/f9c [0,4194304] 0 2024-04-22T00:05:56.208 INFO:tasks.workunit.client.0.smithi110.stdout:8/847: fsync d5/d6f/f70 0 2024-04-22T00:05:56.236 INFO:tasks.workunit.client.0.smithi110.stdout:8/848: stat d5/da/la1 0 2024-04-22T00:05:56.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/785: rename d0/d14/d23/d6d/fda to d0/d16/d5d/dc5/f111 0 2024-04-22T00:05:57.230 INFO:tasks.workunit.client.0.smithi110.stdout:1/750: write d1/d2/d1b/d10/d5c/dc5/d27/d3e/fe7 [2019055,33007] 0 2024-04-22T00:05:57.459 INFO:tasks.workunit.client.0.smithi110.stdout:2/831: mknod d9/d1a/d1d/d2b/d5b/dd2/de7/c118 0 2024-04-22T00:05:57.699 INFO:tasks.workunit.client.0.smithi110.stdout:5/783: creat d7/d35/dc0/fe2 x:0 0 0 2024-04-22T00:05:58.010 INFO:tasks.workunit.client.0.smithi110.stdout:4/716: creat d1/d35/d6b/df2/d20/d58/d7e/ddd/deb/f100 x:0 0 0 2024-04-22T00:05:58.165 INFO:tasks.workunit.client.0.smithi110.stdout:8/849: truncate d5/da/d88/dd4/f101 199391 0 2024-04-22T00:05:58.871 INFO:tasks.workunit.client.0.smithi110.stdout:1/751: rename d1/d1d/d70/c7e to d1/d2/d1b/da7/c102 0 2024-04-22T00:05:58.997 INFO:tasks.workunit.client.0.smithi110.stdout:3/783: dwrite d6/d12/d14/f7e [4194304,4194304] 0 2024-04-22T00:05:59.164 INFO:tasks.workunit.client.0.smithi110.stdout:9/776: write d1/d29/d2a/d2b/d58/d7b/fab [409342,72090] 0 2024-04-22T00:05:59.598 INFO:tasks.workunit.client.0.smithi110.stdout:5/784: dread d7/d9/f33 [0,4194304] 0 2024-04-22T00:05:59.999 INFO:tasks.workunit.client.0.smithi110.stdout:8/850: mkdir d5/d24/d33/d3d/d5c/d122 0 2024-04-22T00:06:00.000 INFO:tasks.workunit.client.0.smithi110.stdout:0/786: truncate d0/fc 2302750 0 2024-04-22T00:06:00.527 INFO:tasks.workunit.client.0.smithi110.stdout:3/784: fsync d6/d12/d3c/f95 0 2024-04-22T00:06:00.926 INFO:tasks.workunit.client.0.smithi110.stdout:7/788: dwrite d10/d45/f4f [0,4194304] 0 2024-04-22T00:06:01.125 INFO:tasks.workunit.client.0.smithi110.stdout:5/785: dread d7/d24/d37/f87 [0,4194304] 0 2024-04-22T00:06:01.184 INFO:tasks.workunit.client.0.smithi110.stdout:0/787: rmdir d0/d14/d23/d6d/da8 39 2024-04-22T00:06:01.599 INFO:tasks.workunit.client.0.smithi110.stdout:3/785: mkdir d6/d12/d50/d10b 0 2024-04-22T00:06:01.767 INFO:tasks.workunit.client.0.smithi110.stdout:9/777: mkdir d1/d29/d6f/dd9/dec 0 2024-04-22T00:06:01.781 INFO:tasks.workunit.client.0.smithi110.stdout:2/832: dwrite d9/d1a/d1d/d2b/d54/f84 [0,4194304] 0 2024-04-22T00:06:01.919 INFO:tasks.workunit.client.0.smithi110.stdout:4/717: write d1/f8f [524345,93778] 0 2024-04-22T00:06:02.002 INFO:tasks.workunit.client.0.smithi110.stdout:6/786: link d16/d1d/l78 d16/d1d/d38/d48/l105 0 2024-04-22T00:06:02.574 INFO:tasks.workunit.client.0.smithi110.stdout:0/788: dread - d0/d16/d42/fd9 zero size 2024-04-22T00:06:02.712 INFO:tasks.workunit.client.0.smithi110.stdout:3/786: creat d6/d12/d3c/d65/f10c x:0 0 0 2024-04-22T00:06:02.767 INFO:tasks.workunit.client.0.smithi110.stdout:3/787: read - d6/d12/d3c/d65/d91/fbf zero size 2024-04-22T00:06:02.812 INFO:tasks.workunit.client.0.smithi110.stdout:1/752: write d1/d1d/d4a/ffa [1021177,602] 0 2024-04-22T00:06:02.937 INFO:tasks.workunit.client.0.smithi110.stdout:3/788: truncate d6/d12/d3c/d65/f10c 745937 0 2024-04-22T00:06:02.981 INFO:tasks.workunit.client.0.smithi110.stdout:9/778: dread d1/d29/d6f/db4/f9a [0,4194304] 0 2024-04-22T00:06:03.067 INFO:tasks.workunit.client.0.smithi110.stdout:9/779: truncate d1/d29/d6f/db4/f61 4737588 0 2024-04-22T00:06:03.125 INFO:tasks.workunit.client.0.smithi110.stdout:6/787: symlink d16/d3d/d40/d46/l106 0 2024-04-22T00:06:03.285 INFO:tasks.workunit.client.0.smithi110.stdout:2/833: dread d9/d1a/d1d/d4e/f9a [0,4194304] 0 2024-04-22T00:06:03.452 INFO:tasks.workunit.client.0.smithi110.stdout:4/718: mkdir d1/d101 0 2024-04-22T00:06:03.626 INFO:tasks.workunit.client.0.smithi110.stdout:3/789: write d6/d12/d16/d30/dc7/f10a [791731,73713] 0 2024-04-22T00:06:03.777 INFO:tasks.workunit.client.0.smithi110.stdout:9/780: fsync d1/fea 0 2024-04-22T00:06:04.057 INFO:tasks.workunit.client.0.smithi110.stdout:8/851: dwrite d5/da/d17/d7c/dc0/fcf [0,4194304] 0 2024-04-22T00:06:04.642 INFO:tasks.workunit.client.0.smithi110.stdout:1/753: mkdir d1/d2/d1b/d10/d5c/dc5/d27/d103 0 2024-04-22T00:06:04.719 INFO:tasks.workunit.client.0.smithi110.stdout:3/790: dread - d6/d12/d16/d30/ff5 zero size 2024-04-22T00:06:05.534 INFO:tasks.workunit.client.0.smithi110.stdout:1/754: dread - d1/d2/d1b/d10/d5c/d77/d78/deb/fc8 zero size 2024-04-22T00:06:05.751 INFO:tasks.workunit.client.0.smithi110.stdout:6/788: creat d16/d3d/d97/dd0/df9/f107 x:0 0 0 2024-04-22T00:06:05.864 INFO:tasks.workunit.client.0.smithi110.stdout:7/789: dwrite d10/d45/d51/db1/dc9/df5/d2c/fd9 [0,4194304] 0 2024-04-22T00:06:06.032 INFO:tasks.workunit.client.0.smithi110.stdout:5/786: dwrite d7/d24/d3a/d54/fa3 [0,4194304] 0 2024-04-22T00:06:06.359 INFO:tasks.workunit.client.0.smithi110.stdout:3/791: mkdir d6/d12/d16/d6f/db5/db9/dc6/d10d 0 2024-04-22T00:06:06.425 INFO:tasks.workunit.client.0.smithi110.stdout:7/790: dread fd [0,4194304] 0 2024-04-22T00:06:06.535 INFO:tasks.workunit.client.0.smithi110.stdout:3/792: sync 2024-04-22T00:06:06.544 INFO:tasks.workunit.client.0.smithi110.stdout:7/791: chown d10/d45/d51/d88 8046 1 2024-04-22T00:06:06.663 INFO:tasks.workunit.client.0.smithi110.stdout:6/789: read - d16/d1d/d38/d48/d5e/d62/fd7 zero size 2024-04-22T00:06:06.723 INFO:tasks.workunit.client.0.smithi110.stdout:0/789: dwrite d0/f41 [0,4194304] 0 2024-04-22T00:06:06.924 INFO:tasks.workunit.client.0.smithi110.stdout:7/792: chown d10/d45/d51/d88/d39/d7f/d80 3837 1 2024-04-22T00:06:07.249 INFO:tasks.workunit.client.0.smithi110.stdout:5/787: dread d7/d9/d17/f1c [0,4194304] 0 2024-04-22T00:06:07.399 INFO:tasks.workunit.client.0.smithi110.stdout:2/834: write f1 [5920213,50306] 0 2024-04-22T00:06:07.435 INFO:tasks.workunit.client.0.smithi110.stdout:4/719: write d1/d35/d6b/df2/d20/fa2 [82669,66803] 0 2024-04-22T00:06:07.629 INFO:tasks.workunit.client.0.smithi110.stdout:6/790: dread d16/d1d/f25 [0,4194304] 0 2024-04-22T00:06:07.654 INFO:tasks.workunit.client.0.smithi110.stdout:7/793: chown d10/d45/d51/d88/dce/c102 894 1 2024-04-22T00:06:07.687 INFO:tasks.workunit.client.0.smithi110.stdout:6/791: chown d16/d1e/cca 638781518 1 2024-04-22T00:06:07.804 INFO:tasks.workunit.client.0.smithi110.stdout:3/793: mkdir d6/d12/da1/dea/d10e 0 2024-04-22T00:06:07.819 INFO:tasks.workunit.client.0.smithi110.stdout:9/781: write d1/d29/d4d/fb2 [345707,14542] 0 2024-04-22T00:06:07.843 INFO:tasks.workunit.client.0.smithi110.stdout:1/755: link d1/d2/d1b/d10/d5c/ld7 d1/d2/d1b/l104 0 2024-04-22T00:06:07.895 INFO:tasks.workunit.client.0.smithi110.stdout:8/852: write d5/da/d17/d60/fef [924117,121] 0 2024-04-22T00:06:07.962 INFO:tasks.workunit.client.0.smithi110.stdout:2/835: rmdir d9/d1a/d7b 39 2024-04-22T00:06:07.967 INFO:tasks.workunit.client.0.smithi110.stdout:1/756: dread d1/d2/d1b/d10/da2/fd8 [0,4194304] 0 2024-04-22T00:06:08.110 INFO:tasks.workunit.client.0.smithi110.stdout:8/853: sync 2024-04-22T00:06:08.492 INFO:tasks.workunit.client.0.smithi110.stdout:7/794: dread - d10/d45/d60/d5e/d65/d8a/deb/f116 zero size 2024-04-22T00:06:08.743 INFO:tasks.workunit.client.0.smithi110.stdout:5/788: mknod d7/d24/d3a/d40/ddc/ce3 0 2024-04-22T00:06:08.870 INFO:tasks.workunit.client.0.smithi110.stdout:2/836: unlink d9/d1a/d1d/d2b/d54/f84 0 2024-04-22T00:06:08.891 INFO:tasks.workunit.client.0.smithi110.stdout:0/790: write d0/d27/f4a [927676,48105] 0 2024-04-22T00:06:08.975 INFO:tasks.workunit.client.0.smithi110.stdout:1/757: creat d1/d2/d30/d8b/dc3/f105 x:0 0 0 2024-04-22T00:06:09.059 INFO:tasks.workunit.client.0.smithi110.stdout:4/720: mkdir d1/d35/d6b/df2/d20/d58/d102 0 2024-04-22T00:06:09.314 INFO:tasks.workunit.client.0.smithi110.stdout:8/854: unlink d5/da/d17/d6c/d7d/d114/d8c/f83 0 2024-04-22T00:06:09.793 INFO:tasks.workunit.client.0.smithi110.stdout:9/782: unlink d1/d29/d6f/db4/l3a 0 2024-04-22T00:06:10.003 INFO:tasks.workunit.client.0.smithi110.stdout:3/794: dwrite d6/d12/d14/f2e [4194304,4194304] 0 2024-04-22T00:06:10.144 INFO:tasks.workunit.client.0.smithi110.stdout:7/795: fdatasync d10/d45/d51/d88/d46/fdd 0 2024-04-22T00:06:10.302 INFO:tasks.workunit.client.0.smithi110.stdout:3/795: dread - d6/d12/d3c/d65/d91/fbf zero size 2024-04-22T00:06:10.407 INFO:tasks.workunit.client.0.smithi110.stdout:5/789: dread d7/d35/f47 [0,4194304] 0 2024-04-22T00:06:10.435 INFO:tasks.workunit.client.0.smithi110.stdout:1/758: mkdir d1/dd/d23/dcc/d106 0 2024-04-22T00:06:10.586 INFO:tasks.workunit.client.0.smithi110.stdout:5/790: sync 2024-04-22T00:06:10.896 INFO:tasks.workunit.client.0.smithi110.stdout:8/855: dread d5/da/d17/d6c/d95/fa6 [0,4194304] 0 2024-04-22T00:06:11.283 INFO:tasks.workunit.client.0.smithi110.stdout:9/783: dread - d1/d29/d2a/d2b/d58/fd8 zero size 2024-04-22T00:06:11.860 INFO:tasks.workunit.client.0.smithi110.stdout:1/759: read - d1/d2/d1b/fdb zero size 2024-04-22T00:06:12.022 INFO:tasks.workunit.client.0.smithi110.stdout:4/721: symlink d1/d35/d6b/df2/d12/de6/l103 0 2024-04-22T00:06:12.370 INFO:tasks.workunit.client.0.smithi110.stdout:5/791: mknod d7/d24/ce4 0 2024-04-22T00:06:12.786 INFO:tasks.workunit.client.0.smithi110.stdout:6/792: rmdir d16/d3d/d9a 0 2024-04-22T00:06:12.956 INFO:tasks.workunit.client.0.smithi110.stdout:6/793: sync 2024-04-22T00:06:13.499 INFO:tasks.workunit.client.0.smithi110.stdout:1/760: chown d1/l1c 597 1 2024-04-22T00:06:13.716 INFO:tasks.workunit.client.0.smithi110.stdout:5/792: symlink d7/d22/d5b/d68/le5 0 2024-04-22T00:06:13.755 INFO:tasks.workunit.client.0.smithi110.stdout:5/793: chown d7/d22/d5b/d68/cd2 3764465 1 2024-04-22T00:06:13.803 INFO:tasks.workunit.client.0.smithi110.stdout:8/856: creat d5/da/d17/d6c/d72/dc4/f123 x:0 0 0 2024-04-22T00:06:14.376 INFO:tasks.workunit.client.0.smithi110.stdout:0/791: dwrite d0/fa [0,4194304] 0 2024-04-22T00:06:14.619 INFO:tasks.workunit.client.0.smithi110.stdout:9/784: creat d1/d29/d6f/db4/d79/d98/fed x:0 0 0 2024-04-22T00:06:14.674 INFO:tasks.workunit.client.0.smithi110.stdout:6/794: rmdir d16/d3d/d97 39 2024-04-22T00:06:14.825 INFO:tasks.workunit.client.0.smithi110.stdout:2/837: getdents d9/d1a/d1d/d7a/d91/dac 0 2024-04-22T00:06:14.886 INFO:tasks.workunit.client.0.smithi110.stdout:2/838: dread - d9/d25/d1b/d45/d8e/fda zero size 2024-04-22T00:06:15.071 INFO:tasks.workunit.client.0.smithi110.stdout:1/761: mknod d1/dd/d23/d48/c107 0 2024-04-22T00:06:15.820 INFO:tasks.workunit.client.0.smithi110.stdout:0/792: creat d0/d16/d5d/dc5/f112 x:0 0 0 2024-04-22T00:06:15.877 INFO:tasks.workunit.client.0.smithi110.stdout:8/857: chown d5/da/d17/d6c/fb5 21446 1 2024-04-22T00:06:16.003 INFO:tasks.workunit.client.0.smithi110.stdout:0/793: sync 2024-04-22T00:06:16.115 INFO:tasks.workunit.client.0.smithi110.stdout:3/796: dwrite d6/d12/d3c/d8d/fe8 [0,4194304] 0 2024-04-22T00:06:16.323 INFO:tasks.workunit.client.0.smithi110.stdout:7/796: creat d10/d15/f117 x:0 0 0 2024-04-22T00:06:16.446 INFO:tasks.workunit.client.0.smithi110.stdout:1/762: read d1/dd/d23/f3d [1529790,91833] 0 2024-04-22T00:06:16.888 INFO:tasks.workunit.client.0.smithi110.stdout:4/722: rename d1/d35/d6b/df2/d20/d23/d1c/d40/f5a to d1/d35/d6b/df2/d20/d58/f104 0 2024-04-22T00:06:16.904 INFO:tasks.workunit.client.0.smithi110.stdout:5/794: symlink d7/d24/d49/le6 0 2024-04-22T00:06:17.335 INFO:tasks.workunit.client.0.smithi110.stdout:8/858: fdatasync d5/da/d17/d6c/d7d/f69 0 2024-04-22T00:06:17.446 INFO:tasks.workunit.client.0.smithi110.stdout:2/839: creat d9/d1a/d1d/db4/f119 x:0 0 0 2024-04-22T00:06:17.587 INFO:tasks.workunit.client.0.smithi110.stdout:0/794: truncate d0/d14/d23/d3b/fdd 361367 0 2024-04-22T00:06:17.736 INFO:tasks.workunit.client.0.smithi110.stdout:1/763: truncate d1/d1d/d57/fb8 479069 0 2024-04-22T00:06:18.146 INFO:tasks.workunit.client.0.smithi110.stdout:6/795: rename d16/d1d/d38/d48/d5e/fe7 to d16/d1d/d38/d48/d5e/d6a/db6/f108 0 2024-04-22T00:06:18.171 INFO:tasks.workunit.client.0.smithi110.stdout:5/795: symlink d7/d22/d5b/d68/le7 0 2024-04-22T00:06:18.253 INFO:tasks.workunit.client.0.smithi110.stdout:4/723: mkdir d1/d35/d6b/df2/d20/d23/d105 0 2024-04-22T00:06:18.286 INFO:tasks.workunit.client.0.smithi110.stdout:4/724: readlink d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/d7a/l9d 0 2024-04-22T00:06:18.816 INFO:tasks.workunit.client.0.smithi110.stdout:3/797: mknod d6/d12/da1/dea/d10e/c10f 0 2024-04-22T00:06:18.847 INFO:tasks.workunit.client.0.smithi110.stdout:9/785: dwrite d1/d29/d6f/f83 [0,4194304] 0 2024-04-22T00:06:19.058 INFO:tasks.workunit.client.0.smithi110.stdout:0/795: chown d0/d27/d4b/d7f/cd7 2077290 1 2024-04-22T00:06:19.089 INFO:tasks.workunit.client.0.smithi110.stdout:7/797: mkdir d10/d45/d60/d118 0 2024-04-22T00:06:19.223 INFO:tasks.workunit.client.0.smithi110.stdout:1/764: chown d1/d2/d1b/d10/d5c/d77/l9f 0 1 2024-04-22T00:06:19.249 INFO:tasks.workunit.client.0.smithi110.stdout:1/765: chown d1/d2/d1b/fc 437277477 1 2024-04-22T00:06:19.347 INFO:tasks.workunit.client.0.smithi110.stdout:6/796: creat d16/d1e/d24/d33/f109 x:0 0 0 2024-04-22T00:06:19.868 INFO:tasks.workunit.client.0.smithi110.stdout:2/840: unlink d9/d1a/d1d/d7a/c87 0 2024-04-22T00:06:20.065 INFO:tasks.workunit.client.0.smithi110.stdout:3/798: truncate d6/d12/d14/d4b/f63 3841957 0 2024-04-22T00:06:20.197 INFO:tasks.workunit.client.0.smithi110.stdout:0/796: truncate d0/d16/f26 2731598 0 2024-04-22T00:06:20.269 INFO:tasks.workunit.client.0.smithi110.stdout:9/786: dread d1/d29/d6f/db4/f92 [0,4194304] 0 2024-04-22T00:06:20.506 INFO:tasks.workunit.client.0.smithi110.stdout:1/766: unlink d1/d2/d1b/d10/d5c/dc5/d27/d3e/fcd 0 2024-04-22T00:06:20.528 INFO:tasks.workunit.client.0.smithi110.stdout:0/797: dread d0/d25/d5a/fc7 [0,4194304] 0 2024-04-22T00:06:21.372 INFO:tasks.workunit.client.0.smithi110.stdout:8/859: write d5/d4f/d79/dd1/fd6 [1710286,82370] 0 2024-04-22T00:06:23.305 INFO:tasks.workunit.client.0.smithi110.stdout:5/796: getdents d7/d24/d3a/da7 0 2024-04-22T00:06:23.327 INFO:tasks.workunit.client.0.smithi110.stdout:5/797: stat d7/d35/dd6 0 2024-04-22T00:06:23.375 INFO:tasks.workunit.client.0.smithi110.stdout:5/798: read d7/d22/d5b/d6f/fbf [2220460,116118] 0 2024-04-22T00:06:23.505 INFO:tasks.workunit.client.0.smithi110.stdout:6/797: creat d16/d1d/f10a x:0 0 0 2024-04-22T00:06:23.643 INFO:tasks.workunit.client.0.smithi110.stdout:4/725: link d1/d35/l3a d1/d35/d6b/df2/d20/d23/d1c/d40/l106 0 2024-04-22T00:06:23.863 INFO:tasks.workunit.client.0.smithi110.stdout:2/841: creat d9/f11a x:0 0 0 2024-04-22T00:06:23.895 INFO:tasks.workunit.client.0.smithi110.stdout:7/798: dwrite d10/d45/d51/db1/dc9/df5/d2c/f5d [0,4194304] 0 2024-04-22T00:06:23.901 INFO:tasks.workunit.client.0.smithi110.stdout:9/787: link d1/d29/d59/c86 d1/d29/d4d/dac/db8/cee 0 2024-04-22T00:06:24.056 INFO:tasks.workunit.client.0.smithi110.stdout:4/726: dread - d1/d35/d6b/df2/d20/d58/d7e/fa0 zero size 2024-04-22T00:06:24.087 INFO:tasks.workunit.client.0.smithi110.stdout:7/799: chown d10/c1c 364 1 2024-04-22T00:06:24.404 INFO:tasks.workunit.client.0.smithi110.stdout:6/798: mkdir d16/d3d/d40/d46/d10b 0 2024-04-22T00:06:24.440 INFO:tasks.workunit.client.0.smithi110.stdout:6/799: chown d16/d3d/d40/f9c 738662 1 2024-04-22T00:06:24.502 INFO:tasks.workunit.client.0.smithi110.stdout:3/799: write d6/d12/d14/d4b/fa0 [1872547,86949] 0 2024-04-22T00:06:24.692 INFO:tasks.workunit.client.0.smithi110.stdout:1/767: write d1/d2/d1b/f11 [2162490,9238] 0 2024-04-22T00:06:24.982 INFO:tasks.workunit.client.0.smithi110.stdout:4/727: mknod d1/d35/d6b/df2/d20/dbf/d5f/c107 0 2024-04-22T00:06:25.191 INFO:tasks.workunit.client.0.smithi110.stdout:0/798: dwrite d0/d14/f1c [4194304,4194304] 0 2024-04-22T00:06:25.446 INFO:tasks.workunit.client.0.smithi110.stdout:7/800: rename d10/d45/d51/db1/dc9/df5/d2c/faf to d10/d45/d51/d88/dce/f119 0 2024-04-22T00:06:25.461 INFO:tasks.workunit.client.0.smithi110.stdout:6/800: fsync d16/d1d/d38/d48/d5e/d6a/f9e 0 2024-04-22T00:06:25.687 INFO:tasks.workunit.client.0.smithi110.stdout:9/788: mknod d1/d29/d59/d99/deb/cef 0 2024-04-22T00:06:25.712 INFO:tasks.workunit.client.0.smithi110.stdout:9/789: readlink d1/d29/d4d/la7 0 2024-04-22T00:06:26.479 INFO:tasks.workunit.client.0.smithi110.stdout:4/728: dread d1/f8f [0,4194304] 0 2024-04-22T00:06:26.604 INFO:tasks.workunit.client.0.smithi110.stdout:0/799: dread - d0/d14/d23/d3b/ff6 zero size 2024-04-22T00:06:27.046 INFO:tasks.workunit.client.0.smithi110.stdout:7/801: symlink d10/d45/d51/db1/l11a 0 2024-04-22T00:06:27.258 INFO:tasks.workunit.client.0.smithi110.stdout:1/768: symlink d1/d2/d14/dfd/l108 0 2024-04-22T00:06:27.391 INFO:tasks.workunit.client.0.smithi110.stdout:9/790: truncate d1/d29/d2a/d2b/d58/d7b/f91 963304 0 2024-04-22T00:06:27.426 INFO:tasks.workunit.client.0.smithi110.stdout:5/799: getdents d7/d22 0 2024-04-22T00:06:27.530 INFO:tasks.workunit.client.0.smithi110.stdout:8/860: write d5/da/d17/d6c/d72/d73/f90 [342439,113274] 0 2024-04-22T00:06:27.694 INFO:tasks.workunit.client.0.smithi110.stdout:2/842: link d9/d25/d1b/d45/d50/l8f d9/d1a/d1d/d2b/d54/d77/l11b 0 2024-04-22T00:06:27.958 INFO:tasks.workunit.client.0.smithi110.stdout:4/729: rename d1/d35/d6b/df2/d20/d23/d1c/d40/l9f to d1/dbe/l108 0 2024-04-22T00:06:28.165 INFO:tasks.workunit.client.0.smithi110.stdout:2/843: dread d9/d25/f2f [0,4194304] 0 2024-04-22T00:06:28.832 INFO:tasks.workunit.client.0.smithi110.stdout:7/802: mkdir d10/d45/d60/d5e/d11b 0 2024-04-22T00:06:29.091 INFO:tasks.workunit.client.0.smithi110.stdout:5/800: creat d7/d22/d5b/d86/fe8 x:0 0 0 2024-04-22T00:06:29.155 INFO:tasks.workunit.client.0.smithi110.stdout:3/800: write d6/d12/d16/d6f/db5/f105 [628489,90947] 0 2024-04-22T00:06:29.501 INFO:tasks.workunit.client.0.smithi110.stdout:1/769: rename d1/d2/d1b/l61 to d1/d2/d1b/d10/d5c/daa/l109 0 2024-04-22T00:06:29.680 INFO:tasks.workunit.client.0.smithi110.stdout:2/844: creat d9/d25/d1b/d45/d8e/f11c x:0 0 0 2024-04-22T00:06:29.855 INFO:tasks.workunit.client.0.smithi110.stdout:1/770: dread d1/d2/d1b/f9 [0,4194304] 0 2024-04-22T00:06:30.382 INFO:tasks.workunit.client.0.smithi110.stdout:3/801: mkdir d6/d12/d16/d6f/db5/db9/dc6/d110 0 2024-04-22T00:06:30.649 INFO:tasks.workunit.client.0.smithi110.stdout:4/730: rename d1/d35/d6b/df2/d20/d58/d93/fbd to d1/d35/d6b/df2/d20/dbf/d5f/f109 0 2024-04-22T00:06:30.704 INFO:tasks.workunit.client.0.smithi110.stdout:4/731: chown d1/d35/d6b/df2/d20/d23/d1c/dae/lf8 524421188 1 2024-04-22T00:06:31.047 INFO:tasks.workunit.client.0.smithi110.stdout:7/803: mkdir d10/d45/d51/d88/d46/d11c 0 2024-04-22T00:06:31.065 INFO:tasks.workunit.client.0.smithi110.stdout:7/804: chown d10/c18 49253 1 2024-04-22T00:06:31.087 INFO:tasks.workunit.client.0.smithi110.stdout:1/771: fsync d1/d1d/f9e 0 2024-04-22T00:06:31.580 INFO:tasks.workunit.client.0.smithi110.stdout:9/791: creat d1/d29/d2a/d9d/ff0 x:0 0 0 2024-04-22T00:06:31.882 INFO:tasks.workunit.client.0.smithi110.stdout:3/802: creat d6/d12/d3c/d8d/f111 x:0 0 0 2024-04-22T00:06:31.907 INFO:tasks.workunit.client.0.smithi110.stdout:0/800: write d0/d16/d5d/fdf [381377,35341] 0 2024-04-22T00:06:31.913 INFO:tasks.workunit.client.0.smithi110.stdout:9/792: dwrite d1/d29/d2a/d9d/ff0 [0,4194304] 0 2024-04-22T00:06:32.272 INFO:tasks.workunit.client.0.smithi110.stdout:7/805: chown d10/d45/d60/l7b 111 1 2024-04-22T00:06:32.320 INFO:tasks.workunit.client.0.smithi110.stdout:1/772: rename d1/d2/d14/dfd to d1/d2/d1b/d10/d5c/daa/d10a 0 2024-04-22T00:06:32.480 INFO:tasks.workunit.client.0.smithi110.stdout:6/801: dwrite d16/d3d/d97/fa4 [0,4194304] 0 2024-04-22T00:06:32.617 INFO:tasks.workunit.client.0.smithi110.stdout:4/732: symlink d1/d35/d6b/df2/d20/df5/l10a 0 2024-04-22T00:06:33.031 INFO:tasks.workunit.client.0.smithi110.stdout:8/861: write d5/da/d17/d6c/d7d/d114/f97 [2232853,89165] 0 2024-04-22T00:06:33.161 INFO:tasks.workunit.client.0.smithi110.stdout:0/801: dread d0/d2a/fd1 [0,4194304] 0 2024-04-22T00:06:33.315 INFO:tasks.workunit.client.0.smithi110.stdout:1/773: rmdir d1/d2/d1b/d10/d5c/dc5/d27 39 2024-04-22T00:06:33.332 INFO:tasks.workunit.client.0.smithi110.stdout:7/806: mkdir d10/d45/d51/d88/d39/d7f/dd6/d11d 0 2024-04-22T00:06:33.376 INFO:tasks.workunit.client.0.smithi110.stdout:3/803: fdatasync d6/d12/d14/d4b/f63 0 2024-04-22T00:06:33.481 INFO:tasks.workunit.client.0.smithi110.stdout:4/733: creat d1/d35/d6b/df2/d20/d58/d93/d5e/f10b x:0 0 0 2024-04-22T00:06:33.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/802: truncate d16/d1e/d24/d33/faa 296478 0 2024-04-22T00:06:33.998 INFO:tasks.workunit.client.0.smithi110.stdout:5/801: write d7/d24/d49/d61/f75 [642824,82823] 0 2024-04-22T00:06:34.069 INFO:tasks.workunit.client.0.smithi110.stdout:0/802: mknod d0/d16/d5d/dc5/c113 0 2024-04-22T00:06:34.516 INFO:tasks.workunit.client.0.smithi110.stdout:1/774: mknod d1/d2/d14/d65/c10b 0 2024-04-22T00:06:34.647 INFO:tasks.workunit.client.0.smithi110.stdout:2/845: write d9/d1a/d1d/d2b/ff9 [549266,128483] 0 2024-04-22T00:06:34.720 INFO:tasks.workunit.client.0.smithi110.stdout:2/846: chown d9/d1a/d1d/d4a/l6f 178146 1 2024-04-22T00:06:34.748 INFO:tasks.workunit.client.0.smithi110.stdout:2/847: chown d9/d25/d1c/f28 113217044 1 2024-04-22T00:06:34.869 INFO:tasks.workunit.client.0.smithi110.stdout:6/803: truncate d16/d3d/d40/f5b 3955502 0 2024-04-22T00:06:35.473 INFO:tasks.workunit.client.0.smithi110.stdout:0/803: dread d0/d56/dc9/fea [0,4194304] 0 2024-04-22T00:06:35.612 INFO:tasks.workunit.client.0.smithi110.stdout:2/848: truncate d9/d1a/d1d/d4a/d78/f86 889409 0 2024-04-22T00:06:35.675 INFO:tasks.workunit.client.0.smithi110.stdout:6/804: chown d16/d1e/d24/d33/d85/ff0 29627 1 2024-04-22T00:06:35.844 INFO:tasks.workunit.client.0.smithi110.stdout:5/802: symlink d7/d9/le9 0 2024-04-22T00:06:36.058 INFO:tasks.workunit.client.0.smithi110.stdout:6/805: dread f4 [0,4194304] 0 2024-04-22T00:06:36.255 INFO:tasks.workunit.client.0.smithi110.stdout:7/807: truncate d10/d15/fc5 9895098 0 2024-04-22T00:06:36.281 INFO:tasks.workunit.client.0.smithi110.stdout:1/775: read d1/d2/d1b/d10/d5c/dc5/d27/fbf [6862681,114419] 0 2024-04-22T00:06:36.342 INFO:tasks.workunit.client.0.smithi110.stdout:1/776: stat d1/d2/d1b/d10/da2 0 2024-04-22T00:06:36.381 INFO:tasks.workunit.client.0.smithi110.stdout:0/804: mkdir d0/d27/d4b/da0/da4/d114 0 2024-04-22T00:06:36.411 INFO:tasks.workunit.client.0.smithi110.stdout:2/849: read d9/d1a/d1d/d2b/d54/d77/f99 [2473336,55834] 0 2024-04-22T00:06:36.466 INFO:tasks.workunit.client.0.smithi110.stdout:9/793: write d1/d29/d6f/db4/d79/d98/fed [725137,93592] 0 2024-04-22T00:06:36.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/808: creat d10/d45/d51/db1/dee/df0/f11e x:0 0 0 2024-04-22T00:06:37.145 INFO:tasks.workunit.client.0.smithi110.stdout:1/777: mknod d1/d1d/d57/c10c 0 2024-04-22T00:06:37.215 INFO:tasks.workunit.client.0.smithi110.stdout:0/805: creat d0/d25/d5a/d63/f115 x:0 0 0 2024-04-22T00:06:37.455 INFO:tasks.workunit.client.0.smithi110.stdout:9/794: creat d1/d29/d2a/d6/ff1 x:0 0 0 2024-04-22T00:06:37.885 INFO:tasks.workunit.client.0.smithi110.stdout:7/809: symlink d10/d45/d51/db1/dc9/df5/d2c/l11f 0 2024-04-22T00:06:37.966 INFO:tasks.workunit.client.0.smithi110.stdout:8/862: dwrite d5/d6f/dca/f11e [0,4194304] 0 2024-04-22T00:06:38.449 INFO:tasks.workunit.client.0.smithi110.stdout:2/850: truncate d9/d25/d1b/d45/d4d/f74 1070832 0 2024-04-22T00:06:38.547 INFO:tasks.workunit.client.0.smithi110.stdout:5/803: link d7/d22/d5b/d6f/c79 d7/d24/d37/d38/cea 0 2024-04-22T00:06:38.686 INFO:tasks.workunit.client.0.smithi110.stdout:0/806: rename d0/d14/d23/f9e to d0/d16/d42/d50/dbc/dc8/f116 0 2024-04-22T00:06:38.819 INFO:tasks.workunit.client.0.smithi110.stdout:1/778: dread d1/dd/d23/d48/d4e/fb2 [0,4194304] 0 2024-04-22T00:06:39.088 INFO:tasks.workunit.client.0.smithi110.stdout:0/807: chown d0/d2a/lef 2441 1 2024-04-22T00:06:39.117 INFO:tasks.workunit.client.0.smithi110.stdout:6/806: link d16/d3d/ff8 d16/d1d/d38/d48/d5e/d6a/db6/f10c 0 2024-04-22T00:06:39.301 INFO:tasks.workunit.client.0.smithi110.stdout:3/804: dwrite d6/d78/fc5 [0,4194304] 0 2024-04-22T00:06:39.472 INFO:tasks.workunit.client.0.smithi110.stdout:4/734: dwrite d1/f8f [0,4194304] 0 2024-04-22T00:06:39.601 INFO:tasks.workunit.client.0.smithi110.stdout:0/808: chown d0/d25/d5a/d63/f77 375524 1 2024-04-22T00:06:39.613 INFO:tasks.workunit.client.0.smithi110.stdout:2/851: fdatasync d9/d25/d1b/d45/f80 0 2024-04-22T00:06:39.676 INFO:tasks.workunit.client.0.smithi110.stdout:6/807: dread d16/d3d/d97/dd0/fb0 [0,4194304] 0 2024-04-22T00:06:39.712 INFO:tasks.workunit.client.0.smithi110.stdout:5/804: mkdir d7/d35/dc0/deb 0 2024-04-22T00:06:39.725 INFO:tasks.workunit.client.0.smithi110.stdout:3/805: sync 2024-04-22T00:06:40.720 INFO:tasks.workunit.client.0.smithi110.stdout:4/735: symlink d1/d35/d6b/df2/d20/dbf/d5f/dc0/l10c 0 2024-04-22T00:06:40.764 INFO:tasks.workunit.client.0.smithi110.stdout:4/736: chown d1/d35/d6b/df2/d20/d23/c16 32175 1 2024-04-22T00:06:40.969 INFO:tasks.workunit.client.0.smithi110.stdout:2/852: creat d9/d1a/d1d/d4e/dc0/f11d x:0 0 0 2024-04-22T00:06:41.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/806: mkdir d6/d12/da1/dc8/d112 0 2024-04-22T00:06:41.314 INFO:tasks.workunit.client.0.smithi110.stdout:1/779: symlink d1/dd/d23/d9a/l10d 0 2024-04-22T00:06:41.860 INFO:tasks.workunit.client.0.smithi110.stdout:6/808: symlink d16/d3d/d97/da9/l10d 0 2024-04-22T00:06:42.483 INFO:tasks.workunit.client.0.smithi110.stdout:1/780: rename d1/d2/d1b/d10/f5f to d1/d2/d1b/d10/d5c/dc5/d27/d3e/f10e 0 2024-04-22T00:06:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:1/781: chown d1/d2/d14/d65/d8a 432069999 1 2024-04-22T00:06:42.609 INFO:tasks.workunit.client.0.smithi110.stdout:6/809: creat d16/d1d/d38/d48/d5e/d62/f10e x:0 0 0 2024-04-22T00:06:42.699 INFO:tasks.workunit.client.0.smithi110.stdout:1/782: dread d1/dd/d23/f3d [0,4194304] 0 2024-04-22T00:06:42.800 INFO:tasks.workunit.client.0.smithi110.stdout:2/853: mknod d9/d1a/d1d/d7a/d110/c11e 0 2024-04-22T00:06:42.823 INFO:tasks.workunit.client.0.smithi110.stdout:3/807: fsync d6/d12/d16/ff3 0 2024-04-22T00:06:42.885 INFO:tasks.workunit.client.0.smithi110.stdout:3/808: readlink d6/d12/d14/d4b/la9 0 2024-04-22T00:06:43.252 INFO:tasks.workunit.client.0.smithi110.stdout:9/795: write d1/d29/d6f/f83 [4444938,35281] 0 2024-04-22T00:06:43.323 INFO:tasks.workunit.client.0.smithi110.stdout:6/810: fsync d16/d3d/d97/fa0 0 2024-04-22T00:06:43.884 INFO:tasks.workunit.client.0.smithi110.stdout:7/810: write d10/d27/f82 [1155178,66251] 0 2024-04-22T00:06:44.199 INFO:tasks.workunit.client.0.smithi110.stdout:8/863: dwrite d5/d24/d33/d3d/f64 [0,4194304] 0 2024-04-22T00:06:44.449 INFO:tasks.workunit.client.0.smithi110.stdout:6/811: symlink d16/d1d/d38/d8e/l10f 0 2024-04-22T00:06:44.459 INFO:tasks.workunit.client.0.smithi110.stdout:6/812: readlink l2 0 2024-04-22T00:06:44.531 INFO:tasks.workunit.client.0.smithi110.stdout:4/737: link d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/ca7 d1/d35/d6b/df2/d20/d58/d93/d5e/c10d 0 2024-04-22T00:06:44.539 INFO:tasks.workunit.client.0.smithi110.stdout:2/854: unlink d9/d1a/d1d/d2b/d5b/l101 0 2024-04-22T00:06:44.846 INFO:tasks.workunit.client.0.smithi110.stdout:6/813: dread d16/d3d/f30 [0,4194304] 0 2024-04-22T00:06:44.932 INFO:tasks.workunit.client.0.smithi110.stdout:6/814: chown d16/d1e/l8f 1436 1 2024-04-22T00:06:45.260 INFO:tasks.workunit.client.0.smithi110.stdout:7/811: rmdir d10/d15/d95/d10a 39 2024-04-22T00:06:45.418 INFO:tasks.workunit.client.0.smithi110.stdout:2/855: rename d9/d25/d1c/da0 to d9/d25/d1b/d11f 0 2024-04-22T00:06:45.769 INFO:tasks.workunit.client.0.smithi110.stdout:0/809: write d0/d27/d68/fd5 [1166562,1710] 0 2024-04-22T00:06:45.819 INFO:tasks.workunit.client.0.smithi110.stdout:0/810: read - d0/d27/d4b/da0/fb2 zero size 2024-04-22T00:06:46.019 INFO:tasks.workunit.client.0.smithi110.stdout:2/856: mkdir d9/d1a/d1d/d4e/db5/d120 0 2024-04-22T00:06:46.219 INFO:tasks.workunit.client.0.smithi110.stdout:8/864: rename d5/d24/d33/f96 to d5/d24/d33/f124 0 2024-04-22T00:06:46.446 INFO:tasks.workunit.client.0.smithi110.stdout:7/812: mkdir d10/d45/d60/d5e/d11b/d120 0 2024-04-22T00:06:46.634 INFO:tasks.workunit.client.0.smithi110.stdout:5/805: dwrite d7/d24/d3a/da7/fbc [0,4194304] 0 2024-04-22T00:06:46.753 INFO:tasks.workunit.client.0.smithi110.stdout:4/738: rename d1/d35/l85 to d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/l10e 0 2024-04-22T00:06:46.797 INFO:tasks.workunit.client.0.smithi110.stdout:2/857: symlink d9/d1a/d1d/d4e/l121 0 2024-04-22T00:06:46.865 INFO:tasks.workunit.client.0.smithi110.stdout:4/739: stat d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/l87 0 2024-04-22T00:06:47.186 INFO:tasks.workunit.client.0.smithi110.stdout:7/813: unlink d10/d45/d51/db1/dc9/df5/fcf 0 2024-04-22T00:06:47.618 INFO:tasks.workunit.client.0.smithi110.stdout:6/815: rename d16/d3d/d97/da9/dd9 to d16/d1d/d38/d48/d5e/d6a/d70/d86/d110 0 2024-04-22T00:06:47.676 INFO:tasks.workunit.client.0.smithi110.stdout:6/816: chown d16/d1e/d24/d7b 1316 1 2024-04-22T00:06:47.828 INFO:tasks.workunit.client.0.smithi110.stdout:4/740: fdatasync d1/d35/d6b/df2/d12/f19 0 2024-04-22T00:06:47.901 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:14:28.161 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:47.909 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:14:28.169 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:47.946 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:14:28.142 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:47.947 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:14:28.142 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:47.956 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:14:28.152 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:47.957 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:14:28.153 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:48.053 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:14:28.313 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:48.098 INFO:tasks.workunit.client.0.smithi110.stdout:7/814: rmdir d10/d45/d51/db1/dee 39 2024-04-22T00:06:48.129 INFO:tasks.workunit.client.0.smithi110.stdout:5/806: mknod d7/d24/d49/cec 0 2024-04-22T00:06:48.135 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:14:28.331 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:48.170 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:14:28.365 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:06:48.334 INFO:tasks.workunit.client.0.smithi110.stdout:7/815: sync 2024-04-22T00:06:48.741 INFO:tasks.workunit.client.0.smithi110.stdout:8/865: rename d5/d24/d33/d3d/d82/ce8 to d5/da/d17/d60/c125 0 2024-04-22T00:06:49.299 INFO:tasks.workunit.client.0.smithi110.stdout:5/807: creat d7/d24/d49/d61/fed x:0 0 0 2024-04-22T00:06:49.580 INFO:tasks.workunit.client.0.smithi110.stdout:3/809: write d6/d12/d14/d4b/f5b [5198703,28996] 0 2024-04-22T00:06:49.617 INFO:tasks.workunit.client.0.smithi110.stdout:0/811: link d0/d27/d68/d7d/l7e d0/d16/d5d/dc5/l117 0 2024-04-22T00:06:49.821 INFO:tasks.workunit.client.0.smithi110.stdout:7/816: dread d10/d15/f2e [0,4194304] 0 2024-04-22T00:06:50.137 INFO:tasks.workunit.client.0.smithi110.stdout:5/808: fsync d7/d24/d3a/f82 0 2024-04-22T00:06:50.400 INFO:tasks.workunit.client.0.smithi110.stdout:0/812: unlink d0/d27/d4b/da0/db1/fe8 0 2024-04-22T00:06:50.426 INFO:tasks.workunit.client.0.smithi110.stdout:9/796: write d1/d19/fb5 [561650,91155] 0 2024-04-22T00:06:50.733 INFO:tasks.workunit.client.0.smithi110.stdout:5/809: mknod d7/d9/d17/d48/cee 0 2024-04-22T00:06:51.155 INFO:tasks.workunit.client.0.smithi110.stdout:0/813: creat d0/d56/d10f/f118 x:0 0 0 2024-04-22T00:06:51.164 INFO:tasks.workunit.client.0.smithi110.stdout:9/797: creat d1/d29/d2a/d3c/ff2 x:0 0 0 2024-04-22T00:06:51.253 INFO:tasks.workunit.client.0.smithi110.stdout:9/798: dread - d1/d29/d6f/db4/fdf zero size 2024-04-22T00:06:51.329 INFO:tasks.workunit.client.0.smithi110.stdout:9/799: readlink d1/d29/d2a/dc/l28 0 2024-04-22T00:06:51.333 INFO:tasks.workunit.client.0.smithi110.stdout:5/810: dread d7/d9/d17/fc1 [0,4194304] 0 2024-04-22T00:06:51.427 INFO:tasks.workunit.client.0.smithi110.stdout:5/811: truncate d7/d24/d49/d61/fed 129897 0 2024-04-22T00:06:51.454 INFO:tasks.workunit.client.0.smithi110.stdout:5/812: chown d7/d24/d37/f87 861763674 1 2024-04-22T00:06:51.920 INFO:tasks.workunit.client.0.smithi110.stdout:2/858: dwrite d9/d1a/d1d/d2b/d54/f70 [4194304,4194304] 0 2024-04-22T00:06:52.463 INFO:tasks.workunit.client.0.smithi110.stdout:9/800: dread d1/d29/d2a/d6/f27 [0,4194304] 0 2024-04-22T00:06:52.502 INFO:tasks.workunit.client.0.smithi110.stdout:6/817: write d16/d1e/d24/d90/dac/fd8 [232257,40198] 0 2024-04-22T00:06:52.576 INFO:tasks.workunit.client.0.smithi110.stdout:9/801: dread - d1/d29/d2a/d2b/d58/fc6 zero size 2024-04-22T00:06:52.609 INFO:tasks.workunit.client.0.smithi110.stdout:9/802: stat d1/f15 0 2024-04-22T00:06:52.623 INFO:tasks.workunit.client.0.smithi110.stdout:6/818: dread - d16/d1d/d38/d48/d5e/d62/fd7 zero size 2024-04-22T00:06:52.690 INFO:tasks.workunit.client.0.smithi110.stdout:2/859: creat d9/d1a/d1d/d2b/d5b/f122 x:0 0 0 2024-04-22T00:06:53.071 INFO:tasks.workunit.client.0.smithi110.stdout:1/783: dwrite d1/d2/d1b/d10/d5c/dc5/d27/d3e/f10e [8388608,4194304] 0 2024-04-22T00:06:53.933 INFO:tasks.workunit.client.0.smithi110.stdout:8/866: dwrite d5/d24/d33/d3d/d82/da8/f10f [0,4194304] 0 2024-04-22T00:06:54.008 INFO:tasks.workunit.client.0.smithi110.stdout:4/741: dwrite d1/d35/d6b/df2/d20/d58/d93/d5e/f9a [0,4194304] 0 2024-04-22T00:06:54.162 INFO:tasks.workunit.client.0.smithi110.stdout:7/817: dwrite d10/d45/d51/d88/d46/d69/d75/f107 [0,4194304] 0 2024-04-22T00:06:54.185 INFO:tasks.workunit.client.0.smithi110.stdout:6/819: creat d16/d1e/d24/d7b/f111 x:0 0 0 2024-04-22T00:06:54.337 INFO:tasks.workunit.client.0.smithi110.stdout:1/784: mkdir d1/d2/d14/d10f 0 2024-04-22T00:06:54.464 INFO:tasks.workunit.client.0.smithi110.stdout:8/867: dread d5/d24/d33/d3d/d5c/d6a/fd5 [0,4194304] 0 2024-04-22T00:06:54.621 INFO:tasks.workunit.client.0.smithi110.stdout:0/814: link d0/f41 d0/d56/f119 0 2024-04-22T00:06:54.844 INFO:tasks.workunit.client.0.smithi110.stdout:6/820: truncate d16/d1e/fc7 899209 0 2024-04-22T00:06:54.897 INFO:tasks.workunit.client.0.smithi110.stdout:2/860: rmdir d9/d1a/d1d/d7a 39 2024-04-22T00:06:54.909 INFO:tasks.workunit.client.0.smithi110.stdout:6/821: dread d16/d1d/f25 [0,4194304] 0 2024-04-22T00:06:55.070 INFO:tasks.workunit.client.0.smithi110.stdout:7/818: dread d10/d45/d51/db1/dc9/df5/d2c/fb6 [0,4194304] 0 2024-04-22T00:06:55.470 INFO:tasks.workunit.client.0.smithi110.stdout:8/868: dread d5/d24/f2f [4194304,4194304] 0 2024-04-22T00:06:55.593 INFO:tasks.workunit.client.0.smithi110.stdout:3/810: unlink d6/c11 0 2024-04-22T00:06:55.844 INFO:tasks.workunit.client.0.smithi110.stdout:1/785: link d1/d2/d1b/d10/d5c/dc5/l58 d1/dd/d23/dcc/l110 0 2024-04-22T00:06:56.391 INFO:tasks.workunit.client.0.smithi110.stdout:3/811: mknod d6/d12/d3c/d8d/dee/c113 0 2024-04-22T00:06:56.542 INFO:tasks.workunit.client.0.smithi110.stdout:1/786: symlink d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/l111 0 2024-04-22T00:06:56.680 INFO:tasks.workunit.client.0.smithi110.stdout:3/812: sync 2024-04-22T00:06:56.716 INFO:tasks.workunit.client.0.smithi110.stdout:0/815: getdents d0/d27/d4b/da0 0 2024-04-22T00:06:56.734 INFO:tasks.workunit.client.0.smithi110.stdout:1/787: sync 2024-04-22T00:06:56.759 INFO:tasks.workunit.client.0.smithi110.stdout:9/803: write d1/d29/d2a/d9d/ff0 [3735704,79054] 0 2024-04-22T00:06:57.187 INFO:tasks.workunit.client.0.smithi110.stdout:7/819: getdents d10/d45/d60/d5e/d65/d8a/deb 0 2024-04-22T00:06:57.378 INFO:tasks.workunit.client.0.smithi110.stdout:0/816: fdatasync d0/d25/d5a/d63/f115 0 2024-04-22T00:06:57.507 INFO:tasks.workunit.client.0.smithi110.stdout:4/742: rmdir d1 39 2024-04-22T00:06:57.638 INFO:tasks.workunit.client.0.smithi110.stdout:1/788: unlink d1/d2/d1b/d10/d5c/d77/d78/f9b 0 2024-04-22T00:06:57.997 INFO:tasks.workunit.client.0.smithi110.stdout:5/813: creat d7/d24/fef x:0 0 0 2024-04-22T00:06:58.140 INFO:tasks.workunit.client.0.smithi110.stdout:0/817: mkdir d0/d27/d68/d7d/d11a 0 2024-04-22T00:06:59.025 INFO:tasks.workunit.client.0.smithi110.stdout:5/814: fsync d7/d35/f8a 0 2024-04-22T00:06:59.032 INFO:tasks.workunit.client.0.smithi110.stdout:2/861: write d9/f49 [3037533,109349] 0 2024-04-22T00:06:59.141 INFO:tasks.workunit.client.0.smithi110.stdout:0/818: truncate d0/d27/d4b/d7f/faf 1445622 0 2024-04-22T00:06:59.250 INFO:tasks.workunit.client.0.smithi110.stdout:6/822: dwrite d16/d1e/d24/d33/f109 [0,4194304] 0 2024-04-22T00:06:59.278 INFO:tasks.workunit.client.0.smithi110.stdout:8/869: write d5/d74/fd3 [381637,94097] 0 2024-04-22T00:06:59.944 INFO:tasks.workunit.client.0.smithi110.stdout:5/815: mknod d7/d9/d17/cf0 0 2024-04-22T00:07:00.045 INFO:tasks.workunit.client.0.smithi110.stdout:9/804: getdents d1/d29/d2a/d2b/d58/da8 0 2024-04-22T00:07:00.066 INFO:tasks.workunit.client.0.smithi110.stdout:9/805: chown d1/fea 217024 1 2024-04-22T00:07:00.150 INFO:tasks.workunit.client.0.smithi110.stdout:4/743: creat d1/d35/d6b/dec/f10f x:0 0 0 2024-04-22T00:07:00.595 INFO:tasks.workunit.client.0.smithi110.stdout:6/823: symlink d16/d3d/d40/d46/l112 0 2024-04-22T00:07:01.034 INFO:tasks.workunit.client.0.smithi110.stdout:3/813: dwrite d6/d12/d16/d30/dc7/fdc [0,4194304] 0 2024-04-22T00:07:01.150 INFO:tasks.workunit.client.0.smithi110.stdout:7/820: write d10/d45/d51/db1/dc9/df5/d2c/fbf [1433901,72064] 0 2024-04-22T00:07:01.195 INFO:tasks.workunit.client.0.smithi110.stdout:5/816: truncate d7/d24/d3a/d40/f9a 923698 0 2024-04-22T00:07:02.102 INFO:tasks.workunit.client.0.smithi110.stdout:8/870: creat d5/d24/d33/d3d/d5c/d6a/d102/f126 x:0 0 0 2024-04-22T00:07:02.322 INFO:tasks.workunit.client.0.smithi110.stdout:1/789: write d1/dd/d23/d48/d4e/d86/fc4 [293178,14243] 0 2024-04-22T00:07:02.495 INFO:tasks.workunit.client.0.smithi110.stdout:3/814: truncate d6/d12/d16/d30/d9c/f101 866769 0 2024-04-22T00:07:02.762 INFO:tasks.workunit.client.0.smithi110.stdout:2/862: rename d9/d25/d1b/d45/d50/d94 to d9/d1a/d123 0 2024-04-22T00:07:03.092 INFO:tasks.workunit.client.0.smithi110.stdout:8/871: fsync d5/da/d17/d7c/dc0/fec 0 2024-04-22T00:07:03.132 INFO:tasks.workunit.client.0.smithi110.stdout:8/872: chown d5/da/d17/f85 67 1 2024-04-22T00:07:03.263 INFO:tasks.workunit.client.0.smithi110.stdout:1/790: chown d1/dd/d23/dcc/l110 273 1 2024-04-22T00:07:03.642 INFO:tasks.workunit.client.0.smithi110.stdout:0/819: write d0/d16/d42/d50/dbc/dc8/fe2 [429037,72361] 0 2024-04-22T00:07:04.195 INFO:tasks.workunit.client.0.smithi110.stdout:1/791: truncate d1/d2/d1b/f13 4230999 0 2024-04-22T00:07:04.484 INFO:tasks.workunit.client.0.smithi110.stdout:2/863: symlink d9/d1a/d1d/d2b/d5b/d107/l124 0 2024-04-22T00:07:04.696 INFO:tasks.workunit.client.0.smithi110.stdout:8/873: getdents d5/d121 0 2024-04-22T00:07:05.299 INFO:tasks.workunit.client.0.smithi110.stdout:9/806: dwrite d1/d29/f2e [4194304,4194304] 0 2024-04-22T00:07:05.436 INFO:tasks.workunit.client.0.smithi110.stdout:8/874: unlink d5/da/d17/ff4 0 2024-04-22T00:07:05.586 INFO:tasks.workunit.client.0.smithi110.stdout:4/744: dwrite d1/d35/d6b/df2/d20/d58/d93/d7c/fa5 [4194304,4194304] 0 2024-04-22T00:07:06.012 INFO:tasks.workunit.client.0.smithi110.stdout:7/821: write d10/d45/d51/d88/d46/f86 [947216,123168] 0 2024-04-22T00:07:06.058 INFO:tasks.workunit.client.0.smithi110.stdout:5/817: write d7/d24/d49/d61/fbe [462365,86898] 0 2024-04-22T00:07:06.141 INFO:tasks.workunit.client.0.smithi110.stdout:9/807: rename d1/d29/d2a/dc/fd to d1/d29/d4d/dac/dbf/dda/ff3 0 2024-04-22T00:07:06.297 INFO:tasks.workunit.client.0.smithi110.stdout:4/745: mknod d1/d35/d6b/df2/d20/d23/d1c/dae/c110 0 2024-04-22T00:07:07.014 INFO:tasks.workunit.client.0.smithi110.stdout:7/822: creat d10/d45/d60/d5e/d65/da3/f121 x:0 0 0 2024-04-22T00:07:07.197 INFO:tasks.workunit.client.0.smithi110.stdout:2/864: link d9/d1a/d1d/d2b/l90 d9/d1a/d1d/d2b/d5b/d112/l125 0 2024-04-22T00:07:07.335 INFO:tasks.workunit.client.0.smithi110.stdout:3/815: dwrite d6/d12/d14/d4b/f9d [0,4194304] 0 2024-04-22T00:07:07.483 INFO:tasks.workunit.client.0.smithi110.stdout:3/816: readlink d6/d12/d3c/d8d/l9e 0 2024-04-22T00:07:08.364 INFO:tasks.workunit.client.0.smithi110.stdout:0/820: write d0/d56/f97 [975535,4854] 0 2024-04-22T00:07:08.561 INFO:tasks.workunit.client.0.smithi110.stdout:8/875: write d5/da/d17/d6c/d7d/d114/d8c/fb2 [533290,130803] 0 2024-04-22T00:07:08.732 INFO:tasks.workunit.client.0.smithi110.stdout:3/817: dread d6/d12/d14/f60 [0,4194304] 0 2024-04-22T00:07:08.783 INFO:tasks.workunit.client.0.smithi110.stdout:8/876: dread - d5/d74/fcb zero size 2024-04-22T00:07:08.977 INFO:tasks.workunit.client.0.smithi110.stdout:1/792: dwrite d1/dd/d23/fe1 [0,4194304] 0 2024-04-22T00:07:09.280 INFO:tasks.workunit.client.0.smithi110.stdout:4/746: link d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/d7a/fea d1/d35/df6/f111 0 2024-04-22T00:07:09.789 INFO:tasks.workunit.client.0.smithi110.stdout:2/865: truncate d9/d25/d1b/d45/d50/dc8/fcd 1016860 0 2024-04-22T00:07:10.078 INFO:tasks.workunit.client.0.smithi110.stdout:9/808: dwrite d1/d19/f32 [0,4194304] 0 2024-04-22T00:07:10.251 INFO:tasks.workunit.client.0.smithi110.stdout:1/793: truncate d1/d2/d30/db9/fce 285761 0 2024-04-22T00:07:10.607 INFO:tasks.workunit.client.0.smithi110.stdout:8/877: creat d5/d24/d33/d3d/d82/da8/f127 x:0 0 0 2024-04-22T00:07:10.607 INFO:tasks.workunit.client.0.smithi110.stdout:5/818: dwrite d7/d24/d3a/d40/f9a [0,4194304] 0 2024-04-22T00:07:10.607 INFO:tasks.workunit.client.0.smithi110.stdout:6/824: creat d16/f113 x:0 0 0 2024-04-22T00:07:10.610 INFO:tasks.workunit.client.0.smithi110.stdout:7/823: write d10/d45/d51/db1/dc9/df5/d2c/fd9 [2684468,99817] 0 2024-04-22T00:07:10.746 INFO:tasks.workunit.client.0.smithi110.stdout:3/818: truncate d6/d12/f29 657344 0 2024-04-22T00:07:10.998 INFO:tasks.workunit.client.0.smithi110.stdout:5/819: chown d7/d9/d17/f2c 170169276 1 2024-04-22T00:07:11.070 INFO:tasks.workunit.client.0.smithi110.stdout:5/820: chown d7/d24/d37/d38/fa1 1061 1 2024-04-22T00:07:11.088 INFO:tasks.workunit.client.0.smithi110.stdout:5/821: chown d7/d24/d49 0 1 2024-04-22T00:07:11.149 INFO:tasks.workunit.client.0.smithi110.stdout:7/824: dread - d10/d45/d51/d88/dce/f119 zero size 2024-04-22T00:07:11.634 INFO:tasks.workunit.client.0.smithi110.stdout:5/822: rmdir d7/d9/d17/d48/d69 39 2024-04-22T00:07:12.089 INFO:tasks.workunit.client.0.smithi110.stdout:5/823: symlink d7/d22/d5b/da5/lf1 0 2024-04-22T00:07:12.211 INFO:tasks.workunit.client.0.smithi110.stdout:9/809: creat d1/d52/ff4 x:0 0 0 2024-04-22T00:07:12.297 INFO:tasks.workunit.client.0.smithi110.stdout:7/825: creat d10/d45/d51/d88/d46/d11c/f122 x:0 0 0 2024-04-22T00:07:12.470 INFO:tasks.workunit.client.0.smithi110.stdout:0/821: write d0/d16/d5d/dc5/fca [4846474,12990] 0 2024-04-22T00:07:12.845 INFO:tasks.workunit.client.0.smithi110.stdout:2/866: write d9/d1a/d1d/d7a/f111 [97749,22680] 0 2024-04-22T00:07:13.071 INFO:tasks.workunit.client.0.smithi110.stdout:7/826: truncate d10/d45/d51/d88/d46/d69/d75/f10f 726498 0 2024-04-22T00:07:13.436 INFO:tasks.workunit.client.0.smithi110.stdout:4/747: dwrite d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8/ffb [0,4194304] 0 2024-04-22T00:07:13.570 INFO:tasks.workunit.client.0.smithi110.stdout:3/819: dwrite d6/d12/d14/f53 [0,4194304] 0 2024-04-22T00:07:13.703 INFO:tasks.workunit.client.0.smithi110.stdout:0/822: mkdir d0/d27/d68/d7d/d11a/d11b 0 2024-04-22T00:07:13.733 INFO:tasks.workunit.client.0.smithi110.stdout:7/827: chown d10/d45/d51/db1/dc9/df5/d2c/f5d 0 1 2024-04-22T00:07:15.871 INFO:tasks.workunit.client.0.smithi110.stdout:8/878: rename d5/d24 to d5/da/d17/d7c/d128 0 2024-04-22T00:07:16.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/879: chown d5/d6f/f89 637070079 1 2024-04-22T00:07:16.195 INFO:tasks.workunit.client.0.smithi110.stdout:2/867: dwrite d9/d1a/f1e [0,4194304] 0 2024-04-22T00:07:16.212 INFO:tasks.workunit.client.0.smithi110.stdout:7/828: write d10/d45/d51/d88/d46/d69/d75/fed [784122,61445] 0 2024-04-22T00:07:16.236 INFO:tasks.workunit.client.0.smithi110.stdout:3/820: write d6/d12/d3c/d65/f10c [1521889,23546] 0 2024-04-22T00:07:16.392 INFO:tasks.workunit.client.0.smithi110.stdout:1/794: rename d1/d2/d1b/d10/da2 to d1/dd/d23/d48/d112 0 2024-04-22T00:07:16.521 INFO:tasks.workunit.client.0.smithi110.stdout:3/821: chown d6/d12/d14/c15 34 1 2024-04-22T00:07:16.588 INFO:tasks.workunit.client.0.smithi110.stdout:0/823: dwrite d0/d27/d4b/f54 [0,4194304] 0 2024-04-22T00:07:16.650 INFO:tasks.workunit.client.0.smithi110.stdout:7/829: sync 2024-04-22T00:07:16.989 INFO:tasks.workunit.client.0.smithi110.stdout:8/880: dread - d5/da/d17/d7c/dc0/f120 zero size 2024-04-22T00:07:17.150 INFO:tasks.workunit.client.0.smithi110.stdout:2/868: dread d9/d25/d1b/d45/d4d/fe1 [0,4194304] 0 2024-04-22T00:07:17.608 INFO:tasks.workunit.client.0.smithi110.stdout:3/822: creat d6/d12/d16/f114 x:0 0 0 2024-04-22T00:07:17.622 INFO:tasks.workunit.client.0.smithi110.stdout:0/824: truncate d0/d2a/fdc 208657 0 2024-04-22T00:07:17.716 INFO:tasks.workunit.client.0.smithi110.stdout:0/825: dread - d0/d16/d42/d50/dbc/ffd zero size 2024-04-22T00:07:17.757 INFO:tasks.workunit.client.0.smithi110.stdout:0/826: chown d0/d16/d5d/dc5 95155810 1 2024-04-22T00:07:17.942 INFO:tasks.workunit.client.0.smithi110.stdout:2/869: read - d9/d1a/d1d/db4/f119 zero size 2024-04-22T00:07:18.229 INFO:tasks.workunit.client.0.smithi110.stdout:6/825: rename d16/d1e/d24/f2c to d16/f114 0 2024-04-22T00:07:18.435 INFO:tasks.workunit.client.0.smithi110.stdout:3/823: creat d6/d12/da1/dea/f115 x:0 0 0 2024-04-22T00:07:18.590 INFO:tasks.workunit.client.0.smithi110.stdout:0/827: rmdir d0/d2a 39 2024-04-22T00:07:18.599 INFO:tasks.workunit.client.0.smithi110.stdout:3/824: sync 2024-04-22T00:07:18.815 INFO:tasks.workunit.client.0.smithi110.stdout:7/830: dwrite d10/d45/d51/d88/f8e [4194304,4194304] 0 2024-04-22T00:07:18.884 INFO:tasks.workunit.client.0.smithi110.stdout:7/831: sync 2024-04-22T00:07:18.923 INFO:tasks.workunit.client.0.smithi110.stdout:1/795: link d1/dd/d23/dcc/l8f d1/d1d/d70/l113 0 2024-04-22T00:07:18.945 INFO:tasks.workunit.client.0.smithi110.stdout:8/881: write d5/f2a [4453902,114394] 0 2024-04-22T00:07:19.391 INFO:tasks.workunit.client.0.smithi110.stdout:5/824: rename d7/d22/d5b/d6f/c97 to d7/d24/d3a/da7/cf2 0 2024-04-22T00:07:19.501 INFO:tasks.workunit.client.0.smithi110.stdout:6/826: mknod d16/d1e/d24/d90/dac/c115 0 2024-04-22T00:07:19.764 INFO:tasks.workunit.client.0.smithi110.stdout:3/825: mkdir d6/d12/d3c/d65/d91/d116 0 2024-04-22T00:07:20.128 INFO:tasks.workunit.client.0.smithi110.stdout:1/796: chown d1/d2/d1b/d10/d5c/d77/d78/c7d 0 1 2024-04-22T00:07:20.315 INFO:tasks.workunit.client.0.smithi110.stdout:7/832: write d10/d45/d51/d88/d46/d11c/f122 [777938,5460] 0 2024-04-22T00:07:20.872 INFO:tasks.workunit.client.0.smithi110.stdout:9/810: rename d1/d29/d4d/c50 to d1/d29/d2a/d6/cf5 0 2024-04-22T00:07:21.279 INFO:tasks.workunit.client.0.smithi110.stdout:2/870: rename d9/d25/d1b/d45/d10b to d9/d25/d1b/d45/d126 0 2024-04-22T00:07:21.622 INFO:tasks.workunit.client.0.smithi110.stdout:3/826: dread d6/d12/d50/f66 [0,4194304] 0 2024-04-22T00:07:21.689 INFO:tasks.workunit.client.0.smithi110.stdout:4/748: rename d1/d35/d6b/df2/d12/l84 to d1/d35/d6b/df2/d20/dc4/l112 0 2024-04-22T00:07:22.039 INFO:tasks.workunit.client.0.smithi110.stdout:2/871: fsync d9/d1a/f1e 0 2024-04-22T00:07:22.198 INFO:tasks.workunit.client.0.smithi110.stdout:3/827: stat d6/d12/d3c/d8d/dee/ffd 0 2024-04-22T00:07:22.404 INFO:tasks.workunit.client.0.smithi110.stdout:0/828: dwrite d0/d16/fa6 [0,4194304] 0 2024-04-22T00:07:22.538 INFO:tasks.workunit.client.0.smithi110.stdout:5/825: rename d7/d9/d17/f18 to d7/d22/d5b/d86/ff3 0 2024-04-22T00:07:22.555 INFO:tasks.workunit.client.0.smithi110.stdout:9/811: fsync d1/d29/d2a/d2b/d57/d97/dad/fe9 0 2024-04-22T00:07:22.596 INFO:tasks.workunit.client.0.smithi110.stdout:3/828: dread d6/d12/f1a [0,4194304] 0 2024-04-22T00:07:22.617 INFO:tasks.workunit.client.0.smithi110.stdout:0/829: readlink d0/d56/da3/lb0 0 2024-04-22T00:07:22.994 INFO:tasks.workunit.client.0.smithi110.stdout:2/872: dread d9/d25/de5/ffd [0,4194304] 0 2024-04-22T00:07:23.027 INFO:tasks.workunit.client.0.smithi110.stdout:2/873: chown d9/d1a/d1d/d4e/dc0 1 1 2024-04-22T00:07:24.508 INFO:tasks.workunit.client.0.smithi110.stdout:4/749: creat d1/d35/d6b/df2/d20/d23/d1c/d47/f113 x:0 0 0 2024-04-22T00:07:24.685 INFO:tasks.workunit.client.0.smithi110.stdout:8/882: rmdir d5 39 2024-04-22T00:07:24.699 INFO:tasks.workunit.client.0.smithi110.stdout:5/826: truncate d7/d24/d31/fe1 80232 0 2024-04-22T00:07:24.735 INFO:tasks.workunit.client.0.smithi110.stdout:5/827: readlink d7/d22/d5b/d68/le5 0 2024-04-22T00:07:25.056 INFO:tasks.workunit.client.0.smithi110.stdout:1/797: dwrite d1/d1d/d57/f81 [0,4194304] 0 2024-04-22T00:07:25.484 INFO:tasks.workunit.client.0.smithi110.stdout:7/833: mknod d10/d45/d51/c123 0 2024-04-22T00:07:25.801 INFO:tasks.workunit.client.0.smithi110.stdout:5/828: creat d7/d24/d49/d61/ff4 x:0 0 0 2024-04-22T00:07:25.824 INFO:tasks.workunit.client.0.smithi110.stdout:5/829: stat d7/d35/dd6 0 2024-04-22T00:07:25.918 INFO:tasks.workunit.client.0.smithi110.stdout:2/874: creat d9/d1a/d1d/d4a/f127 x:0 0 0 2024-04-22T00:07:25.953 INFO:tasks.workunit.client.0.smithi110.stdout:9/812: write d1/d29/d6f/f83 [5002519,90282] 0 2024-04-22T00:07:26.027 INFO:tasks.workunit.client.0.smithi110.stdout:9/813: readlink d1/d29/d2a/d6/d1d/l1e 0 2024-04-22T00:07:26.097 INFO:tasks.workunit.client.0.smithi110.stdout:1/798: fsync d1/dd/d23/f3d 0 2024-04-22T00:07:26.148 INFO:tasks.workunit.client.0.smithi110.stdout:0/830: write d0/d16/d42/d50/f89 [954849,75223] 0 2024-04-22T00:07:26.409 INFO:tasks.workunit.client.0.smithi110.stdout:7/834: symlink d10/d43/l124 0 2024-04-22T00:07:26.579 INFO:tasks.workunit.client.0.smithi110.stdout:6/827: rename d16/d1e/d24/d7b/ceb to d16/d3d/c116 0 2024-04-22T00:07:26.601 INFO:tasks.workunit.client.0.smithi110.stdout:5/830: mkdir d7/d35/dc0/df5 0 2024-04-22T00:07:26.648 INFO:tasks.workunit.client.0.smithi110.stdout:9/814: mkdir d1/d29/d2a/d2b/d57/df6 0 2024-04-22T00:07:26.690 INFO:tasks.workunit.client.0.smithi110.stdout:1/799: dread - d1/d2/d1b/d10/d5c/d77/d78/ffb zero size 2024-04-22T00:07:26.919 INFO:tasks.workunit.client.0.smithi110.stdout:0/831: dread d0/d16/d42/fbd [0,4194304] 0 2024-04-22T00:07:27.327 INFO:tasks.workunit.client.0.smithi110.stdout:8/883: dread d5/da/d17/d7c/d128/d33/d3d/d82/fd9 [0,4194304] 0 2024-04-22T00:07:27.554 INFO:tasks.workunit.client.0.smithi110.stdout:3/829: dwrite d6/d12/d16/d6f/fad [0,4194304] 0 2024-04-22T00:07:27.712 INFO:tasks.workunit.client.0.smithi110.stdout:6/828: truncate d16/d1d/f10a 852262 0 2024-04-22T00:07:28.136 INFO:tasks.workunit.client.0.smithi110.stdout:0/832: dread d0/d14/d23/fc2 [0,4194304] 0 2024-04-22T00:07:28.295 INFO:tasks.workunit.client.0.smithi110.stdout:3/830: mkdir d6/d12/d3c/d65/dfc/d117 0 2024-04-22T00:07:28.388 INFO:tasks.workunit.client.0.smithi110.stdout:2/875: getdents d9/d25/d1b/d45/d4d 0 2024-04-22T00:07:28.640 INFO:tasks.workunit.client.0.smithi110.stdout:4/750: rename d1/d35/d6b/df2/d20/dbf/d5f/dc0/l10c to d1/d35/d6b/df2/d20/l114 0 2024-04-22T00:07:28.730 INFO:tasks.workunit.client.0.smithi110.stdout:5/831: creat d7/d9/ff6 x:0 0 0 2024-04-22T00:07:29.010 INFO:tasks.workunit.client.0.smithi110.stdout:7/835: getdents d10/d45/d51/d88/d39/d7f 0 2024-04-22T00:07:29.069 INFO:tasks.workunit.client.0.smithi110.stdout:7/836: chown d10/d45/d51/d88/d39/d7f/d80/d53/l9d 105748397 1 2024-04-22T00:07:29.106 INFO:tasks.workunit.client.0.smithi110.stdout:7/837: dread - d10/d45/d51/d58/ff6 zero size 2024-04-22T00:07:29.172 INFO:tasks.workunit.client.0.smithi110.stdout:0/833: rmdir d0/d27 39 2024-04-22T00:07:29.186 INFO:tasks.workunit.client.0.smithi110.stdout:3/831: fsync d6/d12/d3c/d65/d91/fbf 0 2024-04-22T00:07:29.587 INFO:tasks.workunit.client.0.smithi110.stdout:2/876: truncate d9/d1a/d1d/d2b/ff9 1331111 0 2024-04-22T00:07:29.712 INFO:tasks.workunit.client.0.smithi110.stdout:9/815: write d1/d29/d6f/db4/fc9 [3866630,82745] 0 2024-04-22T00:07:30.004 INFO:tasks.workunit.client.0.smithi110.stdout:4/751: dread - d1/d35/d6b/df2/d20/d58/d93/d5e/f10b zero size 2024-04-22T00:07:30.123 INFO:tasks.workunit.client.0.smithi110.stdout:5/832: mkdir d7/d24/d3a/d40/df7 0 2024-04-22T00:07:30.267 INFO:tasks.workunit.client.0.smithi110.stdout:7/838: mknod d10/d45/c125 0 2024-04-22T00:07:30.294 INFO:tasks.workunit.client.0.smithi110.stdout:1/800: dwrite d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/ffe [0,4194304] 0 2024-04-22T00:07:30.844 INFO:tasks.workunit.client.0.smithi110.stdout:3/832: rename d6/d78/fc5 to d6/d12/d50/d10b/f118 0 2024-04-22T00:07:30.874 INFO:tasks.workunit.client.0.smithi110.stdout:6/829: write d16/d1e/d24/d66/f6e [545758,83090] 0 2024-04-22T00:07:31.149 INFO:tasks.workunit.client.0.smithi110.stdout:8/884: link d5/da/d17/d6c/fad d5/da/d17/d7c/d128/d33/d3d/dfd/de6/f129 0 2024-04-22T00:07:31.362 INFO:tasks.workunit.client.0.smithi110.stdout:4/752: mkdir d1/d35/d6b/df2/d20/dbf/d5f/dc0/d115 0 2024-04-22T00:07:31.615 INFO:tasks.workunit.client.0.smithi110.stdout:4/753: sync 2024-04-22T00:07:32.480 INFO:tasks.workunit.client.0.smithi110.stdout:6/830: mknod d16/d3d/d40/d46/c117 0 2024-04-22T00:07:32.484 INFO:tasks.workunit.client.0.smithi110.stdout:3/833: readlink d6/d78/lcc 0 2024-04-22T00:07:32.733 INFO:tasks.workunit.client.0.smithi110.stdout:8/885: read d5/d4f/f76 [3752929,31244] 0 2024-04-22T00:07:33.118 INFO:tasks.workunit.client.0.smithi110.stdout:0/834: dwrite d0/d25/d5a/d63/fd4 [0,4194304] 0 2024-04-22T00:07:33.783 INFO:tasks.workunit.client.0.smithi110.stdout:2/877: dwrite d9/d25/d1b/d11f/ff2 [0,4194304] 0 2024-04-22T00:07:33.911 INFO:tasks.workunit.client.0.smithi110.stdout:3/834: symlink d6/d12/d3c/l119 0 2024-04-22T00:07:34.149 INFO:tasks.workunit.client.0.smithi110.stdout:9/816: link d1/d29/d2a/d6/d1d/f89 d1/d29/d2a/d9d/de0/ff7 0 2024-04-22T00:07:34.169 INFO:tasks.workunit.client.0.smithi110.stdout:5/833: write d7/d24/d37/d38/d88/f8b [393608,85813] 0 2024-04-22T00:07:34.214 INFO:tasks.workunit.client.0.smithi110.stdout:7/839: write d10/d15/d95/f108 [716135,19992] 0 2024-04-22T00:07:34.303 INFO:tasks.workunit.client.0.smithi110.stdout:1/801: dwrite d1/f26 [0,4194304] 0 2024-04-22T00:07:34.631 INFO:tasks.workunit.client.0.smithi110.stdout:6/831: symlink d16/d1d/d38/dfe/l118 0 2024-04-22T00:07:34.801 INFO:tasks.workunit.client.0.smithi110.stdout:8/886: mknod d5/c12a 0 2024-04-22T00:07:34.828 INFO:tasks.workunit.client.0.smithi110.stdout:8/887: readlink d5/da/d17/d60/l67 0 2024-04-22T00:07:35.333 INFO:tasks.workunit.client.0.smithi110.stdout:7/840: truncate d10/d43/f10e 1682337 0 2024-04-22T00:07:35.660 INFO:tasks.workunit.client.0.smithi110.stdout:1/802: creat d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/f114 x:0 0 0 2024-04-22T00:07:35.683 INFO:tasks.workunit.client.0.smithi110.stdout:6/832: rename d16/d3d/d97/fdb to d16/d1d/d38/dab/f119 0 2024-04-22T00:07:35.785 INFO:tasks.workunit.client.0.smithi110.stdout:1/803: dread - d1/d2/d1b/d10/d5c/d77/d78/deb/fc8 zero size 2024-04-22T00:07:36.119 INFO:tasks.workunit.client.0.smithi110.stdout:4/754: dwrite d1/d35/d6b/df2/d20/d58/d93/fd3 [0,4194304] 0 2024-04-22T00:07:36.692 INFO:tasks.workunit.client.0.smithi110.stdout:8/888: rename d5/da/d88/fe1 to d5/da/d17/d7c/d128/d33/d3d/d82/de3/f12b 0 2024-04-22T00:07:36.697 INFO:tasks.workunit.client.0.smithi110.stdout:6/833: truncate d16/d3d/f81 3715347 0 2024-04-22T00:07:36.718 INFO:tasks.workunit.client.0.smithi110.stdout:7/841: rename d10 to d10/d45/d60/d5e/d11b/d120/d126 22 2024-04-22T00:07:36.754 INFO:tasks.workunit.client.0.smithi110.stdout:0/835: link d0/d14/d23/d3b/f67 d0/d16/d42/d50/f11c 0 2024-04-22T00:07:37.050 INFO:tasks.workunit.client.0.smithi110.stdout:2/878: link d9/d1a/d1d/d7a/ccf d9/d1a/d1d/d2b/d5b/c128 0 2024-04-22T00:07:37.192 INFO:tasks.workunit.client.0.smithi110.stdout:3/835: dread - d6/d12/d3c/d65/d91/fbf zero size 2024-04-22T00:07:37.277 INFO:tasks.workunit.client.0.smithi110.stdout:9/817: write d1/d29/d2a/d6/fc4 [839732,20917] 0 2024-04-22T00:07:38.297 INFO:tasks.workunit.client.0.smithi110.stdout:2/879: truncate d9/d25/d1b/d45/d50/d68/da4/f93 2863 0 2024-04-22T00:07:38.450 INFO:tasks.workunit.client.0.smithi110.stdout:5/834: getdents d7/d22/d5b/d6f 0 2024-04-22T00:07:38.800 INFO:tasks.workunit.client.0.smithi110.stdout:9/818: dread d1/d29/f34 [0,4194304] 0 2024-04-22T00:07:39.619 INFO:tasks.workunit.client.0.smithi110.stdout:3/836: mknod d6/d12/d16/d6f/db5/db9/dc6/d10d/c11a 0 2024-04-22T00:07:39.619 INFO:tasks.workunit.client.0.smithi110.stdout:5/835: creat d7/d22/d5b/d6f/ff8 x:0 0 0 2024-04-22T00:07:39.943 INFO:tasks.workunit.client.0.smithi110.stdout:1/804: write d1/dd/d23/d48/d4e/d86/fc4 [49021,87546] 0 2024-04-22T00:07:40.130 INFO:tasks.workunit.client.0.smithi110.stdout:4/755: link d1/d35/d6b/df2/d20/dbf/f38 d1/d35/d6b/df2/d20/d58/d7e/f116 0 2024-04-22T00:07:40.183 INFO:tasks.workunit.client.0.smithi110.stdout:4/756: chown d1/d35/d6b/df2/d20/d23/d1c/d47 26118726 1 2024-04-22T00:07:40.311 INFO:tasks.workunit.client.0.smithi110.stdout:7/842: mkdir d10/d45/d51/db1/dee/df0/df9/d127 0 2024-04-22T00:07:40.769 INFO:tasks.workunit.client.0.smithi110.stdout:8/889: write d5/da/d17/d60/fc1 [1168807,74911] 0 2024-04-22T00:07:41.492 INFO:tasks.workunit.client.0.smithi110.stdout:4/757: symlink d1/d35/d6b/df2/d12/l117 0 2024-04-22T00:07:41.916 INFO:tasks.workunit.client.0.smithi110.stdout:0/836: dwrite d0/f21 [0,4194304] 0 2024-04-22T00:07:42.322 INFO:tasks.workunit.client.0.smithi110.stdout:9/819: creat d1/d29/d2a/ff8 x:0 0 0 2024-04-22T00:07:42.370 INFO:tasks.workunit.client.0.smithi110.stdout:6/834: write d16/d3d/f81 [3716336,37011] 0 2024-04-22T00:07:42.474 INFO:tasks.workunit.client.0.smithi110.stdout:7/843: rename d10/d45/d51/d88/d39/l61 to d10/d45/d60/d5e/d65/da3/l128 0 2024-04-22T00:07:42.921 INFO:tasks.workunit.client.0.smithi110.stdout:4/758: symlink d1/d35/d6b/df2/d20/dbf/d5f/dc0/d115/l118 0 2024-04-22T00:07:43.188 INFO:tasks.workunit.client.0.smithi110.stdout:2/880: write d9/d1a/d7b/fc3 [822125,67796] 0 2024-04-22T00:07:43.289 INFO:tasks.workunit.client.0.smithi110.stdout:5/836: write d7/d9/f33 [800896,86983] 0 2024-04-22T00:07:43.365 INFO:tasks.workunit.client.0.smithi110.stdout:3/837: write d6/d12/d50/f64 [295562,43684] 0 2024-04-22T00:07:43.370 INFO:tasks.workunit.client.0.smithi110.stdout:5/837: stat d7/d22/d5b/d86/cc7 0 2024-04-22T00:07:44.175 INFO:tasks.workunit.client.0.smithi110.stdout:2/881: dread d9/d1a/d1d/d4a/d6b/d3a/f41 [0,4194304] 0 2024-04-22T00:07:44.195 INFO:tasks.workunit.client.0.smithi110.stdout:3/838: fdatasync d6/f19 0 2024-04-22T00:07:44.504 INFO:tasks.workunit.client.0.smithi110.stdout:1/805: dwrite d1/dd/d23/d48/fa8 [4194304,4194304] 0 2024-04-22T00:07:44.525 INFO:tasks.workunit.client.0.smithi110.stdout:8/890: getdents d5/da/d17/d7c/d128/d33/d3d 0 2024-04-22T00:07:44.663 INFO:tasks.workunit.client.0.smithi110.stdout:6/835: creat d16/d1e/f11a x:0 0 0 2024-04-22T00:07:45.007 INFO:tasks.workunit.client.0.smithi110.stdout:6/836: sync 2024-04-22T00:07:45.244 INFO:tasks.workunit.client.0.smithi110.stdout:0/837: getdents d0/d16 0 2024-04-22T00:07:45.690 INFO:tasks.workunit.client.0.smithi110.stdout:2/882: fdatasync d9/d1a/d1d/d4e/db5/fdb 0 2024-04-22T00:07:45.738 INFO:tasks.workunit.client.0.smithi110.stdout:2/883: dread - d9/d1a/d1d/d2b/d5b/f7c zero size 2024-04-22T00:07:45.841 INFO:tasks.workunit.client.0.smithi110.stdout:8/891: rmdir d5/da/d17/d7c/d128/d33/d3d 39 2024-04-22T00:07:46.123 INFO:tasks.workunit.client.0.smithi110.stdout:6/837: fsync d16/d1d/d38/f4f 0 2024-04-22T00:07:46.252 INFO:tasks.workunit.client.0.smithi110.stdout:9/820: dwrite d1/d29/d2a/d6/d1d/f24 [0,4194304] 0 2024-04-22T00:07:46.388 INFO:tasks.workunit.client.0.smithi110.stdout:6/838: dread - d16/d1d/d38/d48/d5e/d62/f7c zero size 2024-04-22T00:07:46.412 INFO:tasks.workunit.client.0.smithi110.stdout:5/838: unlink d7/d9/d17/d48/d69/d6d/f74 0 2024-04-22T00:07:46.450 INFO:tasks.workunit.client.0.smithi110.stdout:4/759: write d1/d35/d6b/df2/d20/dbf/f30 [1790645,100153] 0 2024-04-22T00:07:46.506 INFO:tasks.workunit.client.0.smithi110.stdout:7/844: write d10/d15/f117 [143387,68318] 0 2024-04-22T00:07:46.549 INFO:tasks.workunit.client.0.smithi110.stdout:2/884: read - d9/d25/d1c/fe6 zero size 2024-04-22T00:07:46.943 INFO:tasks.workunit.client.0.smithi110.stdout:8/892: unlink d5/da/d17/c15 0 2024-04-22T00:07:47.323 INFO:tasks.workunit.client.0.smithi110.stdout:9/821: symlink d1/d29/d4d/dac/dbf/dda/lf9 0 2024-04-22T00:07:47.415 INFO:tasks.workunit.client.0.smithi110.stdout:9/822: sync 2024-04-22T00:07:47.614 INFO:tasks.workunit.client.0.smithi110.stdout:6/839: mknod d16/d1d/d38/d8e/c11b 0 2024-04-22T00:07:47.873 INFO:tasks.workunit.client.0.smithi110.stdout:2/885: fdatasync d9/d1a/d1d/d2b/d5b/f79 0 2024-04-22T00:07:47.873 INFO:tasks.workunit.client.0.smithi110.stdout:1/806: creat d1/f115 x:0 0 0 2024-04-22T00:07:47.946 INFO:tasks.workunit.client.0.smithi110.stdout:4/760: truncate d1/d35/d6b/df2/fda 54921 0 2024-04-22T00:07:48.107 INFO:tasks.workunit.client.0.smithi110.stdout:7/845: rename d10/d45/d51/db1/dc9/df5/f73 to d10/d45/d60/d5e/d65/da3/f129 0 2024-04-22T00:07:48.583 INFO:tasks.workunit.client.0.smithi110.stdout:3/839: dwrite d6/d12/d16/d30/fb7 [0,4194304] 0 2024-04-22T00:07:48.720 INFO:tasks.workunit.client.0.smithi110.stdout:0/838: write d0/d16/d42/d50/dbc/dc8/fe2 [423944,77370] 0 2024-04-22T00:07:49.018 INFO:tasks.workunit.client.0.smithi110.stdout:9/823: dread d1/d29/d2a/d2b/d58/d7b/fcf [0,4194304] 0 2024-04-22T00:07:49.035 INFO:tasks.workunit.client.0.smithi110.stdout:2/886: mkdir d9/d1a/d1d/d7a/d91/d129 0 2024-04-22T00:07:49.127 INFO:tasks.workunit.client.0.smithi110.stdout:2/887: stat d9/d1a/d1d/d2b/d5b/dd2/de7/c118 0 2024-04-22T00:07:49.317 INFO:tasks.workunit.client.0.smithi110.stdout:7/846: read f6 [111248,1568] 0 2024-04-22T00:07:49.355 INFO:tasks.workunit.client.0.smithi110.stdout:7/847: chown d10/d45/d60/la4 43 1 2024-04-22T00:07:49.464 INFO:tasks.workunit.client.0.smithi110.stdout:8/893: mknod d5/da/d17/d6c/d7d/d114/d8c/d104/c12c 0 2024-04-22T00:07:49.852 INFO:tasks.workunit.client.0.smithi110.stdout:1/807: creat d1/d2/d14/d10f/f116 x:0 0 0 2024-04-22T00:07:50.023 INFO:tasks.workunit.client.0.smithi110.stdout:1/808: sync 2024-04-22T00:07:50.598 INFO:tasks.workunit.client.0.smithi110.stdout:9/824: unlink d1/d29/d2a/d9d/ff0 0 2024-04-22T00:07:50.656 INFO:tasks.workunit.client.0.smithi110.stdout:9/825: dread d1/d29/f34 [0,4194304] 0 2024-04-22T00:07:50.881 INFO:tasks.workunit.client.0.smithi110.stdout:7/848: rename d10/d45/d60/d5e/d65/da3/fb5 to d10/d45/d51/d88/d46/d69/d75/f12a 0 2024-04-22T00:07:50.971 INFO:tasks.workunit.client.0.smithi110.stdout:5/839: dwrite d7/d35/dc0/fe2 [0,4194304] 0 2024-04-22T00:07:51.091 INFO:tasks.workunit.client.0.smithi110.stdout:5/840: chown d7/c85 211685478 1 2024-04-22T00:07:51.176 INFO:tasks.workunit.client.0.smithi110.stdout:5/841: chown d7/d24/cab 172 1 2024-04-22T00:07:51.356 INFO:tasks.workunit.client.0.smithi110.stdout:1/809: mkdir d1/dd/d23/d48/d4e/ddc/d117 0 2024-04-22T00:07:51.450 INFO:tasks.workunit.client.0.smithi110.stdout:8/894: dread d5/f54 [0,4194304] 0 2024-04-22T00:07:51.650 INFO:tasks.workunit.client.0.smithi110.stdout:3/840: mkdir d6/d12/da1/dc8/d112/d11b 0 2024-04-22T00:07:51.959 INFO:tasks.workunit.client.0.smithi110.stdout:9/826: fdatasync d1/d29/d59/f88 0 2024-04-22T00:07:52.238 INFO:tasks.workunit.client.0.smithi110.stdout:6/840: dwrite d16/fc3 [0,4194304] 0 2024-04-22T00:07:52.241 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:15:32.500 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.243 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:15:32.503 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.324 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:15:32.519 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.334 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:15:32.530 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.342 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:15:32.602 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.358 INFO:tasks.workunit.client.0.smithi110.stdout:7/849: mknod d10/d45/d51/d88/d39/d7f/d80/d53/c12b 0 2024-04-22T00:07:52.362 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:15:32.558 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.365 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:15:32.560 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.396 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:15:32.591 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.422 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:15:32.617 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:07:52.677 INFO:tasks.workunit.client.0.smithi110.stdout:4/761: write d1/d35/d6b/df2/d20/dbf/db5/fdb [456239,74826] 0 2024-04-22T00:07:52.766 INFO:tasks.workunit.client.0.smithi110.stdout:3/841: creat d6/d12/d16/d6f/db5/dd3/f11c x:0 0 0 2024-04-22T00:07:52.815 INFO:tasks.workunit.client.0.smithi110.stdout:2/888: link d9/d1a/d7b/lba d9/d25/d1b/d45/d8e/dd5/l12a 0 2024-04-22T00:07:53.133 INFO:tasks.workunit.client.0.smithi110.stdout:7/850: creat d10/d45/d60/d5e/d65/d8a/deb/f12c x:0 0 0 2024-04-22T00:07:53.208 INFO:tasks.workunit.client.0.smithi110.stdout:4/762: chown d1/d35/d6b/df2/d20/d23/d1c/d47/d95/fbb 1 1 2024-04-22T00:07:53.271 INFO:tasks.workunit.client.0.smithi110.stdout:7/851: dread - d10/d45/d51/d88/f7c zero size 2024-04-22T00:07:53.458 INFO:tasks.workunit.client.0.smithi110.stdout:6/841: getdents d16/d3d/d40/d46/d10b 0 2024-04-22T00:07:53.542 INFO:tasks.workunit.client.0.smithi110.stdout:0/839: write d0/d25/fa5 [956591,19853] 0 2024-04-22T00:07:53.640 INFO:tasks.workunit.client.0.smithi110.stdout:6/842: sync 2024-04-22T00:07:53.674 INFO:tasks.workunit.client.0.smithi110.stdout:6/843: read d16/d3d/f30 [2556647,101810] 0 2024-04-22T00:07:53.990 INFO:tasks.workunit.client.0.smithi110.stdout:4/763: dread f0 [4194304,4194304] 0 2024-04-22T00:07:54.262 INFO:tasks.workunit.client.0.smithi110.stdout:9/827: creat d1/d52/d76/ffa x:0 0 0 2024-04-22T00:07:54.359 INFO:tasks.workunit.client.0.smithi110.stdout:0/840: creat d0/d27/d4b/d7f/dc1/f11d x:0 0 0 2024-04-22T00:07:55.547 INFO:tasks.workunit.client.0.smithi110.stdout:1/810: write d1/d2/d1b/fdb [631072,129703] 0 2024-04-22T00:07:55.756 INFO:tasks.workunit.client.0.smithi110.stdout:9/828: rmdir d1/d29/d4d/dac/dbf/dda 39 2024-04-22T00:07:55.876 INFO:tasks.workunit.client.0.smithi110.stdout:8/895: dwrite d5/da/d17/d7c/d128/f2c [0,4194304] 0 2024-04-22T00:07:56.304 INFO:tasks.workunit.client.0.smithi110.stdout:3/842: write d6/d12/d16/d30/d9c/f97 [3449093,33724] 0 2024-04-22T00:07:56.475 INFO:tasks.workunit.client.0.smithi110.stdout:0/841: dread d0/fc [0,4194304] 0 2024-04-22T00:07:56.710 INFO:tasks.workunit.client.0.smithi110.stdout:6/844: creat d16/d3d/d97/f11c x:0 0 0 2024-04-22T00:07:56.739 INFO:tasks.workunit.client.0.smithi110.stdout:1/811: truncate d1/dd/d23/dcc/f32 8177564 0 2024-04-22T00:07:56.806 INFO:tasks.workunit.client.0.smithi110.stdout:3/843: chown d6/d12/d14/d32/c108 16038399 1 2024-04-22T00:07:56.829 INFO:tasks.workunit.client.0.smithi110.stdout:7/852: getdents d10/d45/d51/d88/d39 0 2024-04-22T00:07:56.938 INFO:tasks.workunit.client.0.smithi110.stdout:9/829: unlink d1/d29/d2a/d2b/d57/d97/dad/fe9 0 2024-04-22T00:07:57.228 INFO:tasks.workunit.client.0.smithi110.stdout:2/889: dwrite d9/d1a/d1d/d2b/ff9 [0,4194304] 0 2024-04-22T00:07:57.291 INFO:tasks.workunit.client.0.smithi110.stdout:5/842: dwrite d7/d24/d31/fe1 [0,4194304] 0 2024-04-22T00:07:57.684 INFO:tasks.workunit.client.0.smithi110.stdout:4/764: dwrite d1/d35/d6b/df2/d20/d23/d1c/d47/d95/fbb [0,4194304] 0 2024-04-22T00:07:58.486 INFO:tasks.workunit.client.0.smithi110.stdout:8/896: creat d5/d4f/f12d x:0 0 0 2024-04-22T00:07:58.610 INFO:tasks.workunit.client.0.smithi110.stdout:7/853: creat d10/d45/d51/d88/dce/f12d x:0 0 0 2024-04-22T00:07:58.678 INFO:tasks.workunit.client.0.smithi110.stdout:1/812: symlink d1/dd/d23/d48/d4e/ddc/l118 0 2024-04-22T00:07:58.845 INFO:tasks.workunit.client.0.smithi110.stdout:3/844: creat d6/d12/d3c/d8d/dee/f11d x:0 0 0 2024-04-22T00:07:58.992 INFO:tasks.workunit.client.0.smithi110.stdout:2/890: mkdir d9/d25/d1b/d45/d8e/dd5/d12b 0 2024-04-22T00:07:59.150 INFO:tasks.workunit.client.0.smithi110.stdout:5/843: rename d7/d24/d37/ccd to d7/d22/d5b/d86/cf9 0 2024-04-22T00:07:59.424 INFO:tasks.workunit.client.0.smithi110.stdout:4/765: creat d1/d35/d6b/df2/d20/dc4/f119 x:0 0 0 2024-04-22T00:07:59.729 INFO:tasks.workunit.client.0.smithi110.stdout:6/845: dwrite d16/d1e/da8/fc0 [0,4194304] 0 2024-04-22T00:07:59.933 INFO:tasks.workunit.client.0.smithi110.stdout:9/830: mknod d1/d29/d2a/d9d/cfb 0 2024-04-22T00:08:00.610 INFO:tasks.workunit.client.0.smithi110.stdout:5/844: read - d7/d22/d5b/d86/fe8 zero size 2024-04-22T00:08:00.620 INFO:tasks.workunit.client.0.smithi110.stdout:2/891: dread - d9/d1a/d1d/d2b/ffa zero size 2024-04-22T00:08:00.685 INFO:tasks.workunit.client.0.smithi110.stdout:0/842: getdents d0/d56/dc9 0 2024-04-22T00:08:01.064 INFO:tasks.workunit.client.0.smithi110.stdout:6/846: dread d16/d1d/d38/d8e/fd6 [0,4194304] 0 2024-04-22T00:08:01.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/845: symlink d6/d12/d3c/d65/d91/d116/l11e 0 2024-04-22T00:08:01.841 INFO:tasks.workunit.client.0.smithi110.stdout:2/892: chown d9/c105 7628215 1 2024-04-22T00:08:02.220 INFO:tasks.workunit.client.0.smithi110.stdout:5/845: dread d7/d35/f7b [4194304,4194304] 0 2024-04-22T00:08:02.355 INFO:tasks.workunit.client.0.smithi110.stdout:0/843: rename d0/d27/d68/fd5 to d0/d27/d4b/da0/f11e 0 2024-04-22T00:08:02.482 INFO:tasks.workunit.client.0.smithi110.stdout:5/846: sync 2024-04-22T00:08:02.570 INFO:tasks.workunit.client.0.smithi110.stdout:1/813: write d1/d2/d1b/f11 [4761130,78108] 0 2024-04-22T00:08:02.625 INFO:tasks.workunit.client.0.smithi110.stdout:3/846: readlink d6/d12/d16/d30/d67/le7 0 2024-04-22T00:08:02.646 INFO:tasks.workunit.client.0.smithi110.stdout:8/897: dwrite d5/d74/fcb [0,4194304] 0 2024-04-22T00:08:02.792 INFO:tasks.workunit.client.0.smithi110.stdout:3/847: stat d6/d12/d16/d5d/dd8/fff 0 2024-04-22T00:08:02.821 INFO:tasks.workunit.client.0.smithi110.stdout:2/893: creat d9/d1a/d1d/d2b/d5b/dd2/de7/f12c x:0 0 0 2024-04-22T00:08:02.996 INFO:tasks.workunit.client.0.smithi110.stdout:9/831: write d1/d29/d6f/f8a [1559431,130119] 0 2024-04-22T00:08:03.193 INFO:tasks.workunit.client.0.smithi110.stdout:5/847: mkdir d7/d24/d3a/d54/dfa 0 2024-04-22T00:08:03.364 INFO:tasks.workunit.client.0.smithi110.stdout:7/854: link d10/d45/d51/d88/d46/c90 d10/d45/d60/d5e/d65/c12e 0 2024-04-22T00:08:03.455 INFO:tasks.workunit.client.0.smithi110.stdout:4/766: getdents d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d6a 0 2024-04-22T00:08:03.831 INFO:tasks.workunit.client.0.smithi110.stdout:3/848: creat d6/d12/d16/d5d/f11f x:0 0 0 2024-04-22T00:08:04.061 INFO:tasks.workunit.client.0.smithi110.stdout:9/832: read d1/d29/d6f/db4/fc9 [2470513,100918] 0 2024-04-22T00:08:05.027 INFO:tasks.workunit.client.0.smithi110.stdout:6/847: dwrite ff [0,4194304] 0 2024-04-22T00:08:05.366 INFO:tasks.workunit.client.0.smithi110.stdout:9/833: read d1/d29/d4d/f68 [642581,60225] 0 2024-04-22T00:08:05.519 INFO:tasks.workunit.client.0.smithi110.stdout:3/849: truncate d6/d78/f8b 3088824 0 2024-04-22T00:08:05.690 INFO:tasks.workunit.client.0.smithi110.stdout:5/848: mkdir d7/d35/dd6/dfb 0 2024-04-22T00:08:05.693 INFO:tasks.workunit.client.0.smithi110.stdout:6/848: dread d16/d1d/d38/f4f [0,4194304] 0 2024-04-22T00:08:05.977 INFO:tasks.workunit.client.0.smithi110.stdout:0/844: dwrite d0/f2c [0,4194304] 0 2024-04-22T00:08:06.132 INFO:tasks.workunit.client.0.smithi110.stdout:2/894: link d9/d1a/d1d/d2b/d5b/f104 d9/d25/d1c/d82/f12d 0 2024-04-22T00:08:06.415 INFO:tasks.workunit.client.0.smithi110.stdout:1/814: write d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/fd6 [463232,6498] 0 2024-04-22T00:08:06.528 INFO:tasks.workunit.client.0.smithi110.stdout:9/834: creat d1/d19/d42/ffc x:0 0 0 2024-04-22T00:08:06.668 INFO:tasks.workunit.client.0.smithi110.stdout:1/815: readlink d1/d1d/d4a/l67 0 2024-04-22T00:08:06.690 INFO:tasks.workunit.client.0.smithi110.stdout:8/898: dwrite d5/da/d17/d6c/d95/f112 [0,4194304] 0 2024-04-22T00:08:06.891 INFO:tasks.workunit.client.0.smithi110.stdout:3/850: chown d6/d12/d16/d5d/dd8/fe4 86574 1 2024-04-22T00:08:06.896 INFO:tasks.workunit.client.0.smithi110.stdout:8/899: stat d5/da/d17/d60/f109 0 2024-04-22T00:08:06.951 INFO:tasks.workunit.client.0.smithi110.stdout:3/851: stat d6/d12/d14/f60 0 2024-04-22T00:08:06.990 INFO:tasks.workunit.client.0.smithi110.stdout:3/852: dread - d6/d12/da1/fe0 zero size 2024-04-22T00:08:07.023 INFO:tasks.workunit.client.0.smithi110.stdout:7/855: rename d10/d15/f117 to d10/d45/d51/d88/d46/d69/f12f 0 2024-04-22T00:08:07.058 INFO:tasks.workunit.client.0.smithi110.stdout:7/856: chown d10/f23 4302 1 2024-04-22T00:08:07.376 INFO:tasks.workunit.client.0.smithi110.stdout:2/895: fsync d9/f49 0 2024-04-22T00:08:07.400 INFO:tasks.workunit.client.0.smithi110.stdout:7/857: dread d10/d45/d51/d88/d39/f92 [0,4194304] 0 2024-04-22T00:08:07.510 INFO:tasks.workunit.client.0.smithi110.stdout:7/858: chown d10/d45/d51/d88/d46/fb4 1854140 1 2024-04-22T00:08:08.002 INFO:tasks.workunit.client.0.smithi110.stdout:1/816: mkdir d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/d119 0 2024-04-22T00:08:08.222 INFO:tasks.workunit.client.0.smithi110.stdout:4/767: getdents d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8 0 2024-04-22T00:08:08.371 INFO:tasks.workunit.client.0.smithi110.stdout:3/853: truncate d6/f19 1004210 0 2024-04-22T00:08:08.390 INFO:tasks.workunit.client.0.smithi110.stdout:4/768: sync 2024-04-22T00:08:08.712 INFO:tasks.workunit.client.0.smithi110.stdout:2/896: mkdir d9/d25/d1b/d11f/d12e 0 2024-04-22T00:08:08.918 INFO:tasks.workunit.client.0.smithi110.stdout:1/817: creat d1/d2/d1b/d10/d5c/d77/d78/f11a x:0 0 0 2024-04-22T00:08:09.227 INFO:tasks.workunit.client.0.smithi110.stdout:3/854: mkdir d6/d12/da1/dea/d120 0 2024-04-22T00:08:09.377 INFO:tasks.workunit.client.0.smithi110.stdout:4/769: creat d1/d35/d6b/f11a x:0 0 0 2024-04-22T00:08:09.606 INFO:tasks.workunit.client.0.smithi110.stdout:5/849: write d7/d24/f36 [3336680,90775] 0 2024-04-22T00:08:09.853 INFO:tasks.workunit.client.0.smithi110.stdout:6/849: write d16/d3d/f81 [4660268,103827] 0 2024-04-22T00:08:10.230 INFO:tasks.workunit.client.0.smithi110.stdout:9/835: mknod d1/de2/cfd 0 2024-04-22T00:08:10.334 INFO:tasks.workunit.client.0.smithi110.stdout:1/818: stat d1/d2/d14/d65/lb6 0 2024-04-22T00:08:10.353 INFO:tasks.workunit.client.0.smithi110.stdout:0/845: write d0/d16/f18 [3294874,74397] 0 2024-04-22T00:08:11.607 INFO:tasks.workunit.client.0.smithi110.stdout:9/836: fsync d1/d29/d2a/d6/ff1 0 2024-04-22T00:08:11.821 INFO:tasks.workunit.client.0.smithi110.stdout:1/819: dread d1/d2/d14/d65/d8a/ff5 [0,4194304] 0 2024-04-22T00:08:12.004 INFO:tasks.workunit.client.0.smithi110.stdout:8/900: write d5/da/d17/d7c/d128/d33/d3d/d82/fd9 [775338,109101] 0 2024-04-22T00:08:12.163 INFO:tasks.workunit.client.0.smithi110.stdout:5/850: creat d7/d24/d37/d38/d88/dd3/ffc x:0 0 0 2024-04-22T00:08:12.699 INFO:tasks.workunit.client.0.smithi110.stdout:7/859: write d10/d45/d60/d5e/fff [4732928,26079] 0 2024-04-22T00:08:13.463 INFO:tasks.workunit.client.0.smithi110.stdout:9/837: unlink d1/d29/d2a/d2b/d58/da8/cce 0 2024-04-22T00:08:13.622 INFO:tasks.workunit.client.0.smithi110.stdout:3/855: write d6/d12/f8f [3457935,95215] 0 2024-04-22T00:08:13.720 INFO:tasks.workunit.client.0.smithi110.stdout:4/770: write d1/d35/d6b/df2/d20/dbf/f3f [3852754,101339] 0 2024-04-22T00:08:13.758 INFO:tasks.workunit.client.0.smithi110.stdout:2/897: getdents d9/d1a/d1d/d2b/d5b/d112 0 2024-04-22T00:08:13.848 INFO:tasks.workunit.client.0.smithi110.stdout:4/771: sync 2024-04-22T00:08:13.966 INFO:tasks.workunit.client.0.smithi110.stdout:7/860: truncate d10/d45/d60/dbb/fca 1614394 0 2024-04-22T00:08:14.103 INFO:tasks.workunit.client.0.smithi110.stdout:6/850: write d16/d1e/d24/fff [513019,20475] 0 2024-04-22T00:08:14.173 INFO:tasks.workunit.client.0.smithi110.stdout:1/820: getdents d1/d2/d30/d8b/dc3/df0 0 2024-04-22T00:08:14.374 INFO:tasks.workunit.client.0.smithi110.stdout:3/856: mkdir d6/d12/d16/d30/d9c/d121 0 2024-04-22T00:08:14.511 INFO:tasks.workunit.client.0.smithi110.stdout:2/898: rmdir d9/d25/d1b/d60 39 2024-04-22T00:08:14.844 INFO:tasks.workunit.client.0.smithi110.stdout:7/861: creat d10/d45/d51/d88/d46/d11c/f130 x:0 0 0 2024-04-22T00:08:14.922 INFO:tasks.workunit.client.0.smithi110.stdout:9/838: truncate d1/fca 1258210 0 2024-04-22T00:08:15.103 INFO:tasks.workunit.client.0.smithi110.stdout:8/901: rmdir d5/da/d17/d7c/d128/d33/d3d/d5c/d11b 0 2024-04-22T00:08:15.201 INFO:tasks.workunit.client.0.smithi110.stdout:1/821: symlink d1/d2/d14/d10f/l11b 0 2024-04-22T00:08:15.326 INFO:tasks.workunit.client.0.smithi110.stdout:6/851: symlink d16/d1d/d38/d48/d5e/db1/l11d 0 2024-04-22T00:08:16.106 INFO:tasks.workunit.client.0.smithi110.stdout:9/839: fsync d1/d29/d6f/f75 0 2024-04-22T00:08:16.429 INFO:tasks.workunit.client.0.smithi110.stdout:0/846: rename d0/ld to d0/d56/da3/d106/l11f 0 2024-04-22T00:08:16.562 INFO:tasks.workunit.client.0.smithi110.stdout:6/852: mkdir d16/d1d/d38/d48/d5e/d6a/d70/d86/d11e 0 2024-04-22T00:08:16.706 INFO:tasks.workunit.client.0.smithi110.stdout:3/857: creat d6/d12/d16/d6f/db5/def/f122 x:0 0 0 2024-04-22T00:08:16.958 INFO:tasks.workunit.client.0.smithi110.stdout:5/851: write d7/d24/d37/d38/f66 [2242407,105416] 0 2024-04-22T00:08:17.346 INFO:tasks.workunit.client.0.smithi110.stdout:1/822: mkdir d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/d119/d11c 0 2024-04-22T00:08:17.562 INFO:tasks.workunit.client.0.smithi110.stdout:2/899: rename d9/d1a/d1d/d2b/d54/cbf to d9/d25/d1b/d45/d50/d68/c12f 0 2024-04-22T00:08:17.582 INFO:tasks.workunit.client.0.smithi110.stdout:0/847: fsync d0/d14/f32 0 2024-04-22T00:08:17.802 INFO:tasks.workunit.client.0.smithi110.stdout:3/858: creat d6/d12/d16/d5d/dd8/f123 x:0 0 0 2024-04-22T00:08:17.858 INFO:tasks.workunit.client.0.smithi110.stdout:3/859: chown d6/d12/d16/d6f/db5/db9/dc6/d10d/c11a 0 1 2024-04-22T00:08:18.287 INFO:tasks.workunit.client.0.smithi110.stdout:4/772: dwrite d1/d35/d6b/df2/d20/d58/d7e/fe7 [0,4194304] 0 2024-04-22T00:08:18.418 INFO:tasks.workunit.client.0.smithi110.stdout:4/773: stat d1/d35/d6b/df2/d20/d23/d1c/dae/lf4 0 2024-04-22T00:08:18.629 INFO:tasks.workunit.client.0.smithi110.stdout:9/840: rename d1/d29/d6f/db4/f9a to d1/d29/d2a/d9d/de0/ffe 0 2024-04-22T00:08:19.064 INFO:tasks.workunit.client.0.smithi110.stdout:2/900: mkdir d9/d1a/d1d/d4e/db5/d130 0 2024-04-22T00:08:19.096 INFO:tasks.workunit.client.0.smithi110.stdout:0/848: creat d0/d56/da3/d106/f120 x:0 0 0 2024-04-22T00:08:19.458 INFO:tasks.workunit.client.0.smithi110.stdout:3/860: truncate d6/d12/d16/d6f/db5/dd3/fe1 332490 0 2024-04-22T00:08:20.169 INFO:tasks.workunit.client.0.smithi110.stdout:8/902: dwrite d5/d6f/f89 [0,4194304] 0 2024-04-22T00:08:20.391 INFO:tasks.workunit.client.0.smithi110.stdout:8/903: dread d5/da/d17/d7c/d128/d33/d3d/fe4 [0,4194304] 0 2024-04-22T00:08:20.411 INFO:tasks.workunit.client.0.smithi110.stdout:2/901: fsync d9/d25/d1c/f28 0 2024-04-22T00:08:20.759 INFO:tasks.workunit.client.0.smithi110.stdout:0/849: dread d0/d16/d42/d50/dbc/fcc [0,4194304] 0 2024-04-22T00:08:21.121 INFO:tasks.workunit.client.0.smithi110.stdout:7/862: dwrite d10/d45/d51/d88/d46/d69/d75/f12a [8388608,4194304] 0 2024-04-22T00:08:21.273 INFO:tasks.workunit.client.0.smithi110.stdout:6/853: getdents d16/d1d/d38/d48/d5e 0 2024-04-22T00:08:21.290 INFO:tasks.workunit.client.0.smithi110.stdout:9/841: mknod d1/d29/d2a/d9d/dd6/cff 0 2024-04-22T00:08:21.400 INFO:tasks.workunit.client.0.smithi110.stdout:3/861: creat d6/d12/d3c/d65/dfc/d117/f124 x:0 0 0 2024-04-22T00:08:21.873 INFO:tasks.workunit.client.0.smithi110.stdout:4/774: creat d1/d35/d6b/df2/d20/d58/d93/f11b x:0 0 0 2024-04-22T00:08:21.902 INFO:tasks.workunit.client.0.smithi110.stdout:5/852: write d7/d35/f7b [8557451,61309] 0 2024-04-22T00:08:22.350 INFO:tasks.workunit.client.0.smithi110.stdout:1/823: dwrite d1/d2/d1b/d10/d5c/d77/d78/deb/fc8 [0,4194304] 0 2024-04-22T00:08:22.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/824: dread d1/d1d/d57/f62 [0,4194304] 0 2024-04-22T00:08:23.663 INFO:tasks.workunit.client.0.smithi110.stdout:4/775: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d6a/f11c x:0 0 0 2024-04-22T00:08:23.689 INFO:tasks.workunit.client.0.smithi110.stdout:4/776: chown d1/l60 62115 1 2024-04-22T00:08:23.727 INFO:tasks.workunit.client.0.smithi110.stdout:7/863: fsync fd 0 2024-04-22T00:08:24.461 INFO:tasks.workunit.client.0.smithi110.stdout:1/825: dread d1/dd/d23/dcc/f41 [4194304,4194304] 0 2024-04-22T00:08:24.774 INFO:tasks.workunit.client.0.smithi110.stdout:5/853: fdatasync d7/d24/d3a/da7/fc6 0 2024-04-22T00:08:24.829 INFO:tasks.workunit.client.0.smithi110.stdout:5/854: chown d7/d24/d3a/d54/fb2 310 1 2024-04-22T00:08:25.066 INFO:tasks.workunit.client.0.smithi110.stdout:7/864: rmdir d10/d45/d51/db1/dee/df0/df9 39 2024-04-22T00:08:25.117 INFO:tasks.workunit.client.0.smithi110.stdout:7/865: read - d10/d45/d51/d88/dce/f119 zero size 2024-04-22T00:08:25.476 INFO:tasks.workunit.client.0.smithi110.stdout:8/904: dwrite d5/da/d17/d6c/d7d/d114/f97 [0,4194304] 0 2024-04-22T00:08:25.592 INFO:tasks.workunit.client.0.smithi110.stdout:8/905: chown d5/da/d17/d6c/d7d/c10a 9151438 1 2024-04-22T00:08:25.641 INFO:tasks.workunit.client.0.smithi110.stdout:2/902: getdents d9/d1a/d1d/d4e/db5 0 2024-04-22T00:08:25.958 INFO:tasks.workunit.client.0.smithi110.stdout:0/850: dwrite d0/d27/d4b/f54 [0,4194304] 0 2024-04-22T00:08:26.082 INFO:tasks.workunit.client.0.smithi110.stdout:0/851: read d0/d16/f58 [67611,17540] 0 2024-04-22T00:08:26.291 INFO:tasks.workunit.client.0.smithi110.stdout:8/906: creat d5/da/d17/d6c/d95/d98/f12e x:0 0 0 2024-04-22T00:08:26.374 INFO:tasks.workunit.client.0.smithi110.stdout:9/842: dwrite d1/d29/d6f/f8a [0,4194304] 0 2024-04-22T00:08:26.518 INFO:tasks.workunit.client.0.smithi110.stdout:2/903: creat d9/d1a/d1d/d4a/d6b/d3a/f131 x:0 0 0 2024-04-22T00:08:26.542 INFO:tasks.workunit.client.0.smithi110.stdout:6/854: write d16/d1e/d24/d90/dac/fd8 [31581,86469] 0 2024-04-22T00:08:26.624 INFO:tasks.workunit.client.0.smithi110.stdout:9/843: chown d1/d29/d2a/d2b/d58/d7b 1 1 2024-04-22T00:08:26.695 INFO:tasks.workunit.client.0.smithi110.stdout:1/826: rename d1/fc7 to d1/d2/d14/d65/d8a/f11d 0 2024-04-22T00:08:26.729 INFO:tasks.workunit.client.0.smithi110.stdout:0/852: chown d0/d27/d4b/d7f/c86 1006065 1 2024-04-22T00:08:26.792 INFO:tasks.workunit.client.0.smithi110.stdout:1/827: chown d1/d2/d1b/d10/d5c/dc5/d27/d3e/c69 3273 1 2024-04-22T00:08:26.951 INFO:tasks.workunit.client.0.smithi110.stdout:8/907: unlink d5/da/d17/d6c/fe2 0 2024-04-22T00:08:27.005 INFO:tasks.workunit.client.0.smithi110.stdout:8/908: chown d5/da/d17/d7c/d128/d33/d3d/d5c/d6a 14241835 1 2024-04-22T00:08:27.034 INFO:tasks.workunit.client.0.smithi110.stdout:8/909: chown d5/da/d17/d7c/d128 15418910 1 2024-04-22T00:08:27.245 INFO:tasks.workunit.client.0.smithi110.stdout:6/855: creat d16/d1d/d38/dab/f11f x:0 0 0 2024-04-22T00:08:28.237 INFO:tasks.workunit.client.0.smithi110.stdout:8/910: creat d5/da/d17/d6c/d95/f12f x:0 0 0 2024-04-22T00:08:28.301 INFO:tasks.workunit.client.0.smithi110.stdout:9/844: mknod d1/d29/d6f/db4/d79/c100 0 2024-04-22T00:08:28.431 INFO:tasks.workunit.client.0.smithi110.stdout:6/856: creat d16/d1d/d38/d48/d5e/d6a/f120 x:0 0 0 2024-04-22T00:08:28.515 INFO:tasks.workunit.client.0.smithi110.stdout:9/845: sync 2024-04-22T00:08:28.600 INFO:tasks.workunit.client.0.smithi110.stdout:3/862: dwrite d6/d78/f88 [0,4194304] 0 2024-04-22T00:08:28.827 INFO:tasks.workunit.client.0.smithi110.stdout:4/777: write d1/d35/d6b/df2/d20/dbf/db5/fdb [626479,77363] 0 2024-04-22T00:08:29.007 INFO:tasks.workunit.client.0.smithi110.stdout:8/911: truncate d5/da/d17/d7c/d128/d33/f4d 3300684 0 2024-04-22T00:08:29.076 INFO:tasks.workunit.client.0.smithi110.stdout:6/857: mknod d16/d3d/d97/dd0/c121 0 2024-04-22T00:08:29.190 INFO:tasks.workunit.client.0.smithi110.stdout:9/846: creat d1/d29/d6f/db4/d79/d98/f101 x:0 0 0 2024-04-22T00:08:29.367 INFO:tasks.workunit.client.0.smithi110.stdout:3/863: mkdir d6/d12/d16/d6f/d7a/d125 0 2024-04-22T00:08:29.715 INFO:tasks.workunit.client.0.smithi110.stdout:5/855: dwrite d7/d24/d49/d61/fa6 [0,4194304] 0 2024-04-22T00:08:29.870 INFO:tasks.workunit.client.0.smithi110.stdout:8/912: write d5/d4f/d79/fb4 [4296346,105883] 0 2024-04-22T00:08:30.097 INFO:tasks.workunit.client.0.smithi110.stdout:9/847: truncate d1/d29/d2a/dc/fcb 545664 0 2024-04-22T00:08:30.215 INFO:tasks.workunit.client.0.smithi110.stdout:3/864: mknod d6/d12/d3c/d65/d91/d116/c126 0 2024-04-22T00:08:30.290 INFO:tasks.workunit.client.0.smithi110.stdout:4/778: symlink d1/d35/d6b/df2/d20/dbf/l11d 0 2024-04-22T00:08:30.546 INFO:tasks.workunit.client.0.smithi110.stdout:7/866: write d10/d45/d51/d88/dce/f10c [1741341,78499] 0 2024-04-22T00:08:30.676 INFO:tasks.workunit.client.0.smithi110.stdout:8/913: rename d5/da/d17/f85 to d5/da/d17/d6c/d7d/d114/d8c/f130 0 2024-04-22T00:08:30.827 INFO:tasks.workunit.client.0.smithi110.stdout:9/848: creat d1/d29/d2a/d9d/de0/f102 x:0 0 0 2024-04-22T00:08:30.937 INFO:tasks.workunit.client.0.smithi110.stdout:3/865: mkdir d6/d12/d16/d6f/db5/d127 0 2024-04-22T00:08:31.260 INFO:tasks.workunit.client.0.smithi110.stdout:5/856: getdents d7/d24/d3a/d40/df7 0 2024-04-22T00:08:31.362 INFO:tasks.workunit.client.0.smithi110.stdout:0/853: write d0/d27/f48 [142340,73478] 0 2024-04-22T00:08:31.394 INFO:tasks.workunit.client.0.smithi110.stdout:1/828: write d1/d2/d14/f9d [3606250,108182] 0 2024-04-22T00:08:31.454 INFO:tasks.workunit.client.0.smithi110.stdout:0/854: chown d0/d56/f109 64481179 1 2024-04-22T00:08:31.482 INFO:tasks.workunit.client.0.smithi110.stdout:8/914: fdatasync d5/da/d17/d6c/fb5 0 2024-04-22T00:08:31.546 INFO:tasks.workunit.client.0.smithi110.stdout:0/855: chown d0/d16/d5d/c10e 174956 1 2024-04-22T00:08:31.608 INFO:tasks.workunit.client.0.smithi110.stdout:6/858: creat d16/d3d/f122 x:0 0 0 2024-04-22T00:08:32.218 INFO:tasks.workunit.client.0.smithi110.stdout:4/779: symlink d1/d35/d6b/df2/d20/d23/d1c/d47/l11e 0 2024-04-22T00:08:32.391 INFO:tasks.workunit.client.0.smithi110.stdout:3/866: rmdir d6/d12/da1 39 2024-04-22T00:08:32.403 INFO:tasks.workunit.client.0.smithi110.stdout:5/857: fsync d7/d9/d17/d48/f63 0 2024-04-22T00:08:32.824 INFO:tasks.workunit.client.0.smithi110.stdout:8/915: fsync d5/da/d17/d7c/d128/d33/d3d/f46 0 2024-04-22T00:08:33.189 INFO:tasks.workunit.client.0.smithi110.stdout:6/859: unlink d16/d1d/d38/l51 0 2024-04-22T00:08:33.323 INFO:tasks.workunit.client.0.smithi110.stdout:6/860: sync 2024-04-22T00:08:33.741 INFO:tasks.workunit.client.0.smithi110.stdout:2/904: dwrite d9/d25/d1b/d60/fee [0,4194304] 0 2024-04-22T00:08:33.884 INFO:tasks.workunit.client.0.smithi110.stdout:4/780: symlink d1/d35/d6b/df2/d20/d58/d93/d7c/l11f 0 2024-04-22T00:08:34.235 INFO:tasks.workunit.client.0.smithi110.stdout:3/867: symlink d6/d12/d16/d30/l128 0 2024-04-22T00:08:34.482 INFO:tasks.workunit.client.0.smithi110.stdout:1/829: unlink d1/d2/d1b/d10/d5c/dc5/d27/f6b 0 2024-04-22T00:08:35.094 INFO:tasks.workunit.client.0.smithi110.stdout:6/861: symlink d16/d1e/da8/l123 0 2024-04-22T00:08:35.424 INFO:tasks.workunit.client.0.smithi110.stdout:2/905: rmdir d9/d1a/d1d/d4a/d6b/d3a/d5c 39 2024-04-22T00:08:35.698 INFO:tasks.workunit.client.0.smithi110.stdout:4/781: dread d1/d35/d6b/df2/d20/d23/d1c/d47/d95/fbb [0,4194304] 0 2024-04-22T00:08:36.281 INFO:tasks.workunit.client.0.smithi110.stdout:7/867: write d10/d27/f82 [755248,39622] 0 2024-04-22T00:08:36.370 INFO:tasks.workunit.client.0.smithi110.stdout:1/830: creat d1/d2/d30/f11e x:0 0 0 2024-04-22T00:08:36.707 INFO:tasks.workunit.client.0.smithi110.stdout:9/849: write d1/d29/d2a/d2b/d58/d7b/fab [1379614,96199] 0 2024-04-22T00:08:37.082 INFO:tasks.workunit.client.0.smithi110.stdout:6/862: creat d16/d3d/d97/dd0/f124 x:0 0 0 2024-04-22T00:08:37.680 INFO:tasks.workunit.client.0.smithi110.stdout:5/858: rename d7/d9/fd to d7/d9/d17/d48/d69/ffd 0 2024-04-22T00:08:38.102 INFO:tasks.workunit.client.0.smithi110.stdout:0/856: creat d0/d27/d4b/da0/d100/d104/f121 x:0 0 0 2024-04-22T00:08:38.110 INFO:tasks.workunit.client.0.smithi110.stdout:9/850: fsync d1/d29/d2a/d6/d1d/f7c 0 2024-04-22T00:08:38.354 INFO:tasks.workunit.client.0.smithi110.stdout:6/863: mkdir d16/d1d/d38/d48/d5e/d125 0 2024-04-22T00:08:38.773 INFO:tasks.workunit.client.0.smithi110.stdout:4/782: truncate d1/d35/d6b/df2/d20/dbf/f38 5658714 0 2024-04-22T00:08:39.091 INFO:tasks.workunit.client.0.smithi110.stdout:7/868: symlink d10/d45/d51/d88/d39/d7f/d80/l131 0 2024-04-22T00:08:39.351 INFO:tasks.workunit.client.0.smithi110.stdout:9/851: fdatasync d1/d29/d6f/f75 0 2024-04-22T00:08:39.393 INFO:tasks.workunit.client.0.smithi110.stdout:9/852: readlink d1/d29/d2a/d6/d1d/l85 0 2024-04-22T00:08:39.426 INFO:tasks.workunit.client.0.smithi110.stdout:9/853: readlink d1/d29/d2a/d6/d1d/l85 0 2024-04-22T00:08:39.478 INFO:tasks.workunit.client.0.smithi110.stdout:9/854: fsync d1/d29/d2a/d2b/d58/d7b/fab 0 2024-04-22T00:08:39.622 INFO:tasks.workunit.client.0.smithi110.stdout:0/857: truncate d0/d16/d5d/fdf 487317 0 2024-04-22T00:08:40.218 INFO:tasks.workunit.client.0.smithi110.stdout:7/869: fdatasync d10/d45/d51/d88/d46/d69/f103 0 2024-04-22T00:08:40.223 INFO:tasks.workunit.client.0.smithi110.stdout:8/916: dwrite d5/da/d17/d7c/d128/d33/d3d/d82/da8/f105 [0,4194304] 0 2024-04-22T00:08:40.398 INFO:tasks.workunit.client.0.smithi110.stdout:8/917: chown d5/d80/f8f 939 1 2024-04-22T00:08:40.824 INFO:tasks.workunit.client.0.smithi110.stdout:9/855: creat d1/d29/d59/d99/deb/f103 x:0 0 0 2024-04-22T00:08:40.871 INFO:tasks.workunit.client.0.smithi110.stdout:7/870: readlink d10/d45/d51/d88/d46/l6c 0 2024-04-22T00:08:40.961 INFO:tasks.workunit.client.0.smithi110.stdout:7/871: dread - d10/d45/d60/d5e/d65/d8a/deb/f113 zero size 2024-04-22T00:08:41.193 INFO:tasks.workunit.client.0.smithi110.stdout:3/868: truncate d6/d78/f8b 3198604 0 2024-04-22T00:08:41.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/783: getdents d1/d35/d6b/df2/d20/d23 0 2024-04-22T00:08:41.861 INFO:tasks.workunit.client.0.smithi110.stdout:0/858: rename d0/d27/l72 to d0/d14/d23/d6d/l122 0 2024-04-22T00:08:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:0/859: dread d0/d16/d42/fbd [0,4194304] 0 2024-04-22T00:08:41.955 INFO:tasks.workunit.client.0.smithi110.stdout:0/860: chown d0/d14/d23/d3b/c71 16885328 1 2024-04-22T00:08:41.971 INFO:tasks.workunit.client.0.smithi110.stdout:3/869: mknod d6/d12/d50/c129 0 2024-04-22T00:08:42.206 INFO:tasks.workunit.client.0.smithi110.stdout:9/856: truncate d1/d29/d6f/db4/d79/d98/f101 677150 0 2024-04-22T00:08:42.221 INFO:tasks.workunit.client.0.smithi110.stdout:8/918: link d5/da/d17/c30 d5/da/d17/d6c/d72/d73/c131 0 2024-04-22T00:08:42.322 INFO:tasks.workunit.client.0.smithi110.stdout:4/784: mkdir d1/d35/d6b/df2/d20/d58/d93/d5e/d120 0 2024-04-22T00:08:42.602 INFO:tasks.workunit.client.0.smithi110.stdout:2/906: write d9/d1a/d1d/fa9 [3443617,63615] 0 2024-04-22T00:08:42.665 INFO:tasks.workunit.client.0.smithi110.stdout:2/907: read d9/d25/d1b/d60/f67 [3228392,54434] 0 2024-04-22T00:08:42.694 INFO:tasks.workunit.client.0.smithi110.stdout:3/870: creat d6/d12/d16/d6f/db5/f12a x:0 0 0 2024-04-22T00:08:42.800 INFO:tasks.workunit.client.0.smithi110.stdout:9/857: fsync d1/d29/f34 0 2024-04-22T00:08:43.108 INFO:tasks.workunit.client.0.smithi110.stdout:8/919: symlink d5/da/d17/dbf/l132 0 2024-04-22T00:08:43.438 INFO:tasks.workunit.client.0.smithi110.stdout:1/831: dwrite d1/d2/d14/d65/d8a/ff5 [0,4194304] 0 2024-04-22T00:08:43.730 INFO:tasks.workunit.client.0.smithi110.stdout:1/832: dread d1/d2/d1b/d10/f12 [4194304,4194304] 0 2024-04-22T00:08:43.814 INFO:tasks.workunit.client.0.smithi110.stdout:9/858: dread d1/d29/d2a/d6/d1d/f84 [0,4194304] 0 2024-04-22T00:08:43.943 INFO:tasks.workunit.client.0.smithi110.stdout:5/859: write d7/d24/d49/d61/f75 [1940411,49159] 0 2024-04-22T00:08:44.738 INFO:tasks.workunit.client.0.smithi110.stdout:1/833: creat d1/d1d/d4a/f11f x:0 0 0 2024-04-22T00:08:45.001 INFO:tasks.workunit.client.0.smithi110.stdout:9/859: symlink d1/d29/d6f/dd9/l104 0 2024-04-22T00:08:45.229 INFO:tasks.workunit.client.0.smithi110.stdout:5/860: rename d7/d35/f7b to d7/d24/d3a/d54/ffe 0 2024-04-22T00:08:45.405 INFO:tasks.workunit.client.0.smithi110.stdout:6/864: dwrite d16/d1d/f41 [0,4194304] 0 2024-04-22T00:08:45.619 INFO:tasks.workunit.client.0.smithi110.stdout:0/861: getdents d0/d16/d5d 0 2024-04-22T00:08:45.622 INFO:tasks.workunit.client.0.smithi110.stdout:3/871: creat d6/d12/d3c/f12b x:0 0 0 2024-04-22T00:08:46.977 INFO:tasks.workunit.client.0.smithi110.stdout:0/862: truncate d0/d14/d23/fc2 2870377 0 2024-04-22T00:08:47.406 INFO:tasks.workunit.client.0.smithi110.stdout:1/834: symlink d1/d2/d1b/d10/d5c/d77/df1/l120 0 2024-04-22T00:08:47.774 INFO:tasks.workunit.client.0.smithi110.stdout:7/872: write d10/d45/d51/db1/dc9/df5/f42 [985832,94647] 0 2024-04-22T00:08:47.972 INFO:tasks.workunit.client.0.smithi110.stdout:3/872: symlink d6/d12/da1/l12c 0 2024-04-22T00:08:48.190 INFO:tasks.workunit.client.0.smithi110.stdout:9/860: link d1/d29/d2a/d6/fe d1/d29/d6f/f105 0 2024-04-22T00:08:48.724 INFO:tasks.workunit.client.0.smithi110.stdout:4/785: write d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/fe0 [637919,47676] 0 2024-04-22T00:08:48.755 INFO:tasks.workunit.client.0.smithi110.stdout:2/908: write d9/d1a/d1d/d4a/d6b/d3a/d5c/f97 [1927336,50599] 0 2024-04-22T00:08:48.899 INFO:tasks.workunit.client.0.smithi110.stdout:3/873: readlink d6/d12/d3c/d65/d91/lcb 0 2024-04-22T00:08:49.136 INFO:tasks.workunit.client.0.smithi110.stdout:8/920: dwrite d5/da/dac/dc6/fcd [0,4194304] 0 2024-04-22T00:08:49.703 INFO:tasks.workunit.client.0.smithi110.stdout:9/861: mknod d1/d29/d2a/d2b/c106 0 2024-04-22T00:08:49.884 INFO:tasks.workunit.client.0.smithi110.stdout:0/863: rename d0/d27/d4b/da0/da4/cba to d0/d25/d5a/d63/c123 0 2024-04-22T00:08:49.944 INFO:tasks.workunit.client.0.smithi110.stdout:6/865: dwrite d16/d1e/d24/f5d [0,4194304] 0 2024-04-22T00:08:50.319 INFO:tasks.workunit.client.0.smithi110.stdout:8/921: rmdir d5/d4f 39 2024-04-22T00:08:50.394 INFO:tasks.workunit.client.0.smithi110.stdout:1/835: link d1/d2/d14/d65/d8a/da6/lec d1/d1d/d70/de4/l121 0 2024-04-22T00:08:51.107 INFO:tasks.workunit.client.0.smithi110.stdout:6/866: dread - d16/d3d/ff8 zero size 2024-04-22T00:08:51.147 INFO:tasks.workunit.client.0.smithi110.stdout:6/867: dread - d16/d3d/d40/d46/f89 zero size 2024-04-22T00:08:51.637 INFO:tasks.workunit.client.0.smithi110.stdout:8/922: readlink d5/da/d17/d7c/d128/d33/d3d/d82/da8/lbb 0 2024-04-22T00:08:51.995 INFO:tasks.workunit.client.0.smithi110.stdout:5/861: dwrite d7/d9/d17/d48/d69/ffd [0,4194304] 0 2024-04-22T00:08:52.003 INFO:tasks.workunit.client.0.smithi110.stdout:7/873: dwrite d10/d45/d51/d88/d46/fa0 [0,4194304] 0 2024-04-22T00:08:52.321 INFO:tasks.workunit.client.0.smithi110.stdout:9/862: symlink d1/d52/l107 0 2024-04-22T00:08:52.432 INFO:tasks.workunit.client.0.smithi110.stdout:0/864: getdents d0/d56/d10f/d110 0 2024-04-22T00:08:52.887 INFO:tasks.workunit.client.0.smithi110.stdout:3/874: dwrite d6/d12/d16/d30/d9c/f79 [4194304,4194304] 0 2024-04-22T00:08:53.208 INFO:tasks.workunit.client.0.smithi110.stdout:2/909: write d9/d1a/d1d/d4a/d78/f86 [324659,88238] 0 2024-04-22T00:08:53.290 INFO:tasks.workunit.client.0.smithi110.stdout:5/862: read d7/d24/d37/d38/fa1 [2642626,111292] 0 2024-04-22T00:08:53.543 INFO:tasks.workunit.client.0.smithi110.stdout:4/786: getdents d1/d35/d6b/df2/d20/d58/d7e 0 2024-04-22T00:08:53.820 INFO:tasks.workunit.client.0.smithi110.stdout:7/874: dread d10/d45/d51/d88/f8e [0,4194304] 0 2024-04-22T00:08:53.951 INFO:tasks.workunit.client.0.smithi110.stdout:7/875: stat d10/d45/d51/d88/dce/f111 0 2024-04-22T00:08:54.422 INFO:tasks.workunit.client.0.smithi110.stdout:3/875: dread d6/f3a [0,4194304] 0 2024-04-22T00:08:54.447 INFO:tasks.workunit.client.0.smithi110.stdout:6/868: creat d16/d3d/f126 x:0 0 0 2024-04-22T00:08:54.745 INFO:tasks.workunit.client.0.smithi110.stdout:4/787: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d95/f121 x:0 0 0 2024-04-22T00:08:54.837 INFO:tasks.workunit.client.0.smithi110.stdout:3/876: chown d6/d12/d16/d6f/db5/cbb 267214224 1 2024-04-22T00:08:54.919 INFO:tasks.workunit.client.0.smithi110.stdout:2/910: dread d9/d1a/d7b/dab/dc1/fff [0,4194304] 0 2024-04-22T00:08:55.161 INFO:tasks.workunit.client.0.smithi110.stdout:4/788: chown d1/d35/d6b/df2/d20/d23/d1c/dae/c110 4 1 2024-04-22T00:08:55.162 INFO:tasks.workunit.client.0.smithi110.stdout:1/836: link d1/dd/d23/dcc/ld0 d1/d2/d1b/l122 0 2024-04-22T00:08:55.658 INFO:tasks.workunit.client.0.smithi110.stdout:0/865: rename d0/d56/f97 to d0/d14/d23/d6d/f124 0 2024-04-22T00:08:55.857 INFO:tasks.workunit.client.0.smithi110.stdout:3/877: mknod d6/d12/d14/d4b/c12d 0 2024-04-22T00:08:56.193 INFO:tasks.workunit.client.0.smithi110.stdout:4/789: symlink d1/d35/d6b/df2/d20/dc4/l122 0 2024-04-22T00:08:56.224 INFO:tasks.workunit.client.0.smithi110.stdout:8/923: dwrite d5/da/d17/d6c/d7d/f69 [0,4194304] 0 2024-04-22T00:08:56.419 INFO:tasks.workunit.client.0.smithi110.stdout:2/911: truncate d9/d1a/d1d/d2b/d54/f70 5397169 0 2024-04-22T00:08:56.881 INFO:tasks.workunit.client.0.smithi110.stdout:6/869: mkdir d16/d3d/d40/d46/d10b/d127 0 2024-04-22T00:08:56.908 INFO:tasks.workunit.client.0.smithi110.stdout:6/870: chown d16/d1e/d24/c7a 11553744 1 2024-04-22T00:08:57.164 INFO:tasks.workunit.client.0.smithi110.stdout:5/863: rename d7/d24/d37/f5f to d7/d9/d17/d48/d69/d6d/fff 0 2024-04-22T00:08:57.407 INFO:tasks.workunit.client.0.smithi110.stdout:7/876: write d10/d45/d51/db1/dc9/df5/d2c/fb0 [3294512,103018] 0 2024-04-22T00:08:57.454 INFO:tasks.workunit.client.0.smithi110.stdout:9/863: link d1/d29/d2a/d2b/l3e d1/d29/l108 0 2024-04-22T00:08:57.720 INFO:tasks.workunit.client.0.smithi110.stdout:4/790: fsync d1/d35/d6b/df2/d20/fc9 0 2024-04-22T00:08:58.556 INFO:tasks.workunit.client.0.smithi110.stdout:1/837: write d1/d1d/d4a/fb0 [922098,15882] 0 2024-04-22T00:08:58.589 INFO:tasks.workunit.client.0.smithi110.stdout:9/864: creat d1/d29/d2a/d6/f109 x:0 0 0 2024-04-22T00:08:58.710 INFO:tasks.workunit.client.0.smithi110.stdout:1/838: chown d1/d2/d30/d8b/c90 1 1 2024-04-22T00:08:58.745 INFO:tasks.workunit.client.0.smithi110.stdout:1/839: stat d1/d2/d1b/d10/d5c/dc5/cbe 0 2024-04-22T00:08:59.283 INFO:tasks.workunit.client.0.smithi110.stdout:8/924: mknod d5/d4f/d79/d10b/c133 0 2024-04-22T00:08:59.459 INFO:tasks.workunit.client.0.smithi110.stdout:4/791: truncate d1/d35/d6b/df2/d12/ff0 40399 0 2024-04-22T00:08:59.642 INFO:tasks.workunit.client.0.smithi110.stdout:6/871: symlink d16/d1d/d38/d48/d5e/d6a/d70/d86/d11e/l128 0 2024-04-22T00:09:00.042 INFO:tasks.workunit.client.0.smithi110.stdout:0/866: write d0/d16/d42/d50/f94 [531344,11647] 0 2024-04-22T00:09:00.269 INFO:tasks.workunit.client.0.smithi110.stdout:8/925: dread - d5/da/d88/dd4/ffa zero size 2024-04-22T00:09:00.400 INFO:tasks.workunit.client.0.smithi110.stdout:3/878: dwrite d6/d12/d14/f7e [4194304,4194304] 0 2024-04-22T00:09:00.586 INFO:tasks.workunit.client.0.smithi110.stdout:2/912: write d9/d25/d1b/d45/d50/d68/da4/fb9 [59327,15977] 0 2024-04-22T00:09:00.613 INFO:tasks.workunit.client.0.smithi110.stdout:5/864: write d7/d24/d31/f5e [199371,104140] 0 2024-04-22T00:09:00.773 INFO:tasks.workunit.client.0.smithi110.stdout:5/865: chown d7/d9 943 1 2024-04-22T00:09:00.930 INFO:tasks.workunit.client.0.smithi110.stdout:6/872: rmdir d16/d1d/d38/dfe 39 2024-04-22T00:09:01.018 INFO:tasks.workunit.client.0.smithi110.stdout:7/877: dwrite d10/d43/f91 [0,4194304] 0 2024-04-22T00:09:01.138 INFO:tasks.workunit.client.0.smithi110.stdout:6/873: stat d16/d1d/d38 0 2024-04-22T00:09:01.162 INFO:tasks.workunit.client.0.smithi110.stdout:7/878: sync 2024-04-22T00:09:01.205 INFO:tasks.workunit.client.0.smithi110.stdout:7/879: chown d10/d45/d51/db1/l11a 37222 1 2024-04-22T00:09:01.241 INFO:tasks.workunit.client.0.smithi110.stdout:7/880: readlink d10/d45/d51/d88/d39/d7f/d80/l9a 0 2024-04-22T00:09:01.511 INFO:tasks.workunit.client.0.smithi110.stdout:4/792: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d95/dcd/f123 x:0 0 0 2024-04-22T00:09:01.882 INFO:tasks.workunit.client.0.smithi110.stdout:3/879: truncate d6/d12/d16/d30/fb7 2735199 0 2024-04-22T00:09:02.560 INFO:tasks.workunit.client.0.smithi110.stdout:5/866: read d7/d22/d5b/f6c [47459,102118] 0 2024-04-22T00:09:02.644 INFO:tasks.workunit.client.0.smithi110.stdout:7/881: dread - d10/d45/d51/d88/d46/d11c/f130 zero size 2024-04-22T00:09:02.812 INFO:tasks.workunit.client.0.smithi110.stdout:4/793: fdatasync d1/d35/d6b/df2/d20/d23/d1c/dae/fe4 0 2024-04-22T00:09:02.855 INFO:tasks.workunit.client.0.smithi110.stdout:9/865: dwrite d1/d29/d2a/d6/fc4 [0,4194304] 0 2024-04-22T00:09:03.130 INFO:tasks.workunit.client.0.smithi110.stdout:7/882: dread d10/d45/d51/db1/dc9/df5/d2c/fb6 [0,4194304] 0 2024-04-22T00:09:03.236 INFO:tasks.workunit.client.0.smithi110.stdout:6/874: creat d16/d1d/d38/dfe/f129 x:0 0 0 2024-04-22T00:09:03.261 INFO:tasks.workunit.client.0.smithi110.stdout:8/926: write d5/f38 [2300596,103015] 0 2024-04-22T00:09:03.476 INFO:tasks.workunit.client.0.smithi110.stdout:1/840: dwrite d1/d2/d1b/d10/d5c/d77/d78/deb/fa3 [0,4194304] 0 2024-04-22T00:09:03.692 INFO:tasks.workunit.client.0.smithi110.stdout:5/867: symlink d7/d9/d17/d48/d69/d6d/l100 0 2024-04-22T00:09:03.736 INFO:tasks.workunit.client.0.smithi110.stdout:5/868: read d7/d9/d17/fc1 [430514,101764] 0 2024-04-22T00:09:04.608 INFO:tasks.workunit.client.0.smithi110.stdout:2/913: dwrite d9/d1a/d1d/de8/ff4 [0,4194304] 0 2024-04-22T00:09:04.632 INFO:tasks.workunit.client.0.smithi110.stdout:7/883: creat d10/d45/d60/d5e/d65/d8a/f132 x:0 0 0 2024-04-22T00:09:04.739 INFO:tasks.workunit.client.0.smithi110.stdout:6/875: mknod d16/d1d/d38/d48/d5e/d6a/d70/d86/d11e/c12a 0 2024-04-22T00:09:04.794 INFO:tasks.workunit.client.0.smithi110.stdout:1/841: fdatasync d1/dd/d23/f96 0 2024-04-22T00:09:04.881 INFO:tasks.workunit.client.0.smithi110.stdout:5/869: truncate d7/d24/d49/f99 797747 0 2024-04-22T00:09:05.039 INFO:tasks.workunit.client.0.smithi110.stdout:7/884: chown d10/d45/d51/db1/dc9/df5/f79 107692 1 2024-04-22T00:09:05.216 INFO:tasks.workunit.client.0.smithi110.stdout:0/867: dwrite d0/d16/d5d/fdf [0,4194304] 0 2024-04-22T00:09:05.623 INFO:tasks.workunit.client.0.smithi110.stdout:5/870: dread d7/d24/d3a/d40/fa8 [0,4194304] 0 2024-04-22T00:09:05.712 INFO:tasks.workunit.client.0.smithi110.stdout:2/914: creat d9/d25/de5/f132 x:0 0 0 2024-04-22T00:09:05.977 INFO:tasks.workunit.client.0.smithi110.stdout:6/876: dread d16/d1e/d24/d33/f39 [0,4194304] 0 2024-04-22T00:09:06.242 INFO:tasks.workunit.client.0.smithi110.stdout:9/866: write d1/d29/d6f/db4/f92 [1189353,4384] 0 2024-04-22T00:09:06.486 INFO:tasks.workunit.client.0.smithi110.stdout:1/842: dread d1/f26 [0,4194304] 0 2024-04-22T00:09:06.674 INFO:tasks.workunit.client.0.smithi110.stdout:6/877: truncate d16/d3d/d97/fa0 4087994 0 2024-04-22T00:09:06.764 INFO:tasks.workunit.client.0.smithi110.stdout:8/927: write d5/da/d17/d6c/d72/dc4/f123 [823259,23081] 0 2024-04-22T00:09:06.921 INFO:tasks.workunit.client.0.smithi110.stdout:8/928: sync 2024-04-22T00:09:07.283 INFO:tasks.workunit.client.0.smithi110.stdout:7/885: truncate d10/d15/fc5 750551 0 2024-04-22T00:09:07.337 INFO:tasks.workunit.client.0.smithi110.stdout:7/886: chown d10/d45/d51/db1/dc9/df5/d2c/fbf 66 1 2024-04-22T00:09:07.398 INFO:tasks.workunit.client.0.smithi110.stdout:2/915: truncate d9/d25/d1b/ffb 518586 0 2024-04-22T00:09:07.515 INFO:tasks.workunit.client.0.smithi110.stdout:9/867: truncate d1/d29/f34 998946 0 2024-04-22T00:09:07.619 INFO:tasks.workunit.client.0.smithi110.stdout:1/843: dread - d1/f115 zero size 2024-04-22T00:09:07.717 INFO:tasks.workunit.client.0.smithi110.stdout:6/878: rename f3 to d16/d1e/d24/d33/f12b 0 2024-04-22T00:09:07.815 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:16:48.074 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:07.818 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:16:48.077 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:07.912 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:16:48.171 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:07.933 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:16:48.127 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:07.936 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:16:48.130 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:07.944 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:16:48.139 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:07.948 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:16:48.142 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:07.998 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:16:48.193 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:08.010 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:16:48.204 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:09:08.045 INFO:tasks.workunit.client.0.smithi110.stdout:4/794: dwrite d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/d7a/fea [0,4194304] 0 2024-04-22T00:09:08.153 INFO:tasks.workunit.client.0.smithi110.stdout:5/871: rmdir d7/d35/dc0/df5 0 2024-04-22T00:09:08.197 INFO:tasks.workunit.client.0.smithi110.stdout:8/929: readlink d5/d4f/d79/l10e 0 2024-04-22T00:09:08.240 INFO:tasks.workunit.client.0.smithi110.stdout:4/795: chown d1/d35/d6b/df2/fcc 211106186 1 2024-04-22T00:09:08.287 INFO:tasks.workunit.client.0.smithi110.stdout:7/887: truncate d10/d45/d51/d88/d46/fa0 4819773 0 2024-04-22T00:09:08.331 INFO:tasks.workunit.client.0.smithi110.stdout:2/916: truncate d9/d1a/d1d/d4a/d6b/d3a/f131 1017082 0 2024-04-22T00:09:08.388 INFO:tasks.workunit.client.0.smithi110.stdout:0/868: write d0/fa [2983660,3499] 0 2024-04-22T00:09:08.481 INFO:tasks.workunit.client.0.smithi110.stdout:0/869: read d0/d16/fa6 [3843211,72002] 0 2024-04-22T00:09:08.614 INFO:tasks.workunit.client.0.smithi110.stdout:1/844: mknod d1/d2/d1b/d10/d5c/daa/d10a/c123 0 2024-04-22T00:09:08.654 INFO:tasks.workunit.client.0.smithi110.stdout:1/845: chown d1/d2/d1b/d10/d5c/d77/cd4 1726 1 2024-04-22T00:09:08.984 INFO:tasks.workunit.client.0.smithi110.stdout:8/930: symlink d5/da/d17/d60/l134 0 2024-04-22T00:09:09.447 INFO:tasks.workunit.client.0.smithi110.stdout:4/796: fdatasync d1/d35/d6b/df2/d20/d23/d1c/dae/fe4 0 2024-04-22T00:09:09.475 INFO:tasks.workunit.client.0.smithi110.stdout:7/888: creat d10/d45/d60/d5e/d65/d8a/deb/f133 x:0 0 0 2024-04-22T00:09:09.564 INFO:tasks.workunit.client.0.smithi110.stdout:7/889: read - d10/d45/d51/d88/d46/d69/f103 zero size 2024-04-22T00:09:09.867 INFO:tasks.workunit.client.0.smithi110.stdout:2/917: dread d9/d1a/d1d/d2b/f56 [0,4194304] 0 2024-04-22T00:09:10.007 INFO:tasks.workunit.client.0.smithi110.stdout:2/918: dread d9/d1a/d1d/d2b/d5b/f79 [0,4194304] 0 2024-04-22T00:09:10.064 INFO:tasks.workunit.client.0.smithi110.stdout:6/879: symlink d16/d1e/l12c 0 2024-04-22T00:09:10.163 INFO:tasks.workunit.client.0.smithi110.stdout:1/846: rmdir d1/d2/d1b/d10/d5c/d77/d78/deb 39 2024-04-22T00:09:10.191 INFO:tasks.workunit.client.0.smithi110.stdout:1/847: read - d1/dd/d23/f74 zero size 2024-04-22T00:09:10.312 INFO:tasks.workunit.client.0.smithi110.stdout:5/872: symlink d7/d24/d49/ddb/l101 0 2024-04-22T00:09:10.891 INFO:tasks.workunit.client.0.smithi110.stdout:8/931: truncate d5/d6f/f89 2017905 0 2024-04-22T00:09:11.121 INFO:tasks.workunit.client.0.smithi110.stdout:4/797: dread - d1/d35/d6b/df2/d20/dc4/f119 zero size 2024-04-22T00:09:12.964 INFO:tasks.workunit.client.0.smithi110.stdout:4/798: dread d1/d35/d6b/df2/d20/f2c [0,4194304] 0 2024-04-22T00:09:12.964 INFO:tasks.workunit.client.0.smithi110.stdout:3/880: link d6/d12/d16/d5d/f11f d6/d12/f12e 0 2024-04-22T00:09:12.964 INFO:tasks.workunit.client.0.smithi110.stdout:2/919: creat d9/d1a/d1d/d2b/d5b/f133 x:0 0 0 2024-04-22T00:09:12.964 INFO:tasks.workunit.client.0.smithi110.stdout:6/880: mknod d16/d3d/d97/dd0/df9/c12d 0 2024-04-22T00:09:12.964 INFO:tasks.workunit.client.0.smithi110.stdout:5/873: symlink d7/d24/d3a/d54/l102 0 2024-04-22T00:09:13.267 INFO:tasks.workunit.client.0.smithi110.stdout:0/870: write d0/d25/f79 [1968659,4004] 0 2024-04-22T00:09:13.503 INFO:tasks.workunit.client.0.smithi110.stdout:9/868: getdents d1 0 2024-04-22T00:09:14.120 INFO:tasks.workunit.client.0.smithi110.stdout:2/920: mknod d9/d1a/d1d/d4e/dc0/c134 0 2024-04-22T00:09:14.263 INFO:tasks.workunit.client.0.smithi110.stdout:6/881: dread - d16/d1d/d38/fb7 zero size 2024-04-22T00:09:14.369 INFO:tasks.workunit.client.0.smithi110.stdout:5/874: fdatasync d7/d35/dc0/fe2 0 2024-04-22T00:09:14.454 INFO:tasks.workunit.client.0.smithi110.stdout:8/932: mkdir d5/da/d17/d6c/d72/da0/dee/d135 0 2024-04-22T00:09:14.491 INFO:tasks.workunit.client.0.smithi110.stdout:8/933: chown d5/da/d17/d6c/d72 33 1 2024-04-22T00:09:14.776 INFO:tasks.workunit.client.0.smithi110.stdout:7/890: dwrite d10/d45/d51/d88/d46/d11c/f130 [0,4194304] 0 2024-04-22T00:09:14.901 INFO:tasks.workunit.client.0.smithi110.stdout:7/891: dread - d10/d45/d51/d88/d39/fe3 zero size 2024-04-22T00:09:14.924 INFO:tasks.workunit.client.0.smithi110.stdout:7/892: stat d10/d15/d95/d101 0 2024-04-22T00:09:15.097 INFO:tasks.workunit.client.0.smithi110.stdout:9/869: truncate d1/d29/d2a/dc/f90 226429 0 2024-04-22T00:09:15.101 INFO:tasks.workunit.client.0.smithi110.stdout:7/893: dread d10/d45/d51/d88/d46/d11c/f130 [0,4194304] 0 2024-04-22T00:09:15.116 INFO:tasks.workunit.client.0.smithi110.stdout:4/799: rename d1/d101 to d1/d35/d6b/df2/d20/d58/d93/d5e/d120/d124 0 2024-04-22T00:09:15.228 INFO:tasks.workunit.client.0.smithi110.stdout:4/800: chown d1/d35/d6b/df2/d12/l117 7112 1 2024-04-22T00:09:15.386 INFO:tasks.workunit.client.0.smithi110.stdout:3/881: getdents d6/d12/da1/dea/d120 0 2024-04-22T00:09:15.492 INFO:tasks.workunit.client.0.smithi110.stdout:6/882: creat d16/d1d/d38/d48/f12e x:0 0 0 2024-04-22T00:09:15.854 INFO:tasks.workunit.client.0.smithi110.stdout:8/934: dread - d5/d4f/f12d zero size 2024-04-22T00:09:15.984 INFO:tasks.workunit.client.0.smithi110.stdout:5/875: dread d7/d24/f36 [0,4194304] 0 2024-04-22T00:09:16.039 INFO:tasks.workunit.client.0.smithi110.stdout:5/876: read d7/d9/d17/d48/f63 [2906940,72882] 0 2024-04-22T00:09:16.116 INFO:tasks.workunit.client.0.smithi110.stdout:5/877: chown d7/d22/d5b/d68/le7 33317 1 2024-04-22T00:09:16.717 INFO:tasks.workunit.client.0.smithi110.stdout:8/935: symlink d5/da/l136 0 2024-04-22T00:09:16.746 INFO:tasks.workunit.client.0.smithi110.stdout:3/882: read d6/d12/d14/d32/f4e [11190207,19389] 0 2024-04-22T00:09:16.925 INFO:tasks.workunit.client.0.smithi110.stdout:3/883: chown d6/lf 31881979 1 2024-04-22T00:09:16.937 INFO:tasks.workunit.client.0.smithi110.stdout:5/878: chown d7/d9/d17/d48/d69/cbb 639 1 2024-04-22T00:09:17.134 INFO:tasks.workunit.client.0.smithi110.stdout:6/883: dread d16/d3d/d40/d46/f6d [0,4194304] 0 2024-04-22T00:09:18.273 INFO:tasks.workunit.client.0.smithi110.stdout:7/894: link d10/d45/d51/db1/dc9/df5/d2c/f5d d10/d45/d60/d5e/f134 0 2024-04-22T00:09:18.657 INFO:tasks.workunit.client.0.smithi110.stdout:1/848: rename d1/d2/d1b/d10/d5c/d77/d78/deb/l80 to d1/d2/l124 0 2024-04-22T00:09:19.171 INFO:tasks.workunit.client.0.smithi110.stdout:0/871: rename d0/d27/d4b/da0/d100 to d0/d14/d23/d6d/dde/d125 0 2024-04-22T00:09:19.215 INFO:tasks.workunit.client.0.smithi110.stdout:0/872: chown d0/d16/d5d/dc5/f112 34 1 2024-04-22T00:09:19.284 INFO:tasks.workunit.client.0.smithi110.stdout:1/849: creat d1/d2/d14/d10f/f125 x:0 0 0 2024-04-22T00:09:19.511 INFO:tasks.workunit.client.0.smithi110.stdout:5/879: creat d7/d9/d17/d48/f103 x:0 0 0 2024-04-22T00:09:19.752 INFO:tasks.workunit.client.0.smithi110.stdout:7/895: truncate d10/d45/d51/d88/d46/d69/f12f 751984 0 2024-04-22T00:09:19.768 INFO:tasks.workunit.client.0.smithi110.stdout:4/801: write d1/d35/d6b/df2/d20/d58/d7e/fe7 [3539927,53619] 0 2024-04-22T00:09:19.813 INFO:tasks.workunit.client.0.smithi110.stdout:7/896: readlink d10/d43/l10b 0 2024-04-22T00:09:19.908 INFO:tasks.workunit.client.0.smithi110.stdout:7/897: chown d10/d45/d60/d5e/d65/fbc 28 1 2024-04-22T00:09:20.055 INFO:tasks.workunit.client.0.smithi110.stdout:3/884: link f1 d6/d12/d3c/d8d/dee/f12f 0 2024-04-22T00:09:20.115 INFO:tasks.workunit.client.0.smithi110.stdout:5/880: mknod d7/d9/d17/d48/d69/d6d/c104 0 2024-04-22T00:09:20.344 INFO:tasks.workunit.client.0.smithi110.stdout:3/885: sync 2024-04-22T00:09:21.001 INFO:tasks.workunit.client.0.smithi110.stdout:2/921: rename d9/d1a/d1d/d2b/d5b/d107 to d9/d25/d1b/d135 0 2024-04-22T00:09:21.009 INFO:tasks.workunit.client.0.smithi110.stdout:8/936: write d5/d74/fd3 [192511,35721] 0 2024-04-22T00:09:21.314 INFO:tasks.workunit.client.0.smithi110.stdout:0/873: link d0/d27/l9d d0/d27/d4b/d7f/dc1/l126 0 2024-04-22T00:09:21.523 INFO:tasks.workunit.client.0.smithi110.stdout:2/922: mkdir d9/d1a/d1d/d2b/d5b/dd2/de7/df0/d136 0 2024-04-22T00:09:21.854 INFO:tasks.workunit.client.0.smithi110.stdout:3/886: mknod d6/d12/d16/d6f/db5/d127/c130 0 2024-04-22T00:09:22.055 INFO:tasks.workunit.client.0.smithi110.stdout:6/884: write d16/d3d/d97/fa4 [4349985,79237] 0 2024-04-22T00:09:22.289 INFO:tasks.workunit.client.0.smithi110.stdout:0/874: symlink d0/d56/da3/d106/l127 0 2024-04-22T00:09:22.594 INFO:tasks.workunit.client.0.smithi110.stdout:2/923: mknod d9/d25/d1b/d45/d8e/c137 0 2024-04-22T00:09:23.227 INFO:tasks.workunit.client.0.smithi110.stdout:9/870: rename d1/d29/d4d/l5a to d1/d52/l10a 0 2024-04-22T00:09:23.438 INFO:tasks.workunit.client.0.smithi110.stdout:0/875: symlink d0/d27/d4b/d7f/l128 0 2024-04-22T00:09:23.470 INFO:tasks.workunit.client.0.smithi110.stdout:0/876: stat d0/d27/d4b/d7f/l92 0 2024-04-22T00:09:23.564 INFO:tasks.workunit.client.0.smithi110.stdout:2/924: truncate d9/d25/d1b/d45/d50/dc8/f108 372832 0 2024-04-22T00:09:23.661 INFO:tasks.workunit.client.0.smithi110.stdout:8/937: link d5/da/d17/d6c/d72/da0/ff3 d5/da/d17/d7c/dc0/f137 0 2024-04-22T00:09:23.717 INFO:tasks.workunit.client.0.smithi110.stdout:1/850: write d1/dd/d23/d48/fe2 [365076,82720] 0 2024-04-22T00:09:23.794 INFO:tasks.workunit.client.0.smithi110.stdout:8/938: chown d5/da/d17/d7c/d128/d33/d3d/d82/da8/cae 243566778 1 2024-04-22T00:09:23.828 INFO:tasks.workunit.client.0.smithi110.stdout:8/939: readlink d5/da/d17/d6c/d95/d98/le0 0 2024-04-22T00:09:23.957 INFO:tasks.workunit.client.0.smithi110.stdout:3/887: rename d6/d12/d16/d6f/d7a/c8c to d6/d12/d16/d30/dc7/c131 0 2024-04-22T00:09:24.331 INFO:tasks.workunit.client.0.smithi110.stdout:4/802: dwrite d1/d35/d6b/df2/d20/d23/d1c/dae/fc2 [0,4194304] 0 2024-04-22T00:09:24.592 INFO:tasks.workunit.client.0.smithi110.stdout:2/925: mknod d9/d1a/d123/c138 0 2024-04-22T00:09:24.753 INFO:tasks.workunit.client.0.smithi110.stdout:7/898: mkdir d10/d135 0 2024-04-22T00:09:24.911 INFO:tasks.workunit.client.0.smithi110.stdout:7/899: stat d10/d45/d51/db1/dee 0 2024-04-22T00:09:24.932 INFO:tasks.workunit.client.0.smithi110.stdout:5/881: dwrite d7/d9/f3d [0,4194304] 0 2024-04-22T00:09:25.038 INFO:tasks.workunit.client.0.smithi110.stdout:3/888: creat d6/d12/d14/d4b/f132 x:0 0 0 2024-04-22T00:09:25.139 INFO:tasks.workunit.client.0.smithi110.stdout:5/882: write d7/d9/f3d [3805847,39680] 0 2024-04-22T00:09:25.522 INFO:tasks.workunit.client.0.smithi110.stdout:2/926: symlink d9/d1a/d7b/l139 0 2024-04-22T00:09:26.038 INFO:tasks.workunit.client.0.smithi110.stdout:3/889: unlink d6/d12/d16/d5d/c82 0 2024-04-22T00:09:26.182 INFO:tasks.workunit.client.0.smithi110.stdout:9/871: getdents d1/d29/d4d/dac 0 2024-04-22T00:09:26.519 INFO:tasks.workunit.client.0.smithi110.stdout:4/803: symlink d1/d35/d6b/df2/d20/d23/d1c/d47/l125 0 2024-04-22T00:09:26.534 INFO:tasks.workunit.client.0.smithi110.stdout:6/885: dwrite d16/d1e/d24/d7b/f111 [0,4194304] 0 2024-04-22T00:09:26.661 INFO:tasks.workunit.client.0.smithi110.stdout:5/883: fdatasync d7/d24/d49/d61/fbe 0 2024-04-22T00:09:27.274 INFO:tasks.workunit.client.0.smithi110.stdout:0/877: getdents d0/d56/da3/d106 0 2024-04-22T00:09:27.275 INFO:tasks.workunit.client.0.smithi110.stdout:2/927: creat d9/d1a/d1d/d2b/d5b/d112/f13a x:0 0 0 2024-04-22T00:09:27.715 INFO:tasks.workunit.client.0.smithi110.stdout:9/872: creat d1/d29/d2a/d6/d1d/f10b x:0 0 0 2024-04-22T00:09:27.826 INFO:tasks.workunit.client.0.smithi110.stdout:1/851: dwrite d1/d2/d14/f9d [4194304,4194304] 0 2024-04-22T00:09:28.014 INFO:tasks.workunit.client.0.smithi110.stdout:6/886: rmdir d16/d3d/d40/d46 39 2024-04-22T00:09:28.303 INFO:tasks.workunit.client.0.smithi110.stdout:4/804: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/d7a/f126 x:0 0 0 2024-04-22T00:09:28.698 INFO:tasks.workunit.client.0.smithi110.stdout:7/900: creat d10/d45/d51/d88/d46/f136 x:0 0 0 2024-04-22T00:09:28.744 INFO:tasks.workunit.client.0.smithi110.stdout:7/901: chown d10/d45/d60/d5e/d65/da3/fd0 2 1 2024-04-22T00:09:28.871 INFO:tasks.workunit.client.0.smithi110.stdout:0/878: creat d0/d27/d68/f129 x:0 0 0 2024-04-22T00:09:29.207 INFO:tasks.workunit.client.0.smithi110.stdout:8/940: dwrite d5/d6f/f89 [0,4194304] 0 2024-04-22T00:09:29.424 INFO:tasks.workunit.client.0.smithi110.stdout:9/873: creat d1/d29/d4d/dac/db8/f10c x:0 0 0 2024-04-22T00:09:29.474 INFO:tasks.workunit.client.0.smithi110.stdout:8/941: sync 2024-04-22T00:09:29.500 INFO:tasks.workunit.client.0.smithi110.stdout:1/852: symlink d1/d2/d30/d8b/dc3/l126 0 2024-04-22T00:09:29.705 INFO:tasks.workunit.client.0.smithi110.stdout:6/887: creat d16/d1e/d24/d90/dec/f12f x:0 0 0 2024-04-22T00:09:30.081 INFO:tasks.workunit.client.0.smithi110.stdout:2/928: mkdir d9/d1a/d1d/d4a/d109/d13b 0 2024-04-22T00:09:30.497 INFO:tasks.workunit.client.0.smithi110.stdout:0/879: truncate d0/d14/d23/f3a 1352024 0 2024-04-22T00:09:30.893 INFO:tasks.workunit.client.0.smithi110.stdout:8/942: mknod d5/da/dac/dc6/c138 0 2024-04-22T00:09:31.040 INFO:tasks.workunit.client.0.smithi110.stdout:1/853: truncate d1/dd/d23/d48/d4e/d86/fc4 596288 0 2024-04-22T00:09:31.201 INFO:tasks.workunit.client.0.smithi110.stdout:6/888: truncate d16/d3d/fc6 678323 0 2024-04-22T00:09:31.587 INFO:tasks.workunit.client.0.smithi110.stdout:3/890: getdents d6/d12/d16/d6f/db5/d127 0 2024-04-22T00:09:31.710 INFO:tasks.workunit.client.0.smithi110.stdout:5/884: dwrite d7/d9/f33 [4194304,4194304] 0 2024-04-22T00:09:32.162 INFO:tasks.workunit.client.0.smithi110.stdout:1/854: creat d1/d2/d30/f127 x:0 0 0 2024-04-22T00:09:32.366 INFO:tasks.workunit.client.0.smithi110.stdout:6/889: mkdir d16/d1d/d38/d48/d5e/d6a/d70/d86/d110/d130 0 2024-04-22T00:09:33.058 INFO:tasks.workunit.client.0.smithi110.stdout:3/891: rename d6/d12/d16/f39 to d6/d12/d16/d6f/d7a/d125/f133 0 2024-04-22T00:09:33.330 INFO:tasks.workunit.client.0.smithi110.stdout:0/880: symlink d0/d14/d23/l12a 0 2024-04-22T00:09:33.434 INFO:tasks.workunit.client.0.smithi110.stdout:9/874: rmdir d1/d29/d2a/d2b/d58/d7b/dc1 0 2024-04-22T00:09:34.081 INFO:tasks.workunit.client.0.smithi110.stdout:7/902: link d10/d45/d51/db1/dc9/df5/c28 d10/d45/d60/c137 0 2024-04-22T00:09:34.601 INFO:tasks.workunit.client.0.smithi110.stdout:3/892: dread d6/d12/d14/d4b/f5f [0,4194304] 0 2024-04-22T00:09:34.614 INFO:tasks.workunit.client.0.smithi110.stdout:0/881: chown d0/d2a/fd1 1445557 1 2024-04-22T00:09:34.753 INFO:tasks.workunit.client.0.smithi110.stdout:3/893: sync 2024-04-22T00:09:35.042 INFO:tasks.workunit.client.0.smithi110.stdout:9/875: creat d1/d29/d2a/d6/f10d x:0 0 0 2024-04-22T00:09:35.175 INFO:tasks.workunit.client.0.smithi110.stdout:1/855: creat d1/dd/d23/d48/d4e/ddc/d117/f128 x:0 0 0 2024-04-22T00:09:35.911 INFO:tasks.workunit.client.0.smithi110.stdout:0/882: symlink d0/d27/d4b/da0/da4/l12b 0 2024-04-22T00:09:36.015 INFO:tasks.workunit.client.0.smithi110.stdout:4/805: dwrite d1/d35/f33 [0,4194304] 0 2024-04-22T00:09:36.161 INFO:tasks.workunit.client.0.smithi110.stdout:3/894: fsync d6/f3a 0 2024-04-22T00:09:36.175 INFO:tasks.workunit.client.0.smithi110.stdout:8/943: write d5/da/d17/d7c/d128/f2c [272721,100516] 0 2024-04-22T00:09:36.323 INFO:tasks.workunit.client.0.smithi110.stdout:1/856: mknod d1/d1d/d70/c129 0 2024-04-22T00:09:36.332 INFO:tasks.workunit.client.0.smithi110.stdout:2/929: dwrite d9/d1a/d1d/f75 [0,4194304] 0 2024-04-22T00:09:36.463 INFO:tasks.workunit.client.0.smithi110.stdout:7/903: fdatasync d10/d45/d60/dbb/fca 0 2024-04-22T00:09:36.642 INFO:tasks.workunit.client.0.smithi110.stdout:2/930: chown d9/d1a/d1d/d7a/d91/dac 4 1 2024-04-22T00:09:36.919 INFO:tasks.workunit.client.0.smithi110.stdout:5/885: write d7/d24/d37/d38/f4d [11450782,55811] 0 2024-04-22T00:09:37.619 INFO:tasks.workunit.client.0.smithi110.stdout:3/895: creat d6/d12/d16/d6f/db5/db9/dc6/d10d/f134 x:0 0 0 2024-04-22T00:09:37.684 INFO:tasks.workunit.client.0.smithi110.stdout:7/904: mkdir d10/d45/d51/d88/d93/d138 0 2024-04-22T00:09:37.721 INFO:tasks.workunit.client.0.smithi110.stdout:7/905: read d10/f1d [1624377,15600] 0 2024-04-22T00:09:37.743 INFO:tasks.workunit.client.0.smithi110.stdout:7/906: stat d10/d15/d95/d101 0 2024-04-22T00:09:37.783 INFO:tasks.workunit.client.0.smithi110.stdout:7/907: stat d10/d45/d51/d88/fb3 0 2024-04-22T00:09:37.842 INFO:tasks.workunit.client.0.smithi110.stdout:6/890: write d16/d1d/d38/d48/d5e/d6a/d70/fa3 [266965,87432] 0 2024-04-22T00:09:37.915 INFO:tasks.workunit.client.0.smithi110.stdout:2/931: fsync d9/d1a/d1d/d4a/d6b/d3a/f61 0 2024-04-22T00:09:38.027 INFO:tasks.workunit.client.0.smithi110.stdout:5/886: mkdir d7/d35/dc0/d105 0 2024-04-22T00:09:38.683 INFO:tasks.workunit.client.0.smithi110.stdout:3/896: creat d6/d12/d16/d6f/db5/db9/dc6/d10d/f135 x:0 0 0 2024-04-22T00:09:38.877 INFO:tasks.workunit.client.0.smithi110.stdout:4/806: rename d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/c90 to d1/d35/d6b/df2/d20/df5/c127 0 2024-04-22T00:09:38.995 INFO:tasks.workunit.client.0.smithi110.stdout:6/891: fdatasync d16/d1d/f2f 0 2024-04-22T00:09:39.290 INFO:tasks.workunit.client.0.smithi110.stdout:9/876: mknod d1/d29/c10e 0 2024-04-22T00:09:39.326 INFO:tasks.workunit.client.0.smithi110.stdout:9/877: stat d1/d29/d2a/d6/d1d/f84 0 2024-04-22T00:09:39.473 INFO:tasks.workunit.client.0.smithi110.stdout:3/897: creat d6/d12/d3c/d8d/dee/f136 x:0 0 0 2024-04-22T00:09:40.118 INFO:tasks.workunit.client.0.smithi110.stdout:2/932: symlink d9/d1a/d1d/d4a/d6b/d3a/l13c 0 2024-04-22T00:09:40.249 INFO:tasks.workunit.client.0.smithi110.stdout:9/878: symlink d1/d29/d2a/d2b/d57/l10f 0 2024-04-22T00:09:40.330 INFO:tasks.workunit.client.0.smithi110.stdout:2/933: chown d9/d25/d1c/ld8 1292670742 1 2024-04-22T00:09:40.337 INFO:tasks.workunit.client.0.smithi110.stdout:6/892: dread d16/d3d/d97/fa4 [0,4194304] 0 2024-04-22T00:09:40.443 INFO:tasks.workunit.client.0.smithi110.stdout:6/893: chown d16/d3d/d97/dd0/fb0 22142600 1 2024-04-22T00:09:40.463 INFO:tasks.workunit.client.0.smithi110.stdout:3/898: creat d6/d12/d16/d6f/db5/db9/dc6/f137 x:0 0 0 2024-04-22T00:09:40.494 INFO:tasks.workunit.client.0.smithi110.stdout:2/934: chown d9/d25/d1b/d45/d50/d68/da4/fb9 8668 1 2024-04-22T00:09:40.971 INFO:tasks.workunit.client.0.smithi110.stdout:5/887: rename d7/d9/f33 to d7/d22/d5b/f106 0 2024-04-22T00:09:41.073 INFO:tasks.workunit.client.0.smithi110.stdout:9/879: dread d1/d29/d2a/dc/f40 [0,4194304] 0 2024-04-22T00:09:41.240 INFO:tasks.workunit.client.0.smithi110.stdout:2/935: dread d9/d1a/d1d/de8/ff4 [0,4194304] 0 2024-04-22T00:09:41.241 INFO:tasks.workunit.client.0.smithi110.stdout:6/894: creat d16/d1d/d38/d48/d5e/d6a/d70/d86/d110/f131 x:0 0 0 2024-04-22T00:09:41.898 INFO:tasks.workunit.client.0.smithi110.stdout:5/888: mkdir d7/d35/d107 0 2024-04-22T00:09:41.921 INFO:tasks.workunit.client.0.smithi110.stdout:2/936: symlink d9/d25/d1b/d45/d50/dc8/l13d 0 2024-04-22T00:09:41.927 INFO:tasks.workunit.client.0.smithi110.stdout:9/880: read - d1/d29/d2a/d6/f109 zero size 2024-04-22T00:09:41.980 INFO:tasks.workunit.client.0.smithi110.stdout:6/895: creat d16/d1d/d38/d48/d5e/d6a/d70/d74/f132 x:0 0 0 2024-04-22T00:09:42.012 INFO:tasks.workunit.client.0.smithi110.stdout:8/944: write d5/da/d17/d7c/dc0/f94 [462334,28292] 0 2024-04-22T00:09:42.121 INFO:tasks.workunit.client.0.smithi110.stdout:6/896: readlink d16/d1e/da8/l123 0 2024-04-22T00:09:42.252 INFO:tasks.workunit.client.0.smithi110.stdout:1/857: write d1/d2/d14/d10f/f116 [629538,36313] 0 2024-04-22T00:09:42.648 INFO:tasks.workunit.client.0.smithi110.stdout:1/858: chown d1/d2/d1b/d10/d5c/d77/d78/fff 5 1 2024-04-22T00:09:42.648 INFO:tasks.workunit.client.0.smithi110.stdout:5/889: fsync d7/d35/f4c 0 2024-04-22T00:09:42.648 INFO:tasks.workunit.client.0.smithi110.stdout:5/890: chown d7/d24/d3a/d54/l102 28 1 2024-04-22T00:09:42.648 INFO:tasks.workunit.client.0.smithi110.stdout:2/937: creat d9/d25/d1b/d45/d4d/f13e x:0 0 0 2024-04-22T00:09:43.129 INFO:tasks.workunit.client.0.smithi110.stdout:9/881: truncate d1/d29/d6f/db4/fdf 317864 0 2024-04-22T00:09:43.227 INFO:tasks.workunit.client.0.smithi110.stdout:6/897: mknod d16/d1e/d24/d66/c133 0 2024-04-22T00:09:43.241 INFO:tasks.workunit.client.0.smithi110.stdout:1/859: symlink d1/d2/d30/l12a 0 2024-04-22T00:09:43.527 INFO:tasks.workunit.client.0.smithi110.stdout:0/883: dwrite d0/d56/f119 [4194304,4194304] 0 2024-04-22T00:09:43.644 INFO:tasks.workunit.client.0.smithi110.stdout:2/938: fsync d9/d25/d1b/d45/f80 0 2024-04-22T00:09:43.877 INFO:tasks.workunit.client.0.smithi110.stdout:7/908: write d10/d45/d51/db1/ff2 [616934,60720] 0 2024-04-22T00:09:44.371 INFO:tasks.workunit.client.0.smithi110.stdout:1/860: mknod d1/d2/d30/c12b 0 2024-04-22T00:09:44.694 INFO:tasks.workunit.client.0.smithi110.stdout:0/884: mkdir d0/d27/d68/d12c 0 2024-04-22T00:09:44.799 INFO:tasks.workunit.client.0.smithi110.stdout:6/898: dread d16/d1e/d24/d33/f34 [0,4194304] 0 2024-04-22T00:09:44.815 INFO:tasks.workunit.client.0.smithi110.stdout:2/939: mknod d9/d1a/d123/c13f 0 2024-04-22T00:09:45.333 INFO:tasks.workunit.client.0.smithi110.stdout:1/861: dread - d1/d2/d1b/d10/d5c/dc5/d27/d3e/fe6 zero size 2024-04-22T00:09:45.618 INFO:tasks.workunit.client.0.smithi110.stdout:0/885: creat d0/d25/d5a/d63/f12d x:0 0 0 2024-04-22T00:09:45.630 INFO:tasks.workunit.client.0.smithi110.stdout:3/899: write d6/d12/d16/d5d/f7d [1023303,69755] 0 2024-04-22T00:09:45.950 INFO:tasks.workunit.client.0.smithi110.stdout:1/862: fdatasync d1/d2/d30/d8b/dc3/f105 0 2024-04-22T00:09:46.341 INFO:tasks.workunit.client.0.smithi110.stdout:0/886: creat d0/d56/dc9/f12e x:0 0 0 2024-04-22T00:09:46.554 INFO:tasks.workunit.client.0.smithi110.stdout:3/900: rename d6/d12/d16/d30/d9c to d6/d12/d50/d138 0 2024-04-22T00:09:46.750 INFO:tasks.workunit.client.0.smithi110.stdout:1/863: mkdir d1/d2/d14/d10f/d12c 0 2024-04-22T00:09:47.065 INFO:tasks.workunit.client.0.smithi110.stdout:0/887: fsync d0/d16/d42/d50/dbc/dc8/fe2 0 2024-04-22T00:09:47.570 INFO:tasks.workunit.client.0.smithi110.stdout:2/940: getdents d9/d1a/d1d/d2b/d5b/dd2 0 2024-04-22T00:09:47.948 INFO:tasks.workunit.client.0.smithi110.stdout:1/864: mkdir d1/d1d/d70/de4/d12d 0 2024-04-22T00:09:48.151 INFO:tasks.workunit.client.0.smithi110.stdout:8/945: dwrite d5/da/f63 [0,4194304] 0 2024-04-22T00:09:48.349 INFO:tasks.workunit.client.0.smithi110.stdout:2/941: fdatasync d9/d1a/d1d/d7a/d91/fa3 0 2024-04-22T00:09:48.608 INFO:tasks.workunit.client.0.smithi110.stdout:2/942: dread d9/f49 [0,4194304] 0 2024-04-22T00:09:48.936 INFO:tasks.workunit.client.0.smithi110.stdout:2/943: sync 2024-04-22T00:09:49.108 INFO:tasks.workunit.client.0.smithi110.stdout:4/807: symlink d1/d35/d6b/df2/d20/l128 0 2024-04-22T00:09:49.738 INFO:tasks.workunit.client.0.smithi110.stdout:9/882: dwrite d1/d29/d2a/ff8 [0,4194304] 0 2024-04-22T00:09:50.066 INFO:tasks.workunit.client.0.smithi110.stdout:4/808: creat d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/f129 x:0 0 0 2024-04-22T00:09:50.110 INFO:tasks.workunit.client.0.smithi110.stdout:5/891: dwrite d7/d9/d17/d48/d69/d6d/fff [0,4194304] 0 2024-04-22T00:09:50.411 INFO:tasks.workunit.client.0.smithi110.stdout:7/909: write d10/d45/d51/d58/ff6 [879263,59161] 0 2024-04-22T00:09:50.650 INFO:tasks.workunit.client.0.smithi110.stdout:4/809: mkdir d1/d35/d6b/df2/d20/d50/d12a 0 2024-04-22T00:09:51.053 INFO:tasks.workunit.client.0.smithi110.stdout:4/810: unlink d1/d35/d6b/df2/d20/d50/lfa 0 2024-04-22T00:09:51.413 INFO:tasks.workunit.client.0.smithi110.stdout:6/899: dwrite d16/d1e/fc7 [0,4194304] 0 2024-04-22T00:09:52.301 INFO:tasks.workunit.client.0.smithi110.stdout:3/901: dwrite d6/d12/d14/fdb [0,4194304] 0 2024-04-22T00:09:52.428 INFO:tasks.workunit.client.0.smithi110.stdout:0/888: dwrite d0/d14/d23/d3b/fb5 [0,4194304] 0 2024-04-22T00:09:53.262 INFO:tasks.workunit.client.0.smithi110.stdout:0/889: mkdir d0/d27/d4b/da0/da4/d114/d12f 0 2024-04-22T00:09:53.685 INFO:tasks.workunit.client.0.smithi110.stdout:5/892: write d7/d24/d3a/d54/ffe [3831941,6543] 0 2024-04-22T00:09:54.316 INFO:tasks.workunit.client.0.smithi110.stdout:9/883: unlink d1/f15 0 2024-04-22T00:09:54.430 INFO:tasks.workunit.client.0.smithi110.stdout:6/900: write d16/d3d/ff8 [189756,51572] 0 2024-04-22T00:09:54.811 INFO:tasks.workunit.client.0.smithi110.stdout:1/865: dwrite d1/d2/d1b/f9 [0,4194304] 0 2024-04-22T00:09:54.943 INFO:tasks.workunit.client.0.smithi110.stdout:8/946: dwrite d5/f3f [0,4194304] 0 2024-04-22T00:09:54.948 INFO:tasks.workunit.client.0.smithi110.stdout:2/944: dwrite d9/d1a/d1d/d2b/d54/d77/f99 [4194304,4194304] 0 2024-04-22T00:09:55.077 INFO:tasks.workunit.client.0.smithi110.stdout:3/902: write d6/f19 [1512446,66186] 0 2024-04-22T00:09:55.095 INFO:tasks.workunit.client.0.smithi110.stdout:7/910: dwrite d10/d45/d51/d88/d46/d11c/f130 [0,4194304] 0 2024-04-22T00:09:55.309 INFO:tasks.workunit.client.0.smithi110.stdout:5/893: creat d7/d35/dd6/dfb/f108 x:0 0 0 2024-04-22T00:09:55.551 INFO:tasks.workunit.client.0.smithi110.stdout:5/894: chown d7/d22/d5b 0 1 2024-04-22T00:09:55.555 INFO:tasks.workunit.client.0.smithi110.stdout:4/811: dwrite d1/d35/d6b/df2/d20/d50/f70 [0,4194304] 0 2024-04-22T00:09:55.685 INFO:tasks.workunit.client.0.smithi110.stdout:2/945: chown d9/d1a/d1d/d4e/f9a 5245753 1 2024-04-22T00:09:55.962 INFO:tasks.workunit.client.0.smithi110.stdout:0/890: dwrite d0/d2a/fdc [0,4194304] 0 2024-04-22T00:09:56.238 INFO:tasks.workunit.client.0.smithi110.stdout:8/947: symlink d5/da/d17/dbf/l139 0 2024-04-22T00:09:56.254 INFO:tasks.workunit.client.0.smithi110.stdout:1/866: rename d1/dd/d23/f96 to d1/dd/f12e 0 2024-04-22T00:09:56.495 INFO:tasks.workunit.client.0.smithi110.stdout:0/891: dread d0/d16/fa6 [0,4194304] 0 2024-04-22T00:09:56.529 INFO:tasks.workunit.client.0.smithi110.stdout:7/911: fsync d10/d45/d51/d88/dce/fda 0 2024-04-22T00:09:56.809 INFO:tasks.workunit.client.0.smithi110.stdout:7/912: sync 2024-04-22T00:09:56.890 INFO:tasks.workunit.client.0.smithi110.stdout:4/812: symlink d1/d35/d6b/dec/l12b 0 2024-04-22T00:09:56.926 INFO:tasks.workunit.client.0.smithi110.stdout:2/946: dread d9/d1a/d1d/f75 [0,4194304] 0 2024-04-22T00:09:56.943 INFO:tasks.workunit.client.0.smithi110.stdout:3/903: write d6/d12/d3c/f12b [617911,29840] 0 2024-04-22T00:09:57.013 INFO:tasks.workunit.client.0.smithi110.stdout:7/913: dread - d10/d45/d60/d5e/d65/d8a/deb/f116 zero size 2024-04-22T00:09:57.064 INFO:tasks.workunit.client.0.smithi110.stdout:3/904: chown d6/d12/d16/d6f/dab 2374 1 2024-04-22T00:09:57.096 INFO:tasks.workunit.client.0.smithi110.stdout:4/813: chown d1/d35/d6b/df2/d20/d23/c16 21 1 2024-04-22T00:09:57.098 INFO:tasks.workunit.client.0.smithi110.stdout:7/914: chown d10/f34 5875 1 2024-04-22T00:09:57.165 INFO:tasks.workunit.client.0.smithi110.stdout:3/905: readlink d6/d12/d14/lc9 0 2024-04-22T00:09:57.435 INFO:tasks.workunit.client.0.smithi110.stdout:6/901: write d16/d1e/da8/fe3 [4025202,95048] 0 2024-04-22T00:09:57.789 INFO:tasks.workunit.client.0.smithi110.stdout:1/867: dread d1/d2/d1b/f13 [0,4194304] 0 2024-04-22T00:09:57.958 INFO:tasks.workunit.client.0.smithi110.stdout:5/895: mkdir d7/d22/d5b/d109 0 2024-04-22T00:09:57.959 INFO:tasks.workunit.client.0.smithi110.stdout:0/892: creat d0/d27/dcd/df2/f130 x:0 0 0 2024-04-22T00:09:58.964 INFO:tasks.workunit.client.0.smithi110.stdout:3/906: dread d6/d12/d16/d30/fb7 [0,4194304] 0 2024-04-22T00:09:58.987 INFO:tasks.workunit.client.0.smithi110.stdout:8/948: dwrite d5/da/d17/d6c/fb5 [0,4194304] 0 2024-04-22T00:09:59.106 INFO:tasks.workunit.client.0.smithi110.stdout:4/814: write d1/d35/df6/f111 [748103,33570] 0 2024-04-22T00:09:59.516 INFO:tasks.workunit.client.0.smithi110.stdout:8/949: dwrite d5/f3f [4194304,4194304] 0 2024-04-22T00:09:59.698 INFO:tasks.workunit.client.0.smithi110.stdout:7/915: write d10/d45/d60/d5e/d65/da3/f10d [72174,61184] 0 2024-04-22T00:09:59.944 INFO:tasks.workunit.client.0.smithi110.stdout:3/907: mknod d6/d12/da1/dc8/c139 0 2024-04-22T00:09:59.952 INFO:tasks.workunit.client.0.smithi110.stdout:4/815: rmdir d1/d35/d6b/df2/d12 39 2024-04-22T00:10:00.020 INFO:tasks.workunit.client.0.smithi110.stdout:6/902: dwrite d16/d1e/d24/d66/f6e [4194304,4194304] 0 2024-04-22T00:10:00.504 INFO:tasks.workunit.client.0.smithi110.stdout:9/884: rename d1/d29/d4d/la7 to d1/d29/d2a/d6/d1d/l110 0 2024-04-22T00:10:00.592 INFO:tasks.workunit.client.0.smithi110.stdout:2/947: creat d9/d1a/d1d/d4a/d6b/d3a/f140 x:0 0 0 2024-04-22T00:10:00.749 INFO:tasks.workunit.client.0.smithi110.stdout:7/916: dread - d10/d45/d60/d5e/d65/da3/f121 zero size 2024-04-22T00:10:00.832 INFO:tasks.workunit.client.0.smithi110.stdout:1/868: dwrite d1/d2/d1b/d10/d5c/d77/fd3 [0,4194304] 0 2024-04-22T00:10:01.104 INFO:tasks.workunit.client.0.smithi110.stdout:3/908: mknod d6/d12/d16/d5d/c13a 0 2024-04-22T00:10:01.313 INFO:tasks.workunit.client.0.smithi110.stdout:4/816: creat d1/d35/d6b/df2/d20/df5/f12c x:0 0 0 2024-04-22T00:10:01.603 INFO:tasks.workunit.client.0.smithi110.stdout:5/896: write d7/d24/d37/d38/d88/dd3/ffc [870645,113162] 0 2024-04-22T00:10:02.032 INFO:tasks.workunit.client.0.smithi110.stdout:2/948: symlink d9/d25/d1b/d45/d126/l141 0 2024-04-22T00:10:02.248 INFO:tasks.workunit.client.0.smithi110.stdout:1/869: creat d1/d1d/d70/f12f x:0 0 0 2024-04-22T00:10:02.308 INFO:tasks.workunit.client.0.smithi110.stdout:0/893: write d0/d27/d4b/da0/f11e [1087887,89775] 0 2024-04-22T00:10:02.368 INFO:tasks.workunit.client.0.smithi110.stdout:3/909: readlink d6/d12/d16/l71 0 2024-04-22T00:10:02.398 INFO:tasks.workunit.client.0.smithi110.stdout:8/950: write d5/da/d17/d60/fc1 [1872564,73281] 0 2024-04-22T00:10:03.379 INFO:tasks.workunit.client.0.smithi110.stdout:7/917: symlink d10/d45/d51/d88/l139 0 2024-04-22T00:10:03.448 INFO:tasks.workunit.client.0.smithi110.stdout:1/870: read d1/d1d/d4a/fb0 [1788894,9283] 0 2024-04-22T00:10:03.587 INFO:tasks.workunit.client.0.smithi110.stdout:3/910: mknod d6/d12/da1/c13b 0 2024-04-22T00:10:03.689 INFO:tasks.workunit.client.0.smithi110.stdout:8/951: truncate d5/d4f/f5f 394113 0 2024-04-22T00:10:04.326 INFO:tasks.workunit.client.0.smithi110.stdout:9/885: rename d1/d29/d2a/c66 to d1/d29/d2a/d2b/c111 0 2024-04-22T00:10:04.344 INFO:tasks.workunit.client.0.smithi110.stdout:2/949: mknod d9/d1a/d1d/d4e/db5/d130/c142 0 2024-04-22T00:10:04.410 INFO:tasks.workunit.client.0.smithi110.stdout:2/950: chown d9/d25/d1c/d82/f9f 1 1 2024-04-22T00:10:04.533 INFO:tasks.workunit.client.0.smithi110.stdout:0/894: unlink d0/d27/l3c 0 2024-04-22T00:10:04.573 INFO:tasks.workunit.client.0.smithi110.stdout:0/895: chown d0/d14/d23/fe7 7051 1 2024-04-22T00:10:04.625 INFO:tasks.workunit.client.0.smithi110.stdout:8/952: truncate d5/da/d17/d6c/d95/f12f 416590 0 2024-04-22T00:10:04.996 INFO:tasks.workunit.client.0.smithi110.stdout:9/886: dread - d1/fea zero size 2024-04-22T00:10:05.129 INFO:tasks.workunit.client.0.smithi110.stdout:4/817: rename d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/d7a to d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d 0 2024-04-22T00:10:05.147 INFO:tasks.workunit.client.0.smithi110.stdout:5/897: rename d7/d24 to d7/d24/d3a/d10a 22 2024-04-22T00:10:05.435 INFO:tasks.workunit.client.0.smithi110.stdout:1/871: creat d1/d2/d30/d8b/dc3/df0/f130 x:0 0 0 2024-04-22T00:10:05.541 INFO:tasks.workunit.client.0.smithi110.stdout:1/872: readlink d1/dd/d23/l2e 0 2024-04-22T00:10:05.598 INFO:tasks.workunit.client.0.smithi110.stdout:0/896: mknod d0/d16/d5d/c131 0 2024-04-22T00:10:05.846 INFO:tasks.workunit.client.0.smithi110.stdout:9/887: fsync d1/d29/d4d/f8e 0 2024-04-22T00:10:05.877 INFO:tasks.workunit.client.0.smithi110.stdout:6/903: dwrite d16/d1d/d38/dab/f119 [0,4194304] 0 2024-04-22T00:10:06.040 INFO:tasks.workunit.client.0.smithi110.stdout:7/918: rename d10/d45/d51/d88/d46/d69/c9f to d10/d45/d51/db1/dc9/df5/d2c/c13a 0 2024-04-22T00:10:06.282 INFO:tasks.workunit.client.0.smithi110.stdout:1/873: dwrite d1/d2/d14/f64 [0,4194304] 0 2024-04-22T00:10:06.443 INFO:tasks.workunit.client.0.smithi110.stdout:5/898: fdatasync d7/d9/d17/d48/d69/fa4 0 2024-04-22T00:10:06.840 INFO:tasks.workunit.client.0.smithi110.stdout:8/953: symlink d5/da/d17/d6c/d72/l13a 0 2024-04-22T00:10:07.314 INFO:tasks.workunit.client.0.smithi110.stdout:9/888: fdatasync d1/d29/d2a/d2b/f8d 0 2024-04-22T00:10:07.566 INFO:tasks.workunit.client.0.smithi110.stdout:6/904: creat d16/d1d/d38/d48/d5e/d6a/f134 x:0 0 0 2024-04-22T00:10:07.729 INFO:tasks.workunit.client.0.smithi110.stdout:7/919: dread d10/d27/f82 [0,4194304] 0 2024-04-22T00:10:08.502 INFO:tasks.workunit.client.0.smithi110.stdout:8/954: truncate d5/d6f/f70 1542168 0 2024-04-22T00:10:08.509 INFO:tasks.workunit.client.0.smithi110.stdout:1/874: fsync d1/d2/d1b/d10/d5c/d77/d78/deb/fa3 0 2024-04-22T00:10:08.517 INFO:tasks.workunit.client.0.smithi110.stdout:3/911: write d6/d12/d16/d30/d67/f92 [1025035,13856] 0 2024-04-22T00:10:08.789 INFO:tasks.workunit.client.0.smithi110.stdout:9/889: fdatasync d1/d29/d2a/dc/f67 0 2024-04-22T00:10:09.161 INFO:tasks.workunit.client.0.smithi110.stdout:2/951: dwrite d9/d25/de5/f132 [0,4194304] 0 2024-04-22T00:10:09.408 INFO:tasks.workunit.client.0.smithi110.stdout:6/905: dread d16/d3d/d40/d46/f6d [0,4194304] 0 2024-04-22T00:10:10.194 INFO:tasks.workunit.client.0.smithi110.stdout:1/875: mknod d1/d2/d30/d8b/dc3/df0/c131 0 2024-04-22T00:10:10.596 INFO:tasks.workunit.client.0.smithi110.stdout:2/952: truncate d9/d1a/d1d/d2b/d54/d77/fa6 989794 0 2024-04-22T00:10:10.604 INFO:tasks.workunit.client.0.smithi110.stdout:9/890: dread d1/d29/d2a/d2b/d57/f5c [0,4194304] 0 2024-04-22T00:10:10.645 INFO:tasks.workunit.client.0.smithi110.stdout:0/897: write d0/d56/f109 [624514,54025] 0 2024-04-22T00:10:10.800 INFO:tasks.workunit.client.0.smithi110.stdout:7/920: mkdir d10/d13b 0 2024-04-22T00:10:11.345 INFO:tasks.workunit.client.0.smithi110.stdout:4/818: dwrite d1/d35/d6b/df2/d20/d58/f104 [0,4194304] 0 2024-04-22T00:10:11.478 INFO:tasks.workunit.client.0.smithi110.stdout:0/898: fdatasync d0/d16/d42/ff5 0 2024-04-22T00:10:11.945 INFO:tasks.workunit.client.0.smithi110.stdout:7/921: rename d10/d45/d51/d88/d46/d69/d75 to d10/d45/d60/d5e/d65/d8a/deb/d13c 0 2024-04-22T00:10:12.008 INFO:tasks.workunit.client.0.smithi110.stdout:1/876: unlink d1/d2/d1b/l104 0 2024-04-22T00:10:12.192 INFO:tasks.workunit.client.0.smithi110.stdout:9/891: fdatasync d1/d29/d6f/f75 0 2024-04-22T00:10:12.253 INFO:tasks.workunit.client.0.smithi110.stdout:5/899: write d7/d24/d49/d61/f8f [1149275,68869] 0 2024-04-22T00:10:12.323 INFO:tasks.workunit.client.0.smithi110.stdout:4/819: truncate d1/fd 8607647 0 2024-04-22T00:10:12.913 INFO:tasks.workunit.client.0.smithi110.stdout:2/953: truncate d9/d1a/d1d/d4a/d6b/d3a/d5c/f6e 2111372 0 2024-04-22T00:10:13.223 INFO:tasks.workunit.client.0.smithi110.stdout:7/922: creat d10/d45/d51/d88/d46/d11c/f13d x:0 0 0 2024-04-22T00:10:13.812 INFO:tasks.workunit.client.0.smithi110.stdout:4/820: mkdir d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d/d12e 0 2024-04-22T00:10:14.348 INFO:tasks.workunit.client.0.smithi110.stdout:9/892: symlink d1/d29/d4d/dac/dbf/l112 0 2024-04-22T00:10:14.824 INFO:tasks.workunit.client.0.smithi110.stdout:4/821: rmdir d1/d35/d6b/df2/d20/d23/d1c/d47/d4f 39 2024-04-22T00:10:14.832 INFO:tasks.workunit.client.0.smithi110.stdout:9/893: chown d1/d29/d6f/dd9/l104 7825816 1 2024-04-22T00:10:14.964 INFO:tasks.workunit.client.0.smithi110.stdout:3/912: dwrite d6/d12/faa [0,4194304] 0 2024-04-22T00:10:14.969 INFO:tasks.workunit.client.0.smithi110.stdout:8/955: dwrite d5/d74/fd3 [0,4194304] 0 2024-04-22T00:10:15.379 INFO:tasks.workunit.client.0.smithi110.stdout:3/913: stat d6/d12/d16/d6f/db5/db9 0 2024-04-22T00:10:15.482 INFO:tasks.workunit.client.0.smithi110.stdout:6/906: dwrite d16/d1e/f11a [0,4194304] 0 2024-04-22T00:10:15.639 INFO:tasks.workunit.client.0.smithi110.stdout:0/899: getdents d0/d27/dcd 0 2024-04-22T00:10:15.692 INFO:tasks.workunit.client.0.smithi110.stdout:3/914: sync 2024-04-22T00:10:16.317 INFO:tasks.workunit.client.0.smithi110.stdout:9/894: fsync d1/d29/d4d/f80 0 2024-04-22T00:10:16.658 INFO:tasks.workunit.client.0.smithi110.stdout:6/907: fdatasync d16/d1d/d38/dfe/f129 0 2024-04-22T00:10:16.671 INFO:tasks.workunit.client.0.smithi110.stdout:0/900: creat d0/d14/d23/d6d/dde/f132 x:0 0 0 2024-04-22T00:10:16.770 INFO:tasks.workunit.client.0.smithi110.stdout:7/923: link d10/d15/f2e d10/d45/d51/d88/d46/d69/f13e 0 2024-04-22T00:10:16.795 INFO:tasks.workunit.client.0.smithi110.stdout:7/924: chown d10/d45/d51/d88 1 1 2024-04-22T00:10:16.821 INFO:tasks.workunit.client.0.smithi110.stdout:7/925: dread - d10/d45/d51/d88/d39/fc6 zero size 2024-04-22T00:10:17.270 INFO:tasks.workunit.client.0.smithi110.stdout:9/895: creat d1/d29/d4d/f113 x:0 0 0 2024-04-22T00:10:17.885 INFO:tasks.workunit.client.0.smithi110.stdout:6/908: symlink d16/d1d/d38/d48/d5e/d6a/db6/l135 0 2024-04-22T00:10:18.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/909: rename d16/d1e/d24/d33/l58 to d16/d1d/d38/dfe/l136 0 2024-04-22T00:10:18.678 INFO:tasks.workunit.client.0.smithi110.stdout:2/954: write d9/d1a/d7b/fc3 [3539366,16110] 0 2024-04-22T00:10:18.682 INFO:tasks.workunit.client.0.smithi110.stdout:1/877: write d1/dd/d23/dcc/f32 [2042504,23895] 0 2024-04-22T00:10:18.778 INFO:tasks.workunit.client.0.smithi110.stdout:6/910: readlink d16/d1d/d38/d48/d5e/d6a/d70/d86/lb4 0 2024-04-22T00:10:18.831 INFO:tasks.workunit.client.0.smithi110.stdout:2/955: read - d9/d25/d1b/d45/d50/d68/fc6 zero size 2024-04-22T00:10:18.941 INFO:tasks.workunit.client.0.smithi110.stdout:9/896: mkdir d1/d29/d2a/d2b/d114 0 2024-04-22T00:10:19.169 INFO:tasks.workunit.client.0.smithi110.stdout:5/900: dwrite d7/d24/d49/f99 [0,4194304] 0 2024-04-22T00:10:19.455 INFO:tasks.workunit.client.0.smithi110.stdout:3/915: write d6/d12/ff8 [668381,55588] 0 2024-04-22T00:10:19.783 INFO:tasks.workunit.client.0.smithi110.stdout:7/926: creat d10/d45/d51/db1/dee/df0/df9/d127/f13f x:0 0 0 2024-04-22T00:10:20.135 INFO:tasks.workunit.client.0.smithi110.stdout:2/956: rmdir d9/d1a/d7b 39 2024-04-22T00:10:20.200 INFO:tasks.workunit.client.0.smithi110.stdout:0/901: dwrite d0/d16/f58 [0,4194304] 0 2024-04-22T00:10:20.376 INFO:tasks.workunit.client.0.smithi110.stdout:4/822: dwrite d1/fe5 [0,4194304] 0 2024-04-22T00:10:20.384 INFO:tasks.workunit.client.0.smithi110.stdout:9/897: mkdir d1/d29/d2a/d6/d115 0 2024-04-22T00:10:20.413 INFO:tasks.workunit.client.0.smithi110.stdout:5/901: mknod d7/d24/d37/d38/d88/dd3/c10b 0 2024-04-22T00:10:20.536 INFO:tasks.workunit.client.0.smithi110.stdout:8/956: dwrite d5/d6f/f89 [0,4194304] 0 2024-04-22T00:10:20.673 INFO:tasks.workunit.client.0.smithi110.stdout:7/927: readlink d10/d45/d51/d88/d39/d7f/d80/l9a 0 2024-04-22T00:10:20.902 INFO:tasks.workunit.client.0.smithi110.stdout:2/957: dread - d9/d25/d1b/d11f/f116 zero size 2024-04-22T00:10:21.380 INFO:tasks.workunit.client.0.smithi110.stdout:5/902: truncate d7/d9/fad 1833354 0 2024-04-22T00:10:21.406 INFO:tasks.workunit.client.0.smithi110.stdout:1/878: write d1/d2/d1b/d10/d5c/d77/d78/ffb [228436,17676] 0 2024-04-22T00:10:21.449 INFO:tasks.workunit.client.0.smithi110.stdout:8/957: rmdir d5/da/d17/d6c/d95/daa 39 2024-04-22T00:10:21.640 INFO:tasks.workunit.client.0.smithi110.stdout:4/823: read - d1/d35/d6b/df2/d20/dbf/d5f/f109 zero size 2024-04-22T00:10:21.815 INFO:tasks.workunit.client.0.smithi110.stdout:0/902: truncate d0/d14/d23/d6d/ff0 4388673 0 2024-04-22T00:10:21.849 INFO:tasks.workunit.client.0.smithi110.stdout:6/911: dwrite d16/d1d/f41 [0,4194304] 0 2024-04-22T00:10:22.096 INFO:tasks.workunit.client.0.smithi110.stdout:2/958: unlink d9/f76 0 2024-04-22T00:10:22.214 INFO:tasks.workunit.client.0.smithi110.stdout:5/903: mkdir d7/d24/d3a/d40/ddc/d10c 0 2024-04-22T00:10:22.333 INFO:tasks.workunit.client.0.smithi110.stdout:8/958: fsync d5/da/d17/d7c/d128/f49 0 2024-04-22T00:10:22.379 INFO:tasks.workunit.client.0.smithi110.stdout:8/959: chown d5/da/d17/d6c/d72/d73 387426 1 2024-04-22T00:10:22.476 INFO:tasks.workunit.client.0.smithi110.stdout:1/879: rmdir d1/d2/d1b/d10/d5c/d77/d78/deb 39 2024-04-22T00:10:23.321 INFO:tasks.workunit.client.0.smithi110.stdout:9/898: truncate d1/d19/f16 3792159 0 2024-04-22T00:10:24.336 INFO:tasks.workunit.client.0.smithi110.stdout:7/928: write d10/d45/d60/d5e/d65/da3/fe4 [646353,113674] 0 2024-04-22T00:10:24.591 INFO:tasks.workunit.client.0.smithi110.stdout:8/960: unlink d5/da/d88/dd4/f101 0 2024-04-22T00:10:24.605 INFO:tasks.workunit.client.0.smithi110.stdout:1/880: mkdir d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/d132 0 2024-04-22T00:10:24.738 INFO:tasks.workunit.client.0.smithi110.stdout:3/916: write d6/d12/d50/d138/f97 [647015,130139] 0 2024-04-22T00:10:25.358 INFO:tasks.workunit.client.0.smithi110.stdout:7/929: creat d10/d45/d60/d5e/d65/d8a/deb/f140 x:0 0 0 2024-04-22T00:10:25.364 INFO:tasks.workunit.client.0.smithi110.stdout:4/824: write d1/d35/d6b/df2/d20/dbf/db5/fdb [1044602,126179] 0 2024-04-22T00:10:25.502 INFO:tasks.workunit.client.0.smithi110.stdout:8/961: fsync d5/d74/fb1 0 2024-04-22T00:10:25.552 INFO:tasks.workunit.client.0.smithi110.stdout:6/912: write d16/d1d/d38/dfe/f129 [294014,125533] 0 2024-04-22T00:10:25.636 INFO:tasks.workunit.client.0.smithi110.stdout:1/881: mkdir d1/d1d/d70/d133 0 2024-04-22T00:10:25.783 INFO:tasks.workunit.client.0.smithi110.stdout:1/882: dread d1/d2/d30/db9/fc2 [0,4194304] 0 2024-04-22T00:10:26.204 INFO:tasks.workunit.client.0.smithi110.stdout:5/904: dwrite d7/d24/d3a/d54/ffe [4194304,4194304] 0 2024-04-22T00:10:26.349 INFO:tasks.workunit.client.0.smithi110.stdout:6/913: creat d16/d1e/d24/d33/f137 x:0 0 0 2024-04-22T00:10:26.513 INFO:tasks.workunit.client.0.smithi110.stdout:8/962: truncate d5/da/d17/d7c/f7e 4203131 0 2024-04-22T00:10:26.544 INFO:tasks.workunit.client.0.smithi110.stdout:0/903: write d0/d27/d4b/da0/fb2 [894237,50881] 0 2024-04-22T00:10:26.756 INFO:tasks.workunit.client.0.smithi110.stdout:4/825: dread d1/d35/d6b/df2/f8a [0,4194304] 0 2024-04-22T00:10:26.801 INFO:tasks.workunit.client.0.smithi110.stdout:9/899: write d1/d29/d2a/d2b/f8d [3194235,81738] 0 2024-04-22T00:10:27.016 INFO:tasks.workunit.client.0.smithi110.stdout:2/959: dwrite d9/d25/d1b/d45/d50/f89 [0,4194304] 0 2024-04-22T00:10:27.451 INFO:tasks.workunit.client.0.smithi110.stdout:5/905: fdatasync d7/d24/d3a/d40/f57 0 2024-04-22T00:10:27.517 INFO:tasks.workunit.client.0.smithi110.stdout:1/883: dread d1/dd/d23/fe1 [0,4194304] 0 2024-04-22T00:10:27.525 INFO:tasks.workunit.client.0.smithi110.stdout:6/914: read d16/d1d/d38/d48/d5e/d6a/d70/f9b [3125805,14518] 0 2024-04-22T00:10:27.537 INFO:tasks.workunit.client.0.smithi110.stdout:0/904: rmdir d0/d27/d68 39 2024-04-22T00:10:27.583 INFO:tasks.workunit.client.0.smithi110.stdout:1/884: stat d1/d2/d1b/d10/d5c/dc5/l49 0 2024-04-22T00:10:27.586 INFO:tasks.workunit.client.0.smithi110.stdout:6/915: read d16/d1d/d38/f98 [2338489,68920] 0 2024-04-22T00:10:28.092 INFO:tasks.workunit.client.0.smithi110.stdout:2/960: mknod d9/d1a/d1d/de8/c143 0 2024-04-22T00:10:28.117 INFO:tasks.workunit.client.0.smithi110.stdout:2/961: readlink d9/d1a/d123/l96 0 2024-04-22T00:10:28.225 INFO:tasks.workunit.client.0.smithi110.stdout:2/962: stat d9/d1a/d1d/d2b/c7f 0 2024-04-22T00:10:28.406 INFO:tasks.workunit.client.0.smithi110.stdout:3/917: dwrite d6/d12/d50/f64 [0,4194304] 0 2024-04-22T00:10:28.407 INFO:tasks.workunit.client.0.smithi110.stdout:5/906: symlink d7/d9/d17/l10d 0 2024-04-22T00:10:28.447 INFO:tasks.workunit.client.0.smithi110.stdout:6/916: creat d16/d1e/d24/d90/dac/f138 x:0 0 0 2024-04-22T00:10:28.455 INFO:tasks.workunit.client.0.smithi110.stdout:1/885: rename d1/f7a to d1/d2/d30/db9/f134 0 2024-04-22T00:10:29.019 INFO:tasks.workunit.client.0.smithi110.stdout:2/963: fsync d9/d25/d1b/d45/d8e/fda 0 2024-04-22T00:10:29.021 INFO:tasks.workunit.client.0.smithi110.stdout:0/905: mknod d0/d14/d23/c133 0 2024-04-22T00:10:29.373 INFO:tasks.workunit.client.0.smithi110.stdout:7/930: dwrite d10/d45/d51/fd2 [0,4194304] 0 2024-04-22T00:10:29.594 INFO:tasks.workunit.client.0.smithi110.stdout:6/917: mknod d16/d1d/d38/d48/d5e/d62/c139 0 2024-04-22T00:10:30.028 INFO:tasks.workunit.client.0.smithi110.stdout:2/964: readlink d9/d1a/d7b/l139 0 2024-04-22T00:10:30.545 INFO:tasks.workunit.client.0.smithi110.stdout:7/931: truncate d10/d45/d60/d5e/d65/d8a/deb/f113 328206 0 2024-04-22T00:10:30.694 INFO:tasks.workunit.client.0.smithi110.stdout:1/886: rename d1/dd/f12e to d1/d2/d14/d65/f135 0 2024-04-22T00:10:30.863 INFO:tasks.workunit.client.0.smithi110.stdout:4/826: link d1/d35/d6b/df2/d20/d23/d1c/d47/d95/fbb d1/d35/d6b/df2/d20/dbf/f12f 0 2024-04-22T00:10:31.366 INFO:tasks.workunit.client.0.smithi110.stdout:0/906: unlink d0/d2a/c10b 0 2024-04-22T00:10:31.370 INFO:tasks.workunit.client.0.smithi110.stdout:2/965: fsync d9/d25/d1b/d60/f67 0 2024-04-22T00:10:31.750 INFO:tasks.workunit.client.0.smithi110.stdout:9/900: write d1/d29/d6f/db4/fa0 [1918572,51537] 0 2024-04-22T00:10:31.751 INFO:tasks.workunit.client.0.smithi110.stdout:2/966: chown d9/d1a/d1d/d2b/d5b/dd2/de7/df0/d136 4280889 1 2024-04-22T00:10:31.829 INFO:tasks.workunit.client.0.smithi110.stdout:8/963: dwrite d5/da/d17/dbf/f10c [0,4194304] 0 2024-04-22T00:10:32.308 INFO:tasks.workunit.client.0.smithi110.stdout:4/827: getdents d1/d35/d6b/df2/d20/d58/d7e/dd7 0 2024-04-22T00:10:32.401 INFO:tasks.workunit.client.0.smithi110.stdout:6/918: rename d16/d1d/f25 to d16/d3d/d40/f13a 0 2024-04-22T00:10:32.864 INFO:tasks.workunit.client.0.smithi110.stdout:5/907: write d7/d9/d17/d48/f63 [5173356,55339] 0 2024-04-22T00:10:32.928 INFO:tasks.workunit.client.0.smithi110.stdout:0/907: truncate d0/d16/d42/d50/f89 1336448 0 2024-04-22T00:10:32.980 INFO:tasks.workunit.client.0.smithi110.stdout:0/908: read d0/d16/d42/d50/dbc/fcc [2081423,5597] 0 2024-04-22T00:10:33.128 INFO:tasks.workunit.client.0.smithi110.stdout:3/918: write d6/d12/d16/d6f/f8e [239352,116084] 0 2024-04-22T00:10:33.470 INFO:tasks.workunit.client.0.smithi110.stdout:2/967: dread d9/d1a/d1d/d2b/ff9 [0,4194304] 0 2024-04-22T00:10:33.642 INFO:tasks.workunit.client.0.smithi110.stdout:5/908: mknod d7/d22/d5b/d68/c10e 0 2024-04-22T00:10:33.863 INFO:tasks.workunit.client.0.smithi110.stdout:0/909: mkdir d0/d16/d5d/d134 0 2024-04-22T00:10:34.123 INFO:tasks.workunit.client.0.smithi110.stdout:8/964: mkdir d5/da/d17/d7c/d128/d33/d3d/dfd/de6/d13b 0 2024-04-22T00:10:34.264 INFO:tasks.workunit.client.0.smithi110.stdout:3/919: stat d6/d12/d3c/d65/ld4 0 2024-04-22T00:10:34.539 INFO:tasks.workunit.client.0.smithi110.stdout:5/909: mknod d7/d24/d37/d38/d88/c10f 0 2024-04-22T00:10:34.563 INFO:tasks.workunit.client.0.smithi110.stdout:5/910: stat d7/d22/d5b/d68 0 2024-04-22T00:10:35.683 INFO:tasks.workunit.client.0.smithi110.stdout:7/932: dwrite d10/d45/d60/d5e/d65/f76 [4194304,4194304] 0 2024-04-22T00:10:35.694 INFO:tasks.workunit.client.0.smithi110.stdout:8/965: fdatasync d5/da/d17/d7c/dc0/f137 0 2024-04-22T00:10:36.139 INFO:tasks.workunit.client.0.smithi110.stdout:1/887: dwrite d1/d2/d14/d65/d8a/ff5 [0,4194304] 0 2024-04-22T00:10:36.712 INFO:tasks.workunit.client.0.smithi110.stdout:1/888: creat d1/d2/d1b/d10/d5c/daa/d10a/f136 x:0 0 0 2024-04-22T00:10:36.816 INFO:tasks.workunit.client.0.smithi110.stdout:0/910: getdents d0/d27/d68/d7d/d11a 0 2024-04-22T00:10:37.437 INFO:tasks.workunit.client.0.smithi110.stdout:0/911: rename d0/d27/d68/d7d/fbb to d0/d25/d5a/d63/f135 0 2024-04-22T00:10:37.830 INFO:tasks.workunit.client.0.smithi110.stdout:4/828: dwrite d1/d35/d6b/df2/d20/d50/f6e [0,4194304] 0 2024-04-22T00:10:37.834 INFO:tasks.workunit.client.0.smithi110.stdout:6/919: dwrite d16/d1e/d24/d90/dec/ffb [0,4194304] 0 2024-04-22T00:10:37.917 INFO:tasks.workunit.client.0.smithi110.stdout:9/901: dwrite d1/d29/d4d/f68 [0,4194304] 0 2024-04-22T00:10:38.007 INFO:tasks.workunit.client.0.smithi110.stdout:1/889: creat d1/d1d/f137 x:0 0 0 2024-04-22T00:10:38.191 INFO:tasks.workunit.client.0.smithi110.stdout:8/966: unlink d5/f38 0 2024-04-22T00:10:38.206 INFO:tasks.workunit.client.0.smithi110.stdout:4/829: read - d1/d35/d6b/faf zero size 2024-04-22T00:10:38.246 INFO:tasks.workunit.client.0.smithi110.stdout:3/920: write f1 [4386691,105658] 0 2024-04-22T00:10:38.267 INFO:tasks.workunit.client.0.smithi110.stdout:5/911: write d7/d24/d3a/d54/fa3 [2302185,55255] 0 2024-04-22T00:10:38.443 INFO:tasks.workunit.client.0.smithi110.stdout:2/968: dwrite d9/d25/d1c/f28 [0,4194304] 0 2024-04-22T00:10:38.617 INFO:tasks.workunit.client.0.smithi110.stdout:6/920: dread d16/d3d/d97/dd0/fb0 [0,4194304] 0 2024-04-22T00:10:38.922 INFO:tasks.workunit.client.0.smithi110.stdout:7/933: dwrite d10/d45/d51/d88/d46/d11c/f130 [4194304,4194304] 0 2024-04-22T00:10:38.931 INFO:tasks.workunit.client.0.smithi110.stdout:9/902: creat d1/d29/d2a/d2b/d58/d7b/f116 x:0 0 0 2024-04-22T00:10:39.145 INFO:tasks.workunit.client.0.smithi110.stdout:5/912: fdatasync d7/fae 0 2024-04-22T00:10:39.344 INFO:tasks.workunit.client.0.smithi110.stdout:0/912: mkdir d0/d14/d23/d6d/da8/d136 0 2024-04-22T00:10:39.815 INFO:tasks.workunit.client.0.smithi110.stdout:6/921: dread d16/d1e/d24/fbd [0,4194304] 0 2024-04-22T00:10:39.847 INFO:tasks.workunit.client.0.smithi110.stdout:6/922: readlink d16/d1e/l8f 0 2024-04-22T00:10:39.886 INFO:tasks.workunit.client.0.smithi110.stdout:6/923: chown d16/d1d/d38/d48/cf5 273412 1 2024-04-22T00:10:40.058 INFO:tasks.workunit.client.0.smithi110.stdout:8/967: mknod d5/c13c 0 2024-04-22T00:10:40.102 INFO:tasks.workunit.client.0.smithi110.stdout:8/968: dread - d5/da/d17/d7c/feb zero size 2024-04-22T00:10:40.273 INFO:tasks.workunit.client.0.smithi110.stdout:7/934: dread d10/d15/fc5 [0,4194304] 0 2024-04-22T00:10:40.693 INFO:tasks.workunit.client.0.smithi110.stdout:9/903: symlink d1/d29/d4d/dac/l117 0 2024-04-22T00:10:40.699 INFO:tasks.workunit.client.0.smithi110.stdout:1/890: write d1/d2/d30/f11e [914303,126214] 0 2024-04-22T00:10:40.783 INFO:tasks.workunit.client.0.smithi110.stdout:5/913: mknod d7/d22/c110 0 2024-04-22T00:10:41.543 INFO:tasks.workunit.client.0.smithi110.stdout:8/969: unlink d5/da/d17/d7c/d128/d33/d3d/d5c/c11d 0 2024-04-22T00:10:41.689 INFO:tasks.workunit.client.0.smithi110.stdout:4/830: dwrite d1/d35/d6b/df2/d20/d23/d1c/dae/fe4 [0,4194304] 0 2024-04-22T00:10:41.985 INFO:tasks.workunit.client.0.smithi110.stdout:9/904: readlink d1/d29/d6f/db4/d79/l7a 0 2024-04-22T00:10:41.993 INFO:tasks.workunit.client.0.smithi110.stdout:4/831: dread d1/d35/d6b/df2/f8a [0,4194304] 0 2024-04-22T00:10:42.221 INFO:tasks.workunit.client.0.smithi110.stdout:0/913: symlink d0/d14/d23/d6d/da8/d136/l137 0 2024-04-22T00:10:42.354 INFO:tasks.workunit.client.0.smithi110.stdout:2/969: truncate d9/d25/d1b/d45/d4d/f52 6021877 0 2024-04-22T00:10:42.850 INFO:tasks.workunit.client.0.smithi110.stdout:3/921: link d6/d12/d50/d138/c87 d6/d12/d16/d6f/db5/db9/dc6/c13c 0 2024-04-22T00:10:43.107 INFO:tasks.workunit.client.0.smithi110.stdout:8/970: dread d5/da/d17/d7c/d128/d33/f124 [0,4194304] 0 2024-04-22T00:10:43.920 INFO:tasks.workunit.client.0.smithi110.stdout:6/924: dwrite d16/d1d/f2f [0,4194304] 0 2024-04-22T00:10:43.933 INFO:tasks.workunit.client.0.smithi110.stdout:0/914: truncate d0/d16/d42/f52 1844946 0 2024-04-22T00:10:44.122 INFO:tasks.workunit.client.0.smithi110.stdout:2/970: creat d9/d1a/d1d/d2b/d54/d77/f144 x:0 0 0 2024-04-22T00:10:44.745 INFO:tasks.workunit.client.0.smithi110.stdout:1/891: dwrite d1/dd/fb3 [4194304,4194304] 0 2024-04-22T00:10:44.978 INFO:tasks.workunit.client.0.smithi110.stdout:5/914: dwrite d7/d24/d3a/da7/fbc [4194304,4194304] 0 2024-04-22T00:10:45.185 INFO:tasks.workunit.client.0.smithi110.stdout:4/832: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d6a/f130 x:0 0 0 2024-04-22T00:10:45.275 INFO:tasks.workunit.client.0.smithi110.stdout:8/971: dread d5/da/d17/d7c/d128/d33/d3d/d82/da8/f105 [0,4194304] 0 2024-04-22T00:10:45.708 INFO:tasks.workunit.client.0.smithi110.stdout:6/925: mknod d16/d1d/d38/d48/d5e/d6a/d70/d86/d110/c13b 0 2024-04-22T00:10:45.720 INFO:tasks.workunit.client.0.smithi110.stdout:0/915: dread d0/d14/d23/d6d/f124 [0,4194304] 0 2024-04-22T00:10:45.915 INFO:tasks.workunit.client.0.smithi110.stdout:7/935: dwrite d10/d45/d51/db1/dc9/df5/fdb [0,4194304] 0 2024-04-22T00:10:45.932 INFO:tasks.workunit.client.0.smithi110.stdout:2/971: rename d9/d1a/d1d/d4a/d6b/d3a/d5c/deb to d9/d1a/d1d/d2b/d54/d145 0 2024-04-22T00:10:46.101 INFO:tasks.workunit.client.0.smithi110.stdout:7/936: chown f5 33062023 1 2024-04-22T00:10:46.134 INFO:tasks.workunit.client.0.smithi110.stdout:0/916: dread d0/d16/d5d/f5e [0,4194304] 0 2024-04-22T00:10:46.916 INFO:tasks.workunit.client.0.smithi110.stdout:8/972: rmdir d5/da/d17/d6c/d7d 39 2024-04-22T00:10:47.179 INFO:tasks.workunit.client.0.smithi110.stdout:4/833: mkdir d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d131 0 2024-04-22T00:10:47.596 INFO:tasks.workunit.client.0.smithi110.stdout:6/926: creat d16/d1d/d38/d48/f13c x:0 0 0 2024-04-22T00:10:48.078 INFO:tasks.workunit.client.0.smithi110.stdout:0/917: unlink d0/d27/c39 0 2024-04-22T00:10:48.309 INFO:tasks.workunit.client.0.smithi110.stdout:3/922: dwrite d6/d12/d3c/f68 [0,4194304] 0 2024-04-22T00:10:48.452 INFO:tasks.workunit.client.0.smithi110.stdout:7/937: creat d10/d45/d51/d88/d39/d7f/f141 x:0 0 0 2024-04-22T00:10:48.961 INFO:tasks.workunit.client.0.smithi110.stdout:4/834: chown d1/f3 4590 1 2024-04-22T00:10:49.016 INFO:tasks.workunit.client.0.smithi110.stdout:6/927: truncate d16/d1d/d38/d48/d5e/d6a/f120 772534 0 2024-04-22T00:10:49.520 INFO:tasks.workunit.client.0.smithi110.stdout:5/915: dwrite d7/d24/d31/fe1 [0,4194304] 0 2024-04-22T00:10:49.911 INFO:tasks.workunit.client.0.smithi110.stdout:7/938: dread d10/d45/d51/d88/d46/fa0 [0,4194304] 0 2024-04-22T00:10:50.090 INFO:tasks.workunit.client.0.smithi110.stdout:4/835: dread d1/d35/d6b/df2/d20/dbf/db5/fdb [0,4194304] 0 2024-04-22T00:10:50.153 INFO:tasks.workunit.client.0.smithi110.stdout:4/836: chown d1/d35/d6b/df2/d20/d23/d1c/d40/fa9 263198536 1 2024-04-22T00:10:51.146 INFO:tasks.workunit.client.0.smithi110.stdout:4/837: unlink d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/fe0 0 2024-04-22T00:10:51.982 INFO:tasks.workunit.client.0.smithi110.stdout:9/905: dwrite d1/d52/d76/ffa [0,4194304] 0 2024-04-22T00:10:52.087 INFO:tasks.workunit.client.0.smithi110.stdout:4/838: rmdir d1/d35/d6b/df2/d20/d58/d93/d5e 39 2024-04-22T00:10:52.160 INFO:tasks.workunit.client.0.smithi110.stdout:9/906: dread - d1/d29/d2a/d2b/d58/da8/fbc zero size 2024-04-22T00:10:52.302 INFO:tasks.workunit.client.0.smithi110.stdout:1/892: rename d1/d1d to d1/dd/d23/dcc/d138 0 2024-04-22T00:10:52.332 INFO:tasks.workunit.client.0.smithi110.stdout:6/928: write d16/d1e/da8/fe3 [4073011,49547] 0 2024-04-22T00:10:52.596 INFO:tasks.workunit.client.0.smithi110.stdout:7/939: write d10/d45/d51/d88/dce/f10c [1807945,118359] 0 2024-04-22T00:10:52.885 INFO:tasks.workunit.client.0.smithi110.stdout:8/973: getdents d5/da/d17/d6c/d7d/d114 0 2024-04-22T00:10:53.188 INFO:tasks.workunit.client.0.smithi110.stdout:2/972: dwrite d9/d1a/d1d/d2b/d5b/dd2/de7/df0/ff8 [0,4194304] 0 2024-04-22T00:10:53.212 INFO:tasks.workunit.client.0.smithi110.stdout:3/923: dwrite d6/d12/d16/d5d/fa5 [0,4194304] 0 2024-04-22T00:10:53.446 INFO:tasks.workunit.client.0.smithi110.stdout:0/918: dwrite d0/d56/dc9/fe5 [0,4194304] 0 2024-04-22T00:10:53.523 INFO:tasks.workunit.client.0.smithi110.stdout:9/907: symlink d1/d29/d2a/d6/d1d/l118 0 2024-04-22T00:10:53.567 INFO:tasks.workunit.client.0.smithi110.stdout:3/924: chown d6/d12/d14/c20 3 1 2024-04-22T00:10:53.577 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:18:33.835 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.581 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:18:33.839 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.614 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:18:33.807 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.620 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:18:33.814 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.621 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:18:33.815 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.630 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:18:33.824 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.673 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:18:33.931 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.742 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:18:33.935 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:53.746 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:18:33.940 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:10:54.059 INFO:tasks.workunit.client.0.smithi110.stdout:5/916: getdents d7/d24/d3a/d54 0 2024-04-22T00:10:54.150 INFO:tasks.workunit.client.0.smithi110.stdout:8/974: fsync d5/ff 0 2024-04-22T00:10:54.205 INFO:tasks.workunit.client.0.smithi110.stdout:8/975: chown d5/da/d17/d6c/d7d/d114/d8c/f130 12 1 2024-04-22T00:10:54.232 INFO:tasks.workunit.client.0.smithi110.stdout:4/839: write d1/d35/d6b/df2/d20/d23/d1c/d47/d95/dcd/f123 [168739,112331] 0 2024-04-22T00:10:54.510 INFO:tasks.workunit.client.0.smithi110.stdout:2/973: mkdir d9/d1a/d1d/d7a/d91/d146 0 2024-04-22T00:10:54.752 INFO:tasks.workunit.client.0.smithi110.stdout:7/940: rename d10/d45/d51/db1/dc9/df5/l5c to d10/d45/d51/d88/d39/l142 0 2024-04-22T00:10:54.774 INFO:tasks.workunit.client.0.smithi110.stdout:7/941: read f5 [128236,24595] 0 2024-04-22T00:10:54.923 INFO:tasks.workunit.client.0.smithi110.stdout:3/925: truncate d6/f6a 4987327 0 2024-04-22T00:10:54.948 INFO:tasks.workunit.client.0.smithi110.stdout:1/893: write d1/d2/d1b/d10/d5c/d77/fd3 [218212,50334] 0 2024-04-22T00:10:55.077 INFO:tasks.workunit.client.0.smithi110.stdout:5/917: unlink d7/d24/d49/d64/f70 0 2024-04-22T00:10:55.312 INFO:tasks.workunit.client.0.smithi110.stdout:2/974: creat d9/d25/d1b/d45/d50/d68/f147 x:0 0 0 2024-04-22T00:10:55.320 INFO:tasks.workunit.client.0.smithi110.stdout:4/840: dread - d1/d35/d6b/df2/d20/d23/d1c/d40/fe2 zero size 2024-04-22T00:10:55.331 INFO:tasks.workunit.client.0.smithi110.stdout:6/929: dwrite d16/d3d/d40/d46/f67 [4194304,4194304] 0 2024-04-22T00:10:55.331 INFO:tasks.workunit.client.0.smithi110.stdout:5/918: stat d7/d24/d3a/d54/fb2 0 2024-04-22T00:10:55.529 INFO:tasks.workunit.client.0.smithi110.stdout:7/942: creat d10/d45/d51/d58/f143 x:0 0 0 2024-04-22T00:10:55.681 INFO:tasks.workunit.client.0.smithi110.stdout:2/975: readlink d9/d1a/d1d/d7a/d91/lc4 0 2024-04-22T00:10:55.757 INFO:tasks.workunit.client.0.smithi110.stdout:5/919: chown d7/d9/d17/d48/d69/f8d 261078200 1 2024-04-22T00:10:56.024 INFO:tasks.workunit.client.0.smithi110.stdout:1/894: dread d1/dd/fb3 [4194304,4194304] 0 2024-04-22T00:10:56.096 INFO:tasks.workunit.client.0.smithi110.stdout:9/908: dread d1/d29/d59/f93 [0,4194304] 0 2024-04-22T00:10:56.132 INFO:tasks.workunit.client.0.smithi110.stdout:0/919: rename d0/d56/da3/d106/l11f to d0/d14/d23/d6d/da8/l138 0 2024-04-22T00:10:56.143 INFO:tasks.workunit.client.0.smithi110.stdout:3/926: truncate d6/d12/d14/d4b/f5b 5449500 0 2024-04-22T00:10:56.319 INFO:tasks.workunit.client.0.smithi110.stdout:4/841: readlink d1/d35/d6b/df2/d20/d58/d93/l3e 0 2024-04-22T00:10:56.437 INFO:tasks.workunit.client.0.smithi110.stdout:8/976: dwrite d5/da/d17/d6c/d95/f112 [0,4194304] 0 2024-04-22T00:10:56.580 INFO:tasks.workunit.client.0.smithi110.stdout:4/842: chown d1/d35/d6b/df2/fb3 167624 1 2024-04-22T00:10:56.752 INFO:tasks.workunit.client.0.smithi110.stdout:2/976: dread d9/d1a/d1d/d2b/d54/d77/fa6 [0,4194304] 0 2024-04-22T00:10:56.963 INFO:tasks.workunit.client.0.smithi110.stdout:5/920: unlink d7/d9/d17/d48/lac 0 2024-04-22T00:10:57.320 INFO:tasks.workunit.client.0.smithi110.stdout:9/909: dread d1/d29/d2a/d9d/de0/ff7 [0,4194304] 0 2024-04-22T00:10:57.366 INFO:tasks.workunit.client.0.smithi110.stdout:0/920: creat d0/d56/d10f/f139 x:0 0 0 2024-04-22T00:10:57.425 INFO:tasks.workunit.client.0.smithi110.stdout:9/910: chown d1/d29/d6f/db4/d79/c100 86 1 2024-04-22T00:10:57.763 INFO:tasks.workunit.client.0.smithi110.stdout:4/843: mkdir d1/d35/d6b/df2/d20/df5/d132 0 2024-04-22T00:10:57.793 INFO:tasks.workunit.client.0.smithi110.stdout:9/911: dwrite d1/d52/d76/ffa [0,4194304] 0 2024-04-22T00:10:57.928 INFO:tasks.workunit.client.0.smithi110.stdout:2/977: dread - d9/d1a/d1d/d4e/dc0/f11d zero size 2024-04-22T00:10:57.970 INFO:tasks.workunit.client.0.smithi110.stdout:5/921: read d7/d24/d31/fe1 [3846131,74225] 0 2024-04-22T00:10:58.163 INFO:tasks.workunit.client.0.smithi110.stdout:6/930: link d16/d3d/ff8 d16/d1e/d24/d90/dac/f13d 0 2024-04-22T00:10:58.618 INFO:tasks.workunit.client.0.smithi110.stdout:1/895: dwrite d1/d2/d1b/d10/d5c/daa/d10a/f136 [0,4194304] 0 2024-04-22T00:10:58.795 INFO:tasks.workunit.client.0.smithi110.stdout:3/927: write d6/d12/d16/d6f/db5/dd3/f11c [743553,81706] 0 2024-04-22T00:10:59.025 INFO:tasks.workunit.client.0.smithi110.stdout:8/977: symlink d5/d4f/l13d 0 2024-04-22T00:10:59.541 INFO:tasks.workunit.client.0.smithi110.stdout:2/978: creat d9/d1a/d1d/de8/f148 x:0 0 0 2024-04-22T00:10:59.547 INFO:tasks.workunit.client.0.smithi110.stdout:7/943: write d10/d45/d51/d88/d39/ffb [1279723,70221] 0 2024-04-22T00:10:59.612 INFO:tasks.workunit.client.0.smithi110.stdout:2/979: stat d9/d1a/d123 0 2024-04-22T00:10:59.808 INFO:tasks.workunit.client.0.smithi110.stdout:6/931: readlink d16/d1e/d24/d66/l72 0 2024-04-22T00:11:00.138 INFO:tasks.workunit.client.0.smithi110.stdout:4/844: dwrite d1/d35/d6b/df2/d20/d58/d93/f11b [0,4194304] 0 2024-04-22T00:11:00.284 INFO:tasks.workunit.client.0.smithi110.stdout:0/921: write d0/d27/d4b/da0/fd3 [2034460,41217] 0 2024-04-22T00:11:00.372 INFO:tasks.workunit.client.0.smithi110.stdout:1/896: readlink d1/d2/d30/d9c/lfc 0 2024-04-22T00:11:00.417 INFO:tasks.workunit.client.0.smithi110.stdout:3/928: symlink d6/d12/d16/d30/l13d 0 2024-04-22T00:11:01.381 INFO:tasks.workunit.client.0.smithi110.stdout:2/980: mknod d9/d1a/d1d/d2b/d5b/dd2/de7/c149 0 2024-04-22T00:11:01.948 INFO:tasks.workunit.client.0.smithi110.stdout:6/932: dread d16/d1d/d38/dab/fde [0,4194304] 0 2024-04-22T00:11:01.998 INFO:tasks.workunit.client.0.smithi110.stdout:6/933: dread - d16/d1d/d38/d48/d5e/ffc zero size 2024-04-22T00:11:02.154 INFO:tasks.workunit.client.0.smithi110.stdout:0/922: creat d0/d14/d23/d6d/dde/d125/d104/f13a x:0 0 0 2024-04-22T00:11:02.241 INFO:tasks.workunit.client.0.smithi110.stdout:1/897: creat d1/dd/f139 x:0 0 0 2024-04-22T00:11:02.296 INFO:tasks.workunit.client.0.smithi110.stdout:1/898: dread d1/dd/d23/d48/d112/fd8 [0,4194304] 0 2024-04-22T00:11:02.370 INFO:tasks.workunit.client.0.smithi110.stdout:3/929: creat d6/d12/d16/d6f/db5/d127/f13e x:0 0 0 2024-04-22T00:11:02.634 INFO:tasks.workunit.client.0.smithi110.stdout:8/978: mknod d5/da/d17/d6c/d95/c13e 0 2024-04-22T00:11:02.944 INFO:tasks.workunit.client.0.smithi110.stdout:9/912: dwrite d1/d29/d2a/d9d/de0/ffe [0,4194304] 0 2024-04-22T00:11:03.154 INFO:tasks.workunit.client.0.smithi110.stdout:7/944: getdents d10/d45/d51/d88/d93/d138 0 2024-04-22T00:11:03.430 INFO:tasks.workunit.client.0.smithi110.stdout:4/845: mkdir d1/d35/d6b/df2/d20/d58/d102/d133 0 2024-04-22T00:11:03.551 INFO:tasks.workunit.client.0.smithi110.stdout:6/934: dread - d16/d1d/d38/dab/f11f zero size 2024-04-22T00:11:03.700 INFO:tasks.workunit.client.0.smithi110.stdout:0/923: symlink d0/d27/d68/d7d/d11a/l13b 0 2024-04-22T00:11:03.783 INFO:tasks.workunit.client.0.smithi110.stdout:1/899: dread d1/d2/d1b/d10/d5c/d77/d78/ffb [0,4194304] 0 2024-04-22T00:11:04.157 INFO:tasks.workunit.client.0.smithi110.stdout:1/900: sync 2024-04-22T00:11:04.718 INFO:tasks.workunit.client.0.smithi110.stdout:7/945: unlink d10/d45/d60/d5e/c87 0 2024-04-22T00:11:05.053 INFO:tasks.workunit.client.0.smithi110.stdout:6/935: dread - d16/d3d/d97/dd0/ff7 zero size 2024-04-22T00:11:05.783 INFO:tasks.workunit.client.0.smithi110.stdout:1/901: unlink d1/d2/d1b/f11 0 2024-04-22T00:11:05.849 INFO:tasks.workunit.client.0.smithi110.stdout:5/922: link d7/d24/d49/d64/c80 d7/d22/c111 0 2024-04-22T00:11:06.032 INFO:tasks.workunit.client.0.smithi110.stdout:2/981: write d9/d25/d1b/d45/f80 [2592170,19443] 0 2024-04-22T00:11:06.375 INFO:tasks.workunit.client.0.smithi110.stdout:4/846: symlink d1/d35/d6b/df2/d20/d58/d102/d133/l134 0 2024-04-22T00:11:06.736 INFO:tasks.workunit.client.0.smithi110.stdout:3/930: write d6/d12/d16/d6f/f8e [549211,47701] 0 2024-04-22T00:11:07.130 INFO:tasks.workunit.client.0.smithi110.stdout:2/982: rename d9/d25/d1b/d45/d126 to d9/d1a/d1d/d4a/d109/d14a 0 2024-04-22T00:11:07.640 INFO:tasks.workunit.client.0.smithi110.stdout:6/936: mknod d16/d3d/d40/c13e 0 2024-04-22T00:11:07.662 INFO:tasks.workunit.client.0.smithi110.stdout:8/979: getdents d5/d6f/dca 0 2024-04-22T00:11:07.759 INFO:tasks.workunit.client.0.smithi110.stdout:8/980: chown d5/da/d17/d7c/d128/d33/d3d/d82/da8/f127 57 1 2024-04-22T00:11:07.868 INFO:tasks.workunit.client.0.smithi110.stdout:1/902: symlink d1/d2/l13a 0 2024-04-22T00:11:07.894 INFO:tasks.workunit.client.0.smithi110.stdout:1/903: stat d1/d2/l124 0 2024-04-22T00:11:08.172 INFO:tasks.workunit.client.0.smithi110.stdout:3/931: rename d6/d12/d14/d4b/la9 to d6/d12/d50/d10b/l13f 0 2024-04-22T00:11:08.393 INFO:tasks.workunit.client.0.smithi110.stdout:4/847: symlink d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d131/l135 0 2024-04-22T00:11:09.126 INFO:tasks.workunit.client.0.smithi110.stdout:1/904: mknod d1/d2/d1b/da7/c13b 0 2024-04-22T00:11:09.195 INFO:tasks.workunit.client.0.smithi110.stdout:6/937: dread d16/d3d/d40/d46/f56 [0,4194304] 0 2024-04-22T00:11:09.444 INFO:tasks.workunit.client.0.smithi110.stdout:9/913: dwrite d1/d29/d6f/db4/d79/d98/f101 [0,4194304] 0 2024-04-22T00:11:09.756 INFO:tasks.workunit.client.0.smithi110.stdout:5/923: creat d7/d22/d5b/d86/f112 x:0 0 0 2024-04-22T00:11:09.889 INFO:tasks.workunit.client.0.smithi110.stdout:7/946: dwrite d10/d45/d60/d5e/d65/d8a/deb/d13c/fed [0,4194304] 0 2024-04-22T00:11:10.064 INFO:tasks.workunit.client.0.smithi110.stdout:8/981: truncate d5/da/f4e 930455 0 2024-04-22T00:11:10.094 INFO:tasks.workunit.client.0.smithi110.stdout:0/924: dwrite d0/d16/d42/d50/dbc/dc8/f116 [0,4194304] 0 2024-04-22T00:11:10.419 INFO:tasks.workunit.client.0.smithi110.stdout:4/848: fsync d1/d35/d6b/df2/d12/f64 0 2024-04-22T00:11:10.421 INFO:tasks.workunit.client.0.smithi110.stdout:1/905: symlink d1/d2/d30/d8b/l13c 0 2024-04-22T00:11:10.631 INFO:tasks.workunit.client.0.smithi110.stdout:6/938: creat d16/d1d/d38/d48/d5e/d6a/f13f x:0 0 0 2024-04-22T00:11:10.754 INFO:tasks.workunit.client.0.smithi110.stdout:2/983: dwrite d9/d1a/d1d/d4a/d6b/d3a/f41 [0,4194304] 0 2024-04-22T00:11:10.900 INFO:tasks.workunit.client.0.smithi110.stdout:9/914: mkdir d1/d29/d6f/db4/d79/d98/d119 0 2024-04-22T00:11:11.059 INFO:tasks.workunit.client.0.smithi110.stdout:3/932: truncate d6/d12/d3c/d65/fca 673405 0 2024-04-22T00:11:11.255 INFO:tasks.workunit.client.0.smithi110.stdout:7/947: creat d10/d45/d60/d5e/d65/d8a/deb/f144 x:0 0 0 2024-04-22T00:11:11.419 INFO:tasks.workunit.client.0.smithi110.stdout:5/924: truncate d7/d35/dd6/dfb/f108 824600 0 2024-04-22T00:11:11.452 INFO:tasks.workunit.client.0.smithi110.stdout:5/925: chown d7/d24/d49/d61/fed 99648971 1 2024-04-22T00:11:12.460 INFO:tasks.workunit.client.0.smithi110.stdout:9/915: dread d1/d19/fb5 [0,4194304] 0 2024-04-22T00:11:12.524 INFO:tasks.workunit.client.0.smithi110.stdout:3/933: fsync d6/d12/d16/d6f/db5/dd3/f11c 0 2024-04-22T00:11:12.579 INFO:tasks.workunit.client.0.smithi110.stdout:2/984: dread d9/d1a/f26 [0,4194304] 0 2024-04-22T00:11:13.212 INFO:tasks.workunit.client.0.smithi110.stdout:7/948: dread d10/d45/d51/d88/f74 [0,4194304] 0 2024-04-22T00:11:13.587 INFO:tasks.workunit.client.0.smithi110.stdout:9/916: fsync d1/d29/d59/f93 0 2024-04-22T00:11:13.983 INFO:tasks.workunit.client.0.smithi110.stdout:0/925: rename d0/d2a/fd1 to d0/d14/d23/d6d/f13c 0 2024-04-22T00:11:14.178 INFO:tasks.workunit.client.0.smithi110.stdout:4/849: write d1/d35/d6b/df2/f4b [522504,95559] 0 2024-04-22T00:11:14.320 INFO:tasks.workunit.client.0.smithi110.stdout:3/934: dread d6/d12/d14/f2e [0,4194304] 0 2024-04-22T00:11:14.336 INFO:tasks.workunit.client.0.smithi110.stdout:1/906: write d1/dd/d23/dcc/d138/f137 [322974,45912] 0 2024-04-22T00:11:14.568 INFO:tasks.workunit.client.0.smithi110.stdout:2/985: mkdir d9/d25/d1b/d45/d8e/dd5/d12b/d14b 0 2024-04-22T00:11:14.601 INFO:tasks.workunit.client.0.smithi110.stdout:2/986: chown d9/d1a/d7b/fc3 6 1 2024-04-22T00:11:14.779 INFO:tasks.workunit.client.0.smithi110.stdout:7/949: creat d10/d45/d60/d118/f145 x:0 0 0 2024-04-22T00:11:14.834 INFO:tasks.workunit.client.0.smithi110.stdout:0/926: mknod d0/d16/d5d/dc5/c13d 0 2024-04-22T00:11:14.970 INFO:tasks.workunit.client.0.smithi110.stdout:9/917: mknod d1/d52/d76/c11a 0 2024-04-22T00:11:15.047 INFO:tasks.workunit.client.0.smithi110.stdout:3/935: fsync d6/d78/fd1 0 2024-04-22T00:11:15.242 INFO:tasks.workunit.client.0.smithi110.stdout:6/939: dwrite d16/d1d/d38/fe8 [0,4194304] 0 2024-04-22T00:11:15.253 INFO:tasks.workunit.client.0.smithi110.stdout:8/982: write d5/d6f/f70 [2273709,98442] 0 2024-04-22T00:11:15.455 INFO:tasks.workunit.client.0.smithi110.stdout:1/907: stat d1/dd/d23/d48/d4e/d86/ld5 0 2024-04-22T00:11:15.504 INFO:tasks.workunit.client.0.smithi110.stdout:8/983: chown d5/da/d17/d7c/d128/d33/d3d/db8 27796 1 2024-04-22T00:11:15.796 INFO:tasks.workunit.client.0.smithi110.stdout:1/908: sync 2024-04-22T00:11:15.833 INFO:tasks.workunit.client.0.smithi110.stdout:1/909: chown d1/dd/d23/dcc/d138/d70/d133 315853 1 2024-04-22T00:11:15.888 INFO:tasks.workunit.client.0.smithi110.stdout:1/910: sync 2024-04-22T00:11:16.014 INFO:tasks.workunit.client.0.smithi110.stdout:0/927: mknod d0/d27/d4b/da0/da4/d114/c13e 0 2024-04-22T00:11:16.342 INFO:tasks.workunit.client.0.smithi110.stdout:5/926: write d7/d24/d3a/da7/fbc [1423374,100202] 0 2024-04-22T00:11:16.771 INFO:tasks.workunit.client.0.smithi110.stdout:9/918: mkdir d1/d29/d2a/d2b/d57/d11b 0 2024-04-22T00:11:16.846 INFO:tasks.workunit.client.0.smithi110.stdout:4/850: symlink d1/d35/d6b/df2/d20/d23/d1c/l136 0 2024-04-22T00:11:16.994 INFO:tasks.workunit.client.0.smithi110.stdout:3/936: creat d6/d12/d3c/d8d/f140 x:0 0 0 2024-04-22T00:11:17.504 INFO:tasks.workunit.client.0.smithi110.stdout:1/911: creat d1/d2/d14/d10f/f13d x:0 0 0 2024-04-22T00:11:17.521 INFO:tasks.workunit.client.0.smithi110.stdout:0/928: dread - d0/d56/d10f/f118 zero size 2024-04-22T00:11:17.879 INFO:tasks.workunit.client.0.smithi110.stdout:9/919: creat d1/d29/d4d/f11c x:0 0 0 2024-04-22T00:11:18.040 INFO:tasks.workunit.client.0.smithi110.stdout:4/851: creat d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d131/f137 x:0 0 0 2024-04-22T00:11:18.197 INFO:tasks.workunit.client.0.smithi110.stdout:3/937: rename d6/d12/d16/d6f to d6/d12/d50/d138/d121/d141 0 2024-04-22T00:11:18.319 INFO:tasks.workunit.client.0.smithi110.stdout:6/940: mknod d16/d1e/d24/c140 0 2024-04-22T00:11:18.794 INFO:tasks.workunit.client.0.smithi110.stdout:1/912: symlink d1/d2/d30/d8b/dc3/l13e 0 2024-04-22T00:11:19.285 INFO:tasks.workunit.client.0.smithi110.stdout:4/852: rename d1/d35/d6b/df2/d20/d58/d93/fd3 to d1/d35/d6b/df2/d20/d58/d102/d133/f138 0 2024-04-22T00:11:19.299 INFO:tasks.workunit.client.0.smithi110.stdout:3/938: fsync d6/d12/d50/d138/f49 0 2024-04-22T00:11:19.369 INFO:tasks.workunit.client.0.smithi110.stdout:6/941: dread - d16/d1d/d38/d48/d5e/d6a/f13f zero size 2024-04-22T00:11:19.446 INFO:tasks.workunit.client.0.smithi110.stdout:6/942: chown d16/d1d/d38/dab/f119 306962456 1 2024-04-22T00:11:19.531 INFO:tasks.workunit.client.0.smithi110.stdout:1/913: fdatasync d1/d2/d14/f9d 0 2024-04-22T00:11:19.632 INFO:tasks.workunit.client.0.smithi110.stdout:9/920: mkdir d1/d29/d2a/d11d 0 2024-04-22T00:11:19.784 INFO:tasks.workunit.client.0.smithi110.stdout:7/950: dwrite d10/d45/d51/db1/dc9/df5/d2c/fbf [0,4194304] 0 2024-04-22T00:11:20.284 INFO:tasks.workunit.client.0.smithi110.stdout:3/939: symlink d6/d12/d50/d138/d121/d141/db5/d127/l142 0 2024-04-22T00:11:21.517 INFO:tasks.workunit.client.0.smithi110.stdout:3/940: fsync d6/d12/d50/d138/d121/d141/db5/f105 0 2024-04-22T00:11:21.650 INFO:tasks.workunit.client.0.smithi110.stdout:1/914: mknod d1/d2/d1b/c13f 0 2024-04-22T00:11:21.864 INFO:tasks.workunit.client.0.smithi110.stdout:2/987: dwrite d9/f10 [0,4194304] 0 2024-04-22T00:11:21.893 INFO:tasks.workunit.client.0.smithi110.stdout:6/943: mkdir d16/d1e/d24/d33/d85/ddd/d141 0 2024-04-22T00:11:22.068 INFO:tasks.workunit.client.0.smithi110.stdout:8/984: dwrite d5/da/d17/d7c/d128/d33/d3d/f47 [0,4194304] 0 2024-04-22T00:11:22.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/941: unlink d6/d12/d16/d30/l128 0 2024-04-22T00:11:22.566 INFO:tasks.workunit.client.0.smithi110.stdout:1/915: rename d1/d2/d1b/d10/fb5 to d1/d2/d30/f140 0 2024-04-22T00:11:22.597 INFO:tasks.workunit.client.0.smithi110.stdout:5/927: dwrite f5 [4194304,4194304] 0 2024-04-22T00:11:22.605 INFO:tasks.workunit.client.0.smithi110.stdout:9/921: link d1/d29/d6f/db4/d79/c100 d1/d29/d2a/d11d/c11e 0 2024-04-22T00:11:23.000 INFO:tasks.workunit.client.0.smithi110.stdout:0/929: dwrite d0/d14/f1c [4194304,4194304] 0 2024-04-22T00:11:23.572 INFO:tasks.workunit.client.0.smithi110.stdout:5/928: chown d7/d22/d5b/d68/c7c 44341 1 2024-04-22T00:11:23.660 INFO:tasks.workunit.client.0.smithi110.stdout:9/922: mknod d1/d29/d4d/c11f 0 2024-04-22T00:11:23.851 INFO:tasks.workunit.client.0.smithi110.stdout:1/916: rename d1/d2/d1b/d10/c63 to d1/d2/d1b/da7/c141 0 2024-04-22T00:11:24.404 INFO:tasks.workunit.client.0.smithi110.stdout:4/853: write d1/f5 [8753255,48550] 0 2024-04-22T00:11:25.046 INFO:tasks.workunit.client.0.smithi110.stdout:9/923: creat d1/d19/d42/f120 x:0 0 0 2024-04-22T00:11:25.487 INFO:tasks.workunit.client.0.smithi110.stdout:7/951: dwrite d10/d45/d51/d88/d46/fa0 [4194304,4194304] 0 2024-04-22T00:11:25.632 INFO:tasks.workunit.client.0.smithi110.stdout:4/854: creat d1/d35/d6b/df2/d20/dbf/d5f/f139 x:0 0 0 2024-04-22T00:11:26.142 INFO:tasks.workunit.client.0.smithi110.stdout:7/952: rename d10/d45/d60/d5e/d65/d8a/deb/d13c/f107 to d10/d27/f146 0 2024-04-22T00:11:26.297 INFO:tasks.workunit.client.0.smithi110.stdout:9/924: symlink d1/d29/d2a/d2b/d114/l121 0 2024-04-22T00:11:26.406 INFO:tasks.workunit.client.0.smithi110.stdout:3/942: getdents d6/d12/d3c/d8d 0 2024-04-22T00:11:26.841 INFO:tasks.workunit.client.0.smithi110.stdout:3/943: truncate d6/d12/d14/d4b/f132 291949 0 2024-04-22T00:11:27.461 INFO:tasks.workunit.client.0.smithi110.stdout:7/953: creat d10/d45/d51/d88/d46/d69/f147 x:0 0 0 2024-04-22T00:11:27.524 INFO:tasks.workunit.client.0.smithi110.stdout:8/985: write d5/da/d17/d6c/d95/d98/f12e [765730,12854] 0 2024-04-22T00:11:27.922 INFO:tasks.workunit.client.0.smithi110.stdout:8/986: readlink d5/da/d17/d7c/dc0/lc8 0 2024-04-22T00:11:28.160 INFO:tasks.workunit.client.0.smithi110.stdout:1/917: write d1/dd/d23/d48/d4e/ddc/d117/f128 [539896,59182] 0 2024-04-22T00:11:28.187 INFO:tasks.workunit.client.0.smithi110.stdout:6/944: dwrite d16/d1d/d38/d48/d5e/ffc [0,4194304] 0 2024-04-22T00:11:28.384 INFO:tasks.workunit.client.0.smithi110.stdout:2/988: dwrite d9/d25/d1b/d45/d50/f89 [0,4194304] 0 2024-04-22T00:11:28.516 INFO:tasks.workunit.client.0.smithi110.stdout:0/930: dwrite d0/d14/d23/d3b/fb5 [0,4194304] 0 2024-04-22T00:11:28.544 INFO:tasks.workunit.client.0.smithi110.stdout:7/954: creat d10/d45/d60/d5e/d11b/f148 x:0 0 0 2024-04-22T00:11:28.778 INFO:tasks.workunit.client.0.smithi110.stdout:7/955: sync 2024-04-22T00:11:28.816 INFO:tasks.workunit.client.0.smithi110.stdout:5/929: dwrite d7/d24/d37/d38/f4d [4194304,4194304] 0 2024-04-22T00:11:28.985 INFO:tasks.workunit.client.0.smithi110.stdout:5/930: chown d7/d9/d17/d48/d69/ffd 221551 1 2024-04-22T00:11:29.220 INFO:tasks.workunit.client.0.smithi110.stdout:9/925: write d1/d29/d6f/f75 [210735,37591] 0 2024-04-22T00:11:29.367 INFO:tasks.workunit.client.0.smithi110.stdout:3/944: rename d6/d12/d14/cf7 to d6/d12/d16/c143 0 2024-04-22T00:11:29.408 INFO:tasks.workunit.client.0.smithi110.stdout:5/931: mknod d7/d22/d5b/d6f/c113 0 2024-04-22T00:11:29.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/932: chown d7/d9/d17/d48/f103 101764649 1 2024-04-22T00:11:29.669 INFO:tasks.workunit.client.0.smithi110.stdout:2/989: mkdir d9/d25/d1b/d11f/d12e/d14c 0 2024-04-22T00:11:30.030 INFO:tasks.workunit.client.0.smithi110.stdout:0/931: rename d0/d14/l37 to d0/d14/d23/d6d/da8/l13f 0 2024-04-22T00:11:30.299 INFO:tasks.workunit.client.0.smithi110.stdout:5/933: mknod d7/d24/d31/c114 0 2024-04-22T00:11:30.571 INFO:tasks.workunit.client.0.smithi110.stdout:4/855: creat d1/f13a x:0 0 0 2024-04-22T00:11:31.059 INFO:tasks.workunit.client.0.smithi110.stdout:8/987: getdents d5/da/dac 0 2024-04-22T00:11:31.246 INFO:tasks.workunit.client.0.smithi110.stdout:8/988: sync 2024-04-22T00:11:31.345 INFO:tasks.workunit.client.0.smithi110.stdout:2/990: mknod d9/d1a/d1d/d4a/d6b/d3a/c14d 0 2024-04-22T00:11:31.638 INFO:tasks.workunit.client.0.smithi110.stdout:8/989: dread d5/da/d17/d6c/d7d/d114/f9f [0,4194304] 0 2024-04-22T00:11:31.678 INFO:tasks.workunit.client.0.smithi110.stdout:8/990: chown d5/da/d17/d6c/d95/d111 470462 1 2024-04-22T00:11:32.007 INFO:tasks.workunit.client.0.smithi110.stdout:4/856: dread d1/d35/d6b/df2/d20/d50/f70 [0,4194304] 0 2024-04-22T00:11:32.032 INFO:tasks.workunit.client.0.smithi110.stdout:9/926: rename d1/d29/d2a/d6/d1d/l118 to d1/d29/d4d/dac/dbf/l122 0 2024-04-22T00:11:32.590 INFO:tasks.workunit.client.0.smithi110.stdout:3/945: getdents d6/d12/d3c/d65/d91 0 2024-04-22T00:11:33.076 INFO:tasks.workunit.client.0.smithi110.stdout:1/918: dwrite d1/dd/d23/dcc/f41 [0,4194304] 0 2024-04-22T00:11:33.305 INFO:tasks.workunit.client.0.smithi110.stdout:7/956: dwrite d10/d45/d51/db1/dc9/df5/fe5 [0,4194304] 0 2024-04-22T00:11:33.758 INFO:tasks.workunit.client.0.smithi110.stdout:2/991: getdents d9/d25/d1b 0 2024-04-22T00:11:33.899 INFO:tasks.workunit.client.0.smithi110.stdout:1/919: stat d1/d2/d1b/d10/d5c/d77/d78/deb/fa3 0 2024-04-22T00:11:33.912 INFO:tasks.workunit.client.0.smithi110.stdout:6/945: dwrite d16/d1d/d38/d48/d5e/d6a/db6/f10c [0,4194304] 0 2024-04-22T00:11:34.054 INFO:tasks.workunit.client.0.smithi110.stdout:4/857: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/f13b x:0 0 0 2024-04-22T00:11:34.126 INFO:tasks.workunit.client.0.smithi110.stdout:5/934: dwrite d7/d24/d37/d38/fa1 [0,4194304] 0 2024-04-22T00:11:34.288 INFO:tasks.workunit.client.0.smithi110.stdout:6/946: readlink d16/d3d/d40/l8b 0 2024-04-22T00:11:34.524 INFO:tasks.workunit.client.0.smithi110.stdout:6/947: readlink d16/d1d/d38/d48/d5e/le2 0 2024-04-22T00:11:34.691 INFO:tasks.workunit.client.0.smithi110.stdout:8/991: dwrite d5/fe [8388608,4194304] 0 2024-04-22T00:11:34.691 INFO:tasks.workunit.client.0.smithi110.stdout:3/946: creat d6/f144 x:0 0 0 2024-04-22T00:11:34.777 INFO:tasks.workunit.client.0.smithi110.stdout:9/927: unlink d1/d29/ca2 0 2024-04-22T00:11:34.860 INFO:tasks.workunit.client.0.smithi110.stdout:8/992: chown d5/da/d17/d7c/d128/d33/d3d/d5c/fc7 18837 1 2024-04-22T00:11:34.956 INFO:tasks.workunit.client.0.smithi110.stdout:7/957: chown d10/d45/d51/d88/d39/d7f/cfa 1 1 2024-04-22T00:11:35.088 INFO:tasks.workunit.client.0.smithi110.stdout:2/992: rename d9/d25/d1b/c3e to d9/d1a/d123/c14e 0 2024-04-22T00:11:35.317 INFO:tasks.workunit.client.0.smithi110.stdout:5/935: rmdir d7/d24/d49/d61 39 2024-04-22T00:11:36.336 INFO:tasks.workunit.client.0.smithi110.stdout:8/993: symlink d5/da/d17/d7c/l13f 0 2024-04-22T00:11:36.547 INFO:tasks.workunit.client.0.smithi110.stdout:4/858: truncate d1/d35/d6b/df2/fda 928817 0 2024-04-22T00:11:36.596 INFO:tasks.workunit.client.0.smithi110.stdout:1/920: dwrite d1/dd/d23/dcc/d138/f9e [0,4194304] 0 2024-04-22T00:11:36.598 INFO:tasks.workunit.client.0.smithi110.stdout:7/958: chown d10/d45/d51/d88/d39/fe3 2848621 1 2024-04-22T00:11:36.718 INFO:tasks.workunit.client.0.smithi110.stdout:5/936: rename d7/d9/d17/d48/d69/d6d/l100 to d7/d24/d3a/d40/df7/l115 0 2024-04-22T00:11:37.285 INFO:tasks.workunit.client.0.smithi110.stdout:9/928: unlink d1/d29/d2a/d2b/d58/d7b/f116 0 2024-04-22T00:11:37.394 INFO:tasks.workunit.client.0.smithi110.stdout:6/948: write d16/d3d/d40/d46/f6d [254277,589] 0 2024-04-22T00:11:37.767 INFO:tasks.workunit.client.0.smithi110.stdout:0/932: write d0/d14/d23/d3b/fdd [1051462,49659] 0 2024-04-22T00:11:37.860 INFO:tasks.workunit.client.0.smithi110.stdout:4/859: read - d1/d35/d6b/df2/d20/d50/fb0 zero size 2024-04-22T00:11:37.892 INFO:tasks.workunit.client.0.smithi110.stdout:1/921: read - d1/d2/d14/d10f/f125 zero size 2024-04-22T00:11:37.913 INFO:tasks.workunit.client.0.smithi110.stdout:3/947: dwrite d6/d12/d14/f7e [0,4194304] 0 2024-04-22T00:11:38.417 INFO:tasks.workunit.client.0.smithi110.stdout:1/922: dread d1/dd/d23/dcc/d138/f9e [0,4194304] 0 2024-04-22T00:11:38.532 INFO:tasks.workunit.client.0.smithi110.stdout:2/993: dwrite d9/d1a/d1d/d2b/d54/d77/fca [0,4194304] 0 2024-04-22T00:11:38.697 INFO:tasks.workunit.client.0.smithi110.stdout:3/948: chown d6/d12/d3c/c40 35 1 2024-04-22T00:11:38.765 INFO:tasks.workunit.client.0.smithi110.stdout:1/923: chown d1/d2/d1b/d10/d5c/d77/d78/f11a 332 1 2024-04-22T00:11:38.996 INFO:tasks.workunit.client.0.smithi110.stdout:6/949: mknod d16/d1e/d24/c142 0 2024-04-22T00:11:39.009 INFO:tasks.workunit.client.0.smithi110.stdout:8/994: write d5/da/d17/d7c/dc0/fcf [1250794,54156] 0 2024-04-22T00:11:39.063 INFO:tasks.workunit.client.0.smithi110.stdout:8/995: chown d5/l34 44420 1 2024-04-22T00:11:39.127 INFO:tasks.workunit.client.0.smithi110.stdout:8/996: stat d5/da/d17/d7c/f87 0 2024-04-22T00:11:39.309 INFO:tasks.workunit.client.0.smithi110.stdout:4/860: truncate d1/d35/d6b/df2/d20/d23/d1c/d40/f63 16771 0 2024-04-22T00:11:40.487 INFO:tasks.workunit.client.0.smithi110.stdout:5/937: link d7/d9/d17/f2c d7/d24/d37/d38/d88/d91/f116 0 2024-04-22T00:11:40.503 INFO:tasks.workunit.client.0.smithi110.stdout:6/950: symlink d16/d1e/d24/d90/dec/l143 0 2024-04-22T00:11:41.004 INFO:tasks.workunit.client.0.smithi110.stdout:7/959: getdents d10/d45/d51/d88/d46 0 2024-04-22T00:11:41.654 INFO:tasks.workunit.client.0.smithi110.stdout:1/924: creat d1/d2/d1b/d10/d5c/dc5/d27/d103/f142 x:0 0 0 2024-04-22T00:11:41.701 INFO:tasks.workunit.client.0.smithi110.stdout:2/994: dwrite d9/d1a/d7b/fe9 [0,4194304] 0 2024-04-22T00:11:41.835 INFO:tasks.workunit.client.0.smithi110.stdout:9/929: fdatasync d1/d29/d4d/dac/dbf/dda/ff3 0 2024-04-22T00:11:41.871 INFO:tasks.workunit.client.0.smithi110.stdout:6/951: fsync d16/d1d/d38/dab/f119 0 2024-04-22T00:11:41.969 INFO:tasks.workunit.client.0.smithi110.stdout:2/995: dread - d9/d1a/d1d/d2b/ffa zero size 2024-04-22T00:11:41.993 INFO:tasks.workunit.client.0.smithi110.stdout:2/996: readlink d9/d1a/ldc 0 2024-04-22T00:11:42.148 INFO:tasks.workunit.client.0.smithi110.stdout:5/938: truncate d7/d22/d5b/d6f/ff8 965169 0 2024-04-22T00:11:42.402 INFO:tasks.workunit.client.0.smithi110.stdout:0/933: getdents d0/d14/d23/d6d/dde/d125/d104 0 2024-04-22T00:11:42.509 INFO:tasks.workunit.client.0.smithi110.stdout:0/934: dread d0/d16/d42/fbd [0,4194304] 0 2024-04-22T00:11:42.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/949: creat d6/d12/f145 x:0 0 0 2024-04-22T00:11:43.214 INFO:tasks.workunit.client.0.smithi110.stdout:9/930: stat d1/d29/d4d/dac/dbf/l122 0 2024-04-22T00:11:43.430 INFO:tasks.workunit.client.0.smithi110.stdout:2/997: creat d9/d1a/d1d/d4a/d6b/d3a/d5c/f14f x:0 0 0 2024-04-22T00:11:43.495 INFO:tasks.workunit.client.0.smithi110.stdout:9/931: sync 2024-04-22T00:11:43.560 INFO:tasks.workunit.client.0.smithi110.stdout:8/997: rmdir d5/da/d17/d6c/d95/d100 0 2024-04-22T00:11:43.586 INFO:tasks.workunit.client.0.smithi110.stdout:9/932: sync 2024-04-22T00:11:44.105 INFO:tasks.workunit.client.0.smithi110.stdout:0/935: fdatasync d0/d16/d42/d50/dbc/dc8/fe2 0 2024-04-22T00:11:44.173 INFO:tasks.workunit.client.0.smithi110.stdout:3/950: dread - d6/d12/d50/d138/d121/d141/db5/f12a zero size 2024-04-22T00:11:44.202 INFO:tasks.workunit.client.0.smithi110.stdout:3/951: readlink d6/d12/d16/l22 0 2024-04-22T00:11:45.100 INFO:tasks.workunit.client.0.smithi110.stdout:6/952: mkdir d16/d3d/d144 0 2024-04-22T00:11:45.115 INFO:tasks.workunit.client.0.smithi110.stdout:1/925: mknod d1/d2/d1b/d10/d5c/dc5/d27/c143 0 2024-04-22T00:11:45.257 INFO:tasks.workunit.client.0.smithi110.stdout:1/926: chown d1/d2/d1b/d10/d5c/dc5/l82 1022713782 1 2024-04-22T00:11:45.448 INFO:tasks.workunit.client.0.smithi110.stdout:9/933: dread d1/d29/d6f/db4/fa3 [0,4194304] 0 2024-04-22T00:11:45.598 INFO:tasks.workunit.client.0.smithi110.stdout:4/861: getdents d1/d35 0 2024-04-22T00:11:46.042 INFO:tasks.workunit.client.0.smithi110.stdout:0/936: symlink d0/d16/d42/d50/dbc/l140 0 2024-04-22T00:11:46.072 INFO:tasks.workunit.client.0.smithi110.stdout:3/952: creat d6/d12/d50/d138/d121/d141/db5/def/f146 x:0 0 0 2024-04-22T00:11:46.673 INFO:tasks.workunit.client.0.smithi110.stdout:6/953: truncate d16/d3d/d97/dd0/fb0 1547701 0 2024-04-22T00:11:46.785 INFO:tasks.workunit.client.0.smithi110.stdout:7/960: write d10/d45/d60/d5e/d65/d8a/deb/d13c/f10f [1731357,7707] 0 2024-04-22T00:11:46.911 INFO:tasks.workunit.client.0.smithi110.stdout:1/927: readlink d1/d2/d1b/ldf 0 2024-04-22T00:11:47.287 INFO:tasks.workunit.client.0.smithi110.stdout:9/934: mknod d1/d29/d4d/dac/db8/c123 0 2024-04-22T00:11:47.314 INFO:tasks.workunit.client.0.smithi110.stdout:9/935: chown d1/d29/d2a/laf 11864 1 2024-04-22T00:11:47.721 INFO:tasks.workunit.client.0.smithi110.stdout:8/998: write d5/d4f/f76 [2880238,100011] 0 2024-04-22T00:11:47.887 INFO:tasks.workunit.client.0.smithi110.stdout:2/998: symlink d9/d25/d1b/d45/d50/d68/l150 0 2024-04-22T00:11:47.992 INFO:tasks.workunit.client.0.smithi110.stdout:8/999: chown d5/da/d17/dbf/f10c 13553 1 2024-04-22T00:11:48.090 INFO:tasks.workunit.client.0.smithi110.stdout:6/954: mkdir d16/d1e/d24/d33/d85/d145 0 2024-04-22T00:11:48.200 INFO:tasks.workunit.client.0.smithi110.stdout:3/953: dread d6/d12/d3c/d8d/dee/f12f [0,4194304] 0 2024-04-22T00:11:48.294 INFO:tasks.workunit.client.0.smithi110.stdout:5/939: getdents d7/d24/d3a 0 2024-04-22T00:11:48.671 INFO:tasks.workunit.client.0.smithi110.stdout:1/928: read - d1/fe3 zero size 2024-04-22T00:11:48.909 INFO:tasks.workunit.client.0.smithi110.stdout:4/862: mknod d1/d35/d6b/df2/d20/c13c 0 2024-04-22T00:11:49.006 INFO:tasks.workunit.client.0.smithi110.stdout:0/937: mknod d0/d27/d4b/da0/db1/c141 0 2024-04-22T00:11:49.377 INFO:tasks.workunit.client.0.smithi110.stdout:2/999: fsync d9/d1a/d1d/d2b/f9b 0 2024-04-22T00:11:49.581 INFO:tasks.workunit.client.0.smithi110.stdout:3/954: truncate d6/d12/f29 1578181 0 2024-04-22T00:11:49.832 INFO:tasks.workunit.client.0.smithi110.stdout:1/929: fdatasync d1/dd/d23/dcc/d138/d4a/fb0 0 2024-04-22T00:11:50.356 INFO:tasks.workunit.client.0.smithi110.stdout:0/938: symlink d0/d27/dcd/df2/l142 0 2024-04-22T00:11:50.385 INFO:tasks.workunit.client.0.smithi110.stdout:0/939: stat d0/d16/d5d/dc5/lff 0 2024-04-22T00:11:50.616 INFO:tasks.workunit.client.0.smithi110.stdout:7/961: write d10/f23 [4852748,86264] 0 2024-04-22T00:11:50.669 INFO:tasks.workunit.client.0.smithi110.stdout:7/962: chown d10/d45/d51/d88/d46/l6c 2 1 2024-04-22T00:11:50.736 INFO:tasks.workunit.client.0.smithi110.stdout:3/955: fdatasync d6/d12/d14/d32/f6d 0 2024-04-22T00:11:51.042 INFO:tasks.workunit.client.0.smithi110.stdout:1/930: mkdir d1/dd/d23/d48/d4e/ddc/d144 0 2024-04-22T00:11:51.075 INFO:tasks.workunit.client.0.smithi110.stdout:1/931: chown d1/d2/d30/c12b 1 1 2024-04-22T00:11:51.169 INFO:tasks.workunit.client.0.smithi110.stdout:4/863: symlink d1/l13d 0 2024-04-22T00:11:51.212 INFO:tasks.workunit.client.0.smithi110.stdout:4/864: stat d1/d35/d6b/df2/d20/d58/f104 0 2024-04-22T00:11:51.454 INFO:tasks.workunit.client.0.smithi110.stdout:4/865: sync 2024-04-22T00:11:51.795 INFO:tasks.workunit.client.0.smithi110.stdout:3/956: rename d6/d12/d3c/d65/d91/d116/l11e to d6/d12/d16/d30/dc7/l147 0 2024-04-22T00:11:51.996 INFO:tasks.workunit.client.0.smithi110.stdout:4/866: chown d1/d35/d6b/df2/d20/d58/d7e/f116 6241749 1 2024-04-22T00:11:52.061 INFO:tasks.workunit.client.0.smithi110.stdout:4/867: read - d1/d35/fb8 zero size 2024-04-22T00:11:52.170 INFO:tasks.workunit.client.0.smithi110.stdout:6/955: getdents d16/d1e/da8 0 2024-04-22T00:11:52.350 INFO:tasks.workunit.client.0.smithi110.stdout:1/932: rename d1/d2/d14/d10f to d1/d2/d30/d9c/d145 0 2024-04-22T00:11:52.723 INFO:tasks.workunit.client.0.smithi110.stdout:5/940: dwrite d7/d24/d37/d38/d88/f8b [0,4194304] 0 2024-04-22T00:11:52.820 INFO:tasks.workunit.client.0.smithi110.stdout:9/936: write d1/d29/f2e [8768421,47199] 0 2024-04-22T00:11:52.886 INFO:tasks.workunit.client.0.smithi110.stdout:4/868: mkdir d1/d35/d6b/df2/d20/d23/d1c/d47/d95/d13e 0 2024-04-22T00:11:53.712 INFO:tasks.workunit.client.0.smithi110.stdout:9/937: creat d1/d29/d2a/d2b/d114/f124 x:0 0 0 2024-04-22T00:11:53.845 INFO:tasks.workunit.client.0.smithi110.stdout:4/869: dread d1/d35/d6b/df2/fda [0,4194304] 0 2024-04-22T00:11:54.122 INFO:tasks.workunit.client.0.smithi110.stdout:7/963: write d10/d45/d51/d88/f8e [30120,59125] 0 2024-04-22T00:11:54.327 INFO:tasks.workunit.client.0.smithi110.stdout:9/938: symlink d1/d29/d2a/d2b/d114/l125 0 2024-04-22T00:11:54.329 INFO:tasks.workunit.client.0.smithi110.stdout:7/964: sync 2024-04-22T00:11:54.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/940: write d0/d14/f32 [1589756,127919] 0 2024-04-22T00:11:54.421 INFO:tasks.workunit.client.0.smithi110.stdout:7/965: sync 2024-04-22T00:11:54.719 INFO:tasks.workunit.client.0.smithi110.stdout:4/870: truncate d1/d35/d6b/df2/d20/d23/ff 685472 0 2024-04-22T00:11:54.740 INFO:tasks.workunit.client.0.smithi110.stdout:5/941: creat d7/d24/d37/f117 x:0 0 0 2024-04-22T00:11:54.869 INFO:tasks.workunit.client.0.smithi110.stdout:7/966: creat d10/d45/f149 x:0 0 0 2024-04-22T00:11:54.894 INFO:tasks.workunit.client.0.smithi110.stdout:7/967: stat d10/d45/d60/f78 0 2024-04-22T00:11:55.352 INFO:tasks.workunit.client.0.smithi110.stdout:4/871: symlink d1/d35/d6b/df2/d20/d58/d102/l13f 0 2024-04-22T00:11:55.373 INFO:tasks.workunit.client.0.smithi110.stdout:6/956: write d16/d3d/f81 [1385702,53969] 0 2024-04-22T00:11:55.566 INFO:tasks.workunit.client.0.smithi110.stdout:4/872: dread - d1/d35/fab zero size 2024-04-22T00:11:55.634 INFO:tasks.workunit.client.0.smithi110.stdout:7/968: creat d10/d45/d60/d5e/d65/d8a/deb/d13c/f14a x:0 0 0 2024-04-22T00:11:55.700 INFO:tasks.workunit.client.0.smithi110.stdout:0/941: fdatasync d0/d14/d23/fc2 0 2024-04-22T00:11:55.787 INFO:tasks.workunit.client.0.smithi110.stdout:1/933: dwrite d1/d2/d1b/f35 [4194304,4194304] 0 2024-04-22T00:11:56.608 INFO:tasks.workunit.client.0.smithi110.stdout:9/939: dwrite d1/d29/d2a/d6/f56 [0,4194304] 0 2024-04-22T00:11:56.767 INFO:tasks.workunit.client.0.smithi110.stdout:5/942: write d7/d24/d3a/d54/ffe [4488512,19686] 0 2024-04-22T00:11:56.770 INFO:tasks.workunit.client.0.smithi110.stdout:4/873: creat d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/f140 x:0 0 0 2024-04-22T00:11:56.861 INFO:tasks.workunit.client.0.smithi110.stdout:1/934: symlink d1/dd/d23/d48/d4e/ddc/d117/l146 0 2024-04-22T00:11:57.066 INFO:tasks.workunit.client.0.smithi110.stdout:6/957: mkdir d16/d3d/d40/d46/d10b/d127/d146 0 2024-04-22T00:11:57.936 INFO:tasks.workunit.client.0.smithi110.stdout:3/957: rename d6/d12/f29 to d6/d12/d50/d138/d121/d141/db5/db9/f148 0 2024-04-22T00:11:57.956 INFO:tasks.workunit.client.0.smithi110.stdout:5/943: creat d7/d22/d5b/da5/db6/f118 x:0 0 0 2024-04-22T00:11:58.137 INFO:tasks.workunit.client.0.smithi110.stdout:5/944: dread - d7/d24/d37/f117 zero size 2024-04-22T00:11:58.269 INFO:tasks.workunit.client.0.smithi110.stdout:0/942: write d0/d16/d42/d50/d83/fbf [887232,120813] 0 2024-04-22T00:11:58.571 INFO:tasks.workunit.client.0.smithi110.stdout:6/958: dread d16/d3d/f43 [0,4194304] 0 2024-04-22T00:11:58.721 INFO:tasks.workunit.client.0.smithi110.stdout:7/969: dwrite d10/f1d [0,4194304] 0 2024-04-22T00:11:59.241 INFO:tasks.workunit.client.0.smithi110.stdout:4/874: write d1/fe5 [3934867,17737] 0 2024-04-22T00:11:59.386 INFO:tasks.workunit.client.0.smithi110.stdout:6/959: symlink d16/d1d/d38/d48/d5e/d6a/d70/l147 0 2024-04-22T00:11:59.399 INFO:tasks.workunit.client.0.smithi110.stdout:9/940: write d1/d29/d4d/dac/dbf/dda/ff3 [5058984,20227] 0 2024-04-22T00:11:59.682 INFO:tasks.workunit.client.0.smithi110.stdout:4/875: dread d1/d35/d6b/df2/d20/fa4 [0,4194304] 0 2024-04-22T00:11:59.926 INFO:tasks.workunit.client.0.smithi110.stdout:5/945: symlink d7/d22/d5b/d109/l119 0 2024-04-22T00:11:59.936 INFO:tasks.workunit.client.0.smithi110.stdout:1/935: rename d1/dd/d23/l2e to d1/d2/d30/d9c/d145/l147 0 2024-04-22T00:12:00.019 INFO:tasks.workunit.client.0.smithi110.stdout:7/970: dread d10/d45/d51/d88/f54 [0,4194304] 0 2024-04-22T00:12:00.255 INFO:tasks.workunit.client.0.smithi110.stdout:4/876: unlink d1/d35/d6b/df2/f69 0 2024-04-22T00:12:00.398 INFO:tasks.workunit.client.0.smithi110.stdout:9/941: mknod d1/c126 0 2024-04-22T00:12:00.684 INFO:tasks.workunit.client.0.smithi110.stdout:6/960: truncate d16/d1d/d38/d48/d5e/d62/d94/ff4 554693 0 2024-04-22T00:12:00.720 INFO:tasks.workunit.client.0.smithi110.stdout:3/958: write d6/d12/d50/d138/d121/d141/db5/db9/dc6/f137 [115799,52734] 0 2024-04-22T00:12:00.853 INFO:tasks.workunit.client.0.smithi110.stdout:1/936: fsync d1/dd/d23/d48/d4e/fb2 0 2024-04-22T00:12:01.291 INFO:tasks.workunit.client.0.smithi110.stdout:4/877: read d1/f8 [4753560,62814] 0 2024-04-22T00:12:01.332 INFO:tasks.workunit.client.0.smithi110.stdout:9/942: mkdir d1/d29/d2a/d2b/d58/da8/d127 0 2024-04-22T00:12:01.433 INFO:tasks.workunit.client.0.smithi110.stdout:0/943: dwrite d0/d14/d23/f3a [0,4194304] 0 2024-04-22T00:12:01.512 INFO:tasks.workunit.client.0.smithi110.stdout:5/946: creat d7/d24/d3a/d54/dfa/f11a x:0 0 0 2024-04-22T00:12:01.533 INFO:tasks.workunit.client.0.smithi110.stdout:9/943: stat d1/d29/d4d/lc5 0 2024-04-22T00:12:01.579 INFO:tasks.workunit.client.0.smithi110.stdout:3/959: dread - d6/d12/d50/d138/fce zero size 2024-04-22T00:12:02.567 INFO:tasks.workunit.client.0.smithi110.stdout:4/878: symlink d1/d35/df6/l141 0 2024-04-22T00:12:02.622 INFO:tasks.workunit.client.0.smithi110.stdout:4/879: read d1/d35/d6b/df2/d12/f64 [612760,12419] 0 2024-04-22T00:12:02.904 INFO:tasks.workunit.client.0.smithi110.stdout:6/961: write d16/d1d/d38/dfe/f129 [93189,1727] 0 2024-04-22T00:12:03.366 INFO:tasks.workunit.client.0.smithi110.stdout:7/971: dwrite d10/d27/f146 [0,4194304] 0 2024-04-22T00:12:03.609 INFO:tasks.workunit.client.0.smithi110.stdout:0/944: getdents d0/d16/d5d/d134 0 2024-04-22T00:12:03.680 INFO:tasks.workunit.client.0.smithi110.stdout:9/944: dread d1/d29/d4d/f68 [0,4194304] 0 2024-04-22T00:12:03.865 INFO:tasks.workunit.client.0.smithi110.stdout:0/945: chown d0/d14/d23/d6d/da8/d136 18955 1 2024-04-22T00:12:03.890 INFO:tasks.workunit.client.0.smithi110.stdout:1/937: dwrite d1/dd/d23/d48/d112/fee [4194304,4194304] 0 2024-04-22T00:12:04.008 INFO:tasks.workunit.client.0.smithi110.stdout:5/947: rmdir d7/d22/d5d 39 2024-04-22T00:12:04.066 INFO:tasks.workunit.client.0.smithi110.stdout:1/938: stat d1/dd/d23/d48/d4e/ddc/d117 0 2024-04-22T00:12:04.200 INFO:tasks.workunit.client.0.smithi110.stdout:3/960: rename d6/d12/l69 to d6/d12/d16/d30/dc7/l149 0 2024-04-22T00:12:04.491 INFO:tasks.workunit.client.0.smithi110.stdout:4/880: mknod d1/d35/d6b/df2/d20/d58/d7e/dd7/c142 0 2024-04-22T00:12:04.511 INFO:tasks.workunit.client.0.smithi110.stdout:9/945: stat d1/cc3 0 2024-04-22T00:12:04.630 INFO:tasks.workunit.client.0.smithi110.stdout:7/972: creat d10/d45/d60/d5e/d11b/f14b x:0 0 0 2024-04-22T00:12:04.990 INFO:tasks.workunit.client.0.smithi110.stdout:5/948: fsync f5 0 2024-04-22T00:12:04.991 INFO:tasks.workunit.client.0.smithi110.stdout:6/962: creat d16/d1d/d38/d48/d5e/d125/f148 x:0 0 0 2024-04-22T00:12:05.334 INFO:tasks.workunit.client.0.smithi110.stdout:1/939: creat d1/dd/d23/d48/d112/f148 x:0 0 0 2024-04-22T00:12:05.427 INFO:tasks.workunit.client.0.smithi110.stdout:1/940: readlink d1/dd/d23/dcc/d138/d70/lbd 0 2024-04-22T00:12:05.762 INFO:tasks.workunit.client.0.smithi110.stdout:4/881: fdatasync d1/d35/d6b/df2/d20/d50/f70 0 2024-04-22T00:12:06.020 INFO:tasks.workunit.client.0.smithi110.stdout:7/973: creat d10/d45/d51/db1/dee/df0/df9/f14c x:0 0 0 2024-04-22T00:12:06.186 INFO:tasks.workunit.client.0.smithi110.stdout:0/946: creat d0/d27/d68/d7d/d11a/d11b/f143 x:0 0 0 2024-04-22T00:12:06.741 INFO:tasks.workunit.client.0.smithi110.stdout:1/941: mkdir d1/dd/d23/dcc/d138/d70/de4/d149 0 2024-04-22T00:12:07.050 INFO:tasks.workunit.client.0.smithi110.stdout:4/882: fdatasync d1/d35/d6b/df2/d20/d50/fc5 0 2024-04-22T00:12:08.086 INFO:tasks.workunit.client.0.smithi110.stdout:7/974: truncate d10/d45/d51/d88/d39/f92 4653371 0 2024-04-22T00:12:08.090 INFO:tasks.workunit.client.0.smithi110.stdout:4/883: fdatasync d1/d35/d6b/df2/d20/d23/d1c/d40/f73 0 2024-04-22T00:12:08.600 INFO:tasks.workunit.client.0.smithi110.stdout:3/961: dwrite d6/d12/f1a [0,4194304] 0 2024-04-22T00:12:08.716 INFO:tasks.workunit.client.0.smithi110.stdout:5/949: link d7/d9/d17/d48/f103 d7/d24/d37/dd7/f11b 0 2024-04-22T00:12:08.860 INFO:tasks.workunit.client.0.smithi110.stdout:9/946: write d1/d29/d4d/f80 [356078,71400] 0 2024-04-22T00:12:09.134 INFO:tasks.workunit.client.0.smithi110.stdout:4/884: fsync d1/d35/d6b/df2/d20/d58/d7e/fe7 0 2024-04-22T00:12:09.407 INFO:tasks.workunit.client.0.smithi110.stdout:1/942: creat d1/d2/d1b/f14a x:0 0 0 2024-04-22T00:12:09.662 INFO:tasks.workunit.client.0.smithi110.stdout:9/947: unlink d1/d29/d4d/dac/dbf/lde 0 2024-04-22T00:12:10.066 INFO:tasks.workunit.client.0.smithi110.stdout:4/885: fdatasync d1/d35/d6b/df2/d20/fa4 0 2024-04-22T00:12:10.209 INFO:tasks.workunit.client.0.smithi110.stdout:6/963: write d16/d1d/d38/d48/d5e/d6a/db6/f108 [111973,23668] 0 2024-04-22T00:12:10.264 INFO:tasks.workunit.client.0.smithi110.stdout:6/964: chown d16/d1e/d24/d33/d85/ddd/d141 461577 1 2024-04-22T00:12:10.310 INFO:tasks.workunit.client.0.smithi110.stdout:5/950: symlink d7/d24/d3a/d40/ddc/d10c/l11c 0 2024-04-22T00:12:10.748 INFO:tasks.workunit.client.0.smithi110.stdout:3/962: rename d6/d12/d16/d30/dc7/l147 to d6/d12/d14/d4b/l14a 0 2024-04-22T00:12:10.878 INFO:tasks.workunit.client.0.smithi110.stdout:9/948: fsync d1/d29/d2a/d6/f10d 0 2024-04-22T00:12:11.139 INFO:tasks.workunit.client.0.smithi110.stdout:4/886: fsync d1/d35/d6b/df2/f8a 0 2024-04-22T00:12:11.243 INFO:tasks.workunit.client.0.smithi110.stdout:4/887: dread d1/d35/d6b/df2/d20/d58/d7e/f116 [4194304,4194304] 0 2024-04-22T00:12:11.264 INFO:tasks.workunit.client.0.smithi110.stdout:6/965: symlink d16/d1e/d24/d33/l149 0 2024-04-22T00:12:11.425 INFO:tasks.workunit.client.0.smithi110.stdout:5/951: creat d7/d24/d49/d64/f11d x:0 0 0 2024-04-22T00:12:11.616 INFO:tasks.workunit.client.0.smithi110.stdout:0/947: dwrite d0/d25/d5a/fb3 [0,4194304] 0 2024-04-22T00:12:11.889 INFO:tasks.workunit.client.0.smithi110.stdout:3/963: creat d6/d12/d14/f14b x:0 0 0 2024-04-22T00:12:12.478 INFO:tasks.workunit.client.0.smithi110.stdout:6/966: rename d16/d3d/f81 to d16/d1e/d24/d33/d85/f14a 0 2024-04-22T00:12:12.622 INFO:tasks.workunit.client.0.smithi110.stdout:7/975: dwrite d10/d45/d60/d5e/d65/d8a/f132 [0,4194304] 0 2024-04-22T00:12:13.058 INFO:tasks.workunit.client.0.smithi110.stdout:4/888: symlink d1/d35/d6b/df2/d20/d23/d1c/d47/d95/l143 0 2024-04-22T00:12:13.270 INFO:tasks.workunit.client.0.smithi110.stdout:5/952: truncate d7/d24/d37/d38/d88/fcb 420978 0 2024-04-22T00:12:13.364 INFO:tasks.workunit.client.0.smithi110.stdout:3/964: symlink d6/d12/d50/d138/d121/d141/db5/dd3/l14c 0 2024-04-22T00:12:13.410 INFO:tasks.workunit.client.0.smithi110.stdout:9/949: fdatasync d1/d29/d59/d99/deb/f103 0 2024-04-22T00:12:14.408 INFO:tasks.workunit.client.0.smithi110.stdout:1/943: dwrite d1/d2/d1b/d10/d5c/f101 [0,4194304] 0 2024-04-22T00:12:14.520 INFO:tasks.workunit.client.0.smithi110.stdout:7/976: getdents d10/d13b 0 2024-04-22T00:12:14.564 INFO:tasks.workunit.client.0.smithi110.stdout:1/944: readlink d1/d2/d30/lbb 0 2024-04-22T00:12:14.891 INFO:tasks.workunit.client.0.smithi110.stdout:9/950: dread d1/d29/d2a/ff8 [0,4194304] 0 2024-04-22T00:12:14.931 INFO:tasks.workunit.client.0.smithi110.stdout:9/951: chown d1/d29/d2a/d2b/d58/l65 8369 1 2024-04-22T00:12:15.003 INFO:tasks.workunit.client.0.smithi110.stdout:3/965: creat d6/d12/d3c/f14d x:0 0 0 2024-04-22T00:12:15.050 INFO:tasks.workunit.client.0.smithi110.stdout:3/966: read d6/d12/d14/d32/f3b [202396,60499] 0 2024-04-22T00:12:15.081 INFO:tasks.workunit.client.0.smithi110.stdout:3/967: chown d6/d12/d14/f14b 44 1 2024-04-22T00:12:15.186 INFO:tasks.workunit.client.0.smithi110.stdout:3/968: sync 2024-04-22T00:12:15.654 INFO:tasks.workunit.client.0.smithi110.stdout:7/977: creat d10/d45/d51/f14d x:0 0 0 2024-04-22T00:12:15.792 INFO:tasks.workunit.client.0.smithi110.stdout:1/945: dread d1/dd/d23/dcc/d138/d4a/ffa [0,4194304] 0 2024-04-22T00:12:16.026 INFO:tasks.workunit.client.0.smithi110.stdout:3/969: rename d6/d12/d16/f114 to d6/d12/d3c/d65/d91/d116/f14e 0 2024-04-22T00:12:16.284 INFO:tasks.workunit.client.0.smithi110.stdout:7/978: rmdir d10/d45/d51/db1/dee/df0 39 2024-04-22T00:12:16.570 INFO:tasks.workunit.client.0.smithi110.stdout:0/948: dwrite d0/d16/d42/ff5 [0,4194304] 0 2024-04-22T00:12:16.995 INFO:tasks.workunit.client.0.smithi110.stdout:6/967: dwrite d16/d3d/d97/dd0/df9/f107 [0,4194304] 0 2024-04-22T00:12:17.158 INFO:tasks.workunit.client.0.smithi110.stdout:4/889: dwrite d1/d35/d6b/df2/fde [0,4194304] 0 2024-04-22T00:12:17.363 INFO:tasks.workunit.client.0.smithi110.stdout:5/953: dwrite d7/d9/f21 [0,4194304] 0 2024-04-22T00:12:18.093 INFO:tasks.workunit.client.0.smithi110.stdout:9/952: dwrite d1/d29/d2a/d6/d1d/f7c [4194304,4194304] 0 2024-04-22T00:12:18.112 INFO:tasks.workunit.client.0.smithi110.stdout:1/946: dwrite d1/dd/d23/dcc/d138/d57/f81 [0,4194304] 0 2024-04-22T00:12:18.326 INFO:tasks.workunit.client.0.smithi110.stdout:7/979: rmdir d10/d27 39 2024-04-22T00:12:18.735 INFO:tasks.workunit.client.0.smithi110.stdout:4/890: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d95/dcd/f144 x:0 0 0 2024-04-22T00:12:18.768 INFO:tasks.workunit.client.0.smithi110.stdout:3/970: truncate d6/d12/d50/d138/d121/d141/db5/db9/dc6/d10d/f135 220570 0 2024-04-22T00:12:18.819 INFO:tasks.workunit.client.0.smithi110.stdout:5/954: dread d7/d9/d17/d48/d69/ffd [0,4194304] 0 2024-04-22T00:12:18.997 INFO:tasks.workunit.client.0.smithi110.stdout:6/968: rename d16/d1d/d38/d48/d5e/d6a/d70/d86/d110/d130 to d16/d1e/d24/d33/d85/ddd/d14b 0 2024-04-22T00:12:19.211 INFO:tasks.workunit.client.0.smithi110.stdout:1/947: creat d1/d2/d30/d9c/f14b x:0 0 0 2024-04-22T00:12:19.296 INFO:tasks.workunit.client.0.smithi110.stdout:4/891: dwrite d1/d35/d6b/df2/d20/d23/d1c/d47/d95/dcd/f144 [0,4194304] 0 2024-04-22T00:12:19.524 INFO:tasks.workunit.client.0.smithi110.stdout:7/980: symlink d10/d45/d60/l14e 0 2024-04-22T00:12:19.705 INFO:tasks.workunit.client.0.smithi110.stdout:0/949: dwrite d0/d14/d23/d3b/f67 [4194304,4194304] 0 2024-04-22T00:12:19.886 INFO:tasks.workunit.client.0.smithi110.stdout:1/948: chown d1/dd/d23/dcc/d138/d57/f81 1368584 1 2024-04-22T00:12:20.117 INFO:tasks.workunit.client.0.smithi110.stdout:9/953: creat d1/d29/d4d/dac/dbf/f128 x:0 0 0 2024-04-22T00:12:20.130 INFO:tasks.workunit.client.0.smithi110.stdout:3/971: dread d6/d12/d50/d138/d121/d141/fad [0,4194304] 0 2024-04-22T00:12:20.163 INFO:tasks.workunit.client.0.smithi110.stdout:6/969: mkdir d16/d1d/d38/d48/d5e/d6a/db6/d14c 0 2024-04-22T00:12:20.222 INFO:tasks.workunit.client.0.smithi110.stdout:7/981: dread - d10/d45/d60/d5e/d11b/f14b zero size 2024-04-22T00:12:20.314 INFO:tasks.workunit.client.0.smithi110.stdout:1/949: stat d1/dd/d23/d48/d4e/c53 0 2024-04-22T00:12:20.318 INFO:tasks.workunit.client.0.smithi110.stdout:6/970: stat d16/d1e/d24/c140 0 2024-04-22T00:12:20.361 INFO:tasks.workunit.client.0.smithi110.stdout:7/982: stat d10/d45/d51/db1/dee 0 2024-04-22T00:12:20.411 INFO:tasks.workunit.client.0.smithi110.stdout:6/971: chown d16/d1e/d24/d33/d85/ff0 226 1 2024-04-22T00:12:20.649 INFO:tasks.workunit.client.0.smithi110.stdout:0/950: dwrite d0/d14/d23/f24 [0,4194304] 0 2024-04-22T00:12:20.663 INFO:tasks.workunit.client.0.smithi110.stdout:4/892: creat d1/d35/d6b/df2/f145 x:0 0 0 2024-04-22T00:12:20.752 INFO:tasks.workunit.client.0.smithi110.stdout:9/954: creat d1/d29/d4d/dac/db8/f129 x:0 0 0 2024-04-22T00:12:20.788 INFO:tasks.workunit.client.0.smithi110.stdout:3/972: mkdir d6/d12/d3c/d8d/dee/d14f 0 2024-04-22T00:12:20.833 INFO:tasks.workunit.client.0.smithi110.stdout:6/972: creat d16/d1d/d38/dab/f14d x:0 0 0 2024-04-22T00:12:20.839 INFO:tasks.workunit.client.0.smithi110.stdout:7/983: truncate d10/d45/d51/d88/dce/f10c 1817280 0 2024-04-22T00:12:20.913 INFO:tasks.workunit.client.0.smithi110.stdout:5/955: symlink d7/d22/d5b/da5/db6/dda/l11e 0 2024-04-22T00:12:21.053 INFO:tasks.workunit.client.0.smithi110.stdout:9/955: read d1/d29/d6f/f83 [3704178,46460] 0 2024-04-22T00:12:21.100 INFO:tasks.workunit.client.0.smithi110.stdout:9/956: write d1/d29/d2a/d6/d1d/f7c [454944,14428] 0 2024-04-22T00:12:21.132 INFO:tasks.workunit.client.0.smithi110.stdout:9/957: stat d1/d29/d2a/d9d/la1 0 2024-04-22T00:12:21.225 INFO:tasks.workunit.client.0.smithi110.stdout:0/951: write d0/d16/f58 [761137,883] 0 2024-04-22T00:12:21.403 INFO:tasks.workunit.client.0.smithi110.stdout:7/984: fdatasync d10/d45/f4f 0 2024-04-22T00:12:21.452 INFO:tasks.workunit.client.0.smithi110.stdout:6/973: read - d16/d1d/d38/d48/d5e/d62/f10e zero size 2024-04-22T00:12:21.497 INFO:tasks.workunit.client.0.smithi110.stdout:3/973: dread d6/d12/d50/d138/d121/d141/db5/db9/dc6/f137 [0,4194304] 0 2024-04-22T00:12:21.587 INFO:tasks.workunit.client.0.smithi110.stdout:3/974: stat d6/d12/d50/d138/d121/d141/dab/ld9 0 2024-04-22T00:12:21.791 INFO:tasks.workunit.client.0.smithi110.stdout:4/893: creat d1/d35/d6b/df2/d20/d23/d105/f146 x:0 0 0 2024-04-22T00:12:21.935 INFO:tasks.workunit.client.0.smithi110.stdout:1/950: getdents d1/d2/d1b/d10/d5c/d77/d78/deb/d8d/d119 0 2024-04-22T00:12:22.124 INFO:tasks.workunit.client.0.smithi110.stdout:5/956: write d7/d24/d3a/d54/dfa/f11a [335228,83566] 0 2024-04-22T00:12:22.419 INFO:tasks.workunit.client.0.smithi110.stdout:4/894: mkdir d1/d35/d6b/df2/d20/d23/d105/d147 0 2024-04-22T00:12:22.442 INFO:tasks.workunit.client.0.smithi110.stdout:1/951: read - d1/d2/d30/db9/fdd zero size 2024-04-22T00:12:22.557 INFO:tasks.workunit.client.0.smithi110.stdout:3/975: getdents d6/d12/da1/dea/d120 0 2024-04-22T00:12:22.600 INFO:tasks.workunit.client.0.smithi110.stdout:3/976: stat d6/d12/d14/d32/c55 0 2024-04-22T00:12:22.893 INFO:tasks.workunit.client.0.smithi110.stdout:0/952: dwrite d0/d14/f32 [4194304,4194304] 0 2024-04-22T00:12:23.080 INFO:tasks.workunit.client.0.smithi110.stdout:0/953: chown d0/d56/l9c 87 1 2024-04-22T00:12:23.358 INFO:tasks.workunit.client.0.smithi110.stdout:9/958: write d1/d29/d2a/dc/f90 [1166200,89364] 0 2024-04-22T00:12:23.440 INFO:tasks.workunit.client.0.smithi110.stdout:6/974: getdents d16/d3d/d97/dd0 0 2024-04-22T00:12:23.673 INFO:tasks.workunit.client.0.smithi110.stdout:7/985: dwrite d10/d45/d60/d5e/d11b/f148 [0,4194304] 0 2024-04-22T00:12:24.021 INFO:tasks.workunit.client.0.smithi110.stdout:1/952: write d1/d2/d1b/d10/d5c/dc5/d27/d3e/fe6 [344081,22436] 0 2024-04-22T00:12:24.129 INFO:tasks.workunit.client.0.smithi110.stdout:5/957: dwrite d7/d24/d3a/d54/fa3 [0,4194304] 0 2024-04-22T00:12:24.608 INFO:tasks.workunit.client.0.smithi110.stdout:4/895: dwrite d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d131/f137 [0,4194304] 0 2024-04-22T00:12:24.713 INFO:tasks.workunit.client.0.smithi110.stdout:7/986: mkdir d10/d45/d60/d5e/d65/d14f 0 2024-04-22T00:12:24.853 INFO:tasks.workunit.client.0.smithi110.stdout:3/977: dwrite d6/d12/d14/d32/f6d [0,4194304] 0 2024-04-22T00:12:25.318 INFO:tasks.workunit.client.0.smithi110.stdout:1/953: symlink d1/d2/d30/d8b/l14c 0 2024-04-22T00:12:26.271 INFO:tasks.workunit.client.0.smithi110.stdout:3/978: stat d6/d12/d50/d138/l48 0 2024-04-22T00:12:26.355 INFO:tasks.workunit.client.0.smithi110.stdout:4/896: truncate d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/f129 635848 0 2024-04-22T00:12:26.619 INFO:tasks.workunit.client.0.smithi110.stdout:0/954: rename d0/d14/d23/f3a to d0/f144 0 2024-04-22T00:12:27.440 INFO:tasks.workunit.client.0.smithi110.stdout:5/958: dwrite d7/d24/d37/d38/f4d [8388608,4194304] 0 2024-04-22T00:12:27.579 INFO:tasks.workunit.client.0.smithi110.stdout:6/975: getdents d16/d1d/d38/dfe 0 2024-04-22T00:12:27.611 INFO:tasks.workunit.client.0.smithi110.stdout:4/897: dread d1/d35/d6b/df2/d20/d50/fa3 [0,4194304] 0 2024-04-22T00:12:27.741 INFO:tasks.workunit.client.0.smithi110.stdout:7/987: rename d10/d45/d51/c123 to d10/d13b/c150 0 2024-04-22T00:12:27.812 INFO:tasks.workunit.client.0.smithi110.stdout:0/955: rename d0/d16/d5d/c7b to d0/d16/d5d/c145 0 2024-04-22T00:12:27.840 INFO:tasks.workunit.client.0.smithi110.stdout:0/956: chown d0/d16/d42/f4c 86951 1 2024-04-22T00:12:27.927 INFO:tasks.workunit.client.0.smithi110.stdout:6/976: sync 2024-04-22T00:12:28.017 INFO:tasks.workunit.client.0.smithi110.stdout:9/959: getdents d1/d29/d2a/d2b/d58 0 2024-04-22T00:12:29.116 INFO:tasks.workunit.client.0.smithi110.stdout:1/954: dwrite d1/dd/d23/dcc/f32 [4194304,4194304] 0 2024-04-22T00:12:29.537 INFO:tasks.workunit.client.0.smithi110.stdout:0/957: fdatasync d0/d16/d42/d50/dbc/dc8/f116 0 2024-04-22T00:12:29.547 INFO:tasks.workunit.client.0.smithi110.stdout:3/979: write d6/d12/d50/d138/d121/d141/db5/def/f146 [340008,47071] 0 2024-04-22T00:12:29.665 INFO:tasks.workunit.client.0.smithi110.stdout:6/977: dread d16/d1e/d24/d90/dac/fd8 [0,4194304] 0 2024-04-22T00:12:30.682 INFO:tasks.workunit.client.0.smithi110.stdout:1/955: read - d1/d2/d1b/d10/d5c/d77/fd9 zero size 2024-04-22T00:12:31.109 INFO:tasks.workunit.client.0.smithi110.stdout:6/978: unlink d16/d3d/d97/dd0/fb0 0 2024-04-22T00:12:31.258 INFO:tasks.workunit.client.0.smithi110.stdout:9/960: unlink d1/d29/d4d/dac/l117 0 2024-04-22T00:12:31.312 INFO:tasks.workunit.client.0.smithi110.stdout:0/958: dread d0/d16/d42/ff5 [0,4194304] 0 2024-04-22T00:12:31.418 INFO:tasks.workunit.client.0.smithi110.stdout:4/898: dwrite d1/d35/d6b/df2/d20/d50/fb0 [0,4194304] 0 2024-04-22T00:12:32.115 INFO:tasks.workunit.client.0.smithi110.stdout:6/979: mkdir d16/d1e/d24/d90/d14e 0 2024-04-22T00:12:32.610 INFO:tasks.workunit.client.0.smithi110.stdout:3/980: link d6/d12/d16/l1c d6/d12/d50/d138/d121/d141/dab/l150 0 2024-04-22T00:12:32.628 INFO:tasks.workunit.client.0.smithi110.stdout:5/959: write d7/d9/d17/f2c [55008,27355] 0 2024-04-22T00:12:33.305 INFO:tasks.workunit.client.0.smithi110.stdout:7/988: creat d10/d45/f151 x:0 0 0 2024-04-22T00:12:33.802 INFO:tasks.workunit.client.0.smithi110.stdout:4/899: rename d1/d35/d6b/df2/d20/d58/d93/l3e to d1/d35/d6b/df2/d20/d58/l148 0 2024-04-22T00:12:33.894 INFO:tasks.workunit.client.0.smithi110.stdout:6/980: mkdir d16/d14f 0 2024-04-22T00:12:34.300 INFO:tasks.workunit.client.0.smithi110.stdout:1/956: link d1/d2/d1b/l122 d1/d2/d14/l14d 0 2024-04-22T00:12:34.300 INFO:tasks.workunit.client.0.smithi110.stdout:5/960: dread d7/d9/d17/d48/f63 [0,4194304] 0 2024-04-22T00:12:34.737 INFO:tasks.workunit.client.0.smithi110.stdout:3/981: rename d6/d12/d50/d138/d121/d141/db5/db9/dc6/d10d/c11a to d6/d12/d50/d10b/c151 0 2024-04-22T00:12:34.771 INFO:tasks.workunit.client.0.smithi110.stdout:0/959: dwrite d0/d56/d10f/f139 [0,4194304] 0 2024-04-22T00:12:34.968 INFO:tasks.workunit.client.0.smithi110.stdout:9/961: dwrite d1/d29/d2a/d2b/f7f [0,4194304] 0 2024-04-22T00:12:35.167 INFO:tasks.workunit.client.0.smithi110.stdout:7/989: symlink d10/d15/l152 0 2024-04-22T00:12:35.216 INFO:tasks.workunit.client.0.smithi110.stdout:7/990: readlink d10/d45/d60/d5e/lcc 0 2024-04-22T00:12:35.659 INFO:tasks.workunit.client.0.smithi110.stdout:0/960: creat d0/d27/dcd/f146 x:0 0 0 2024-04-22T00:12:35.845 INFO:tasks.workunit.client.0.smithi110.stdout:3/982: creat d6/d12/d50/d138/d121/d141/db5/dd3/f152 x:0 0 0 2024-04-22T00:12:35.940 INFO:tasks.workunit.client.0.smithi110.stdout:9/962: truncate d1/d29/d2a/d2b/d58/f95 1092108 0 2024-04-22T00:12:36.729 INFO:tasks.workunit.client.0.smithi110.stdout:1/957: mknod d1/d2/d1b/d10/d5c/dc5/d27/c14e 0 2024-04-22T00:12:36.779 INFO:tasks.workunit.client.0.smithi110.stdout:3/983: mkdir d6/d12/d50/d138/d121/d141/d7a/d153 0 2024-04-22T00:12:36.793 INFO:tasks.workunit.client.0.smithi110.stdout:6/981: dwrite d16/d1d/f4a [0,4194304] 0 2024-04-22T00:12:37.229 INFO:tasks.workunit.client.0.smithi110.stdout:4/900: dwrite d1/d35/d6b/df2/d20/dc4/f119 [0,4194304] 0 2024-04-22T00:12:38.021 INFO:tasks.workunit.client.0.smithi110.stdout:4/901: symlink d1/d35/d6b/df2/d20/d58/d93/d7c/l149 0 2024-04-22T00:12:38.063 INFO:tasks.workunit.client.0.smithi110.stdout:4/902: chown d1/d35/d6b/df2/d12/de6/l103 1 1 2024-04-22T00:12:38.114 INFO:tasks.workunit.client.0.smithi110.stdout:7/991: write d10/d45/d51/d88/f8e [9310915,125819] 0 2024-04-22T00:12:38.678 INFO:tasks.workunit.client.0.smithi110.stdout:5/961: dwrite d7/d24/d49/d61/fbe [0,4194304] 0 2024-04-22T00:12:39.163 INFO:tasks.workunit.client.0.smithi110.stdout:0/961: dwrite d0/d25/d5a/d63/f12d [0,4194304] 0 2024-04-22T00:12:39.539 INFO:tasks.workunit.client.0.smithi110.stdout:3/984: write d6/d12/d16/d5d/dd8/fe4 [450795,106332] 0 2024-04-22T00:12:39.556 INFO:tasks.workunit.client.0.smithi110.stdout:1/958: write d1/d2/d30/db9/fc2 [1928572,119669] 0 2024-04-22T00:12:39.585 INFO:tasks.workunit.client.0.smithi110.stdout:9/963: dwrite d1/d29/d2a/d3c/ff2 [0,4194304] 0 2024-04-22T00:12:39.745 INFO:tasks.workunit.client.0.smithi110.stdout:6/982: write d16/d1d/d38/d48/d5e/d62/d94/ff4 [1554229,69608] 0 2024-04-22T00:12:39.795 INFO:tasks.workunit.client.0.smithi110.stdout:5/962: creat d7/d35/dd6/dfb/f11f x:0 0 0 2024-04-22T00:12:40.005 INFO:tasks.workunit.client.0.smithi110.stdout:1/959: chown d1/dd/d23/dcc/lf9 1871113 1 2024-04-22T00:12:40.052 INFO:tasks.workunit.client.0.smithi110.stdout:6/983: sync 2024-04-22T00:12:40.056 INFO:tasks.workunit.client.0.smithi110.stdout:4/903: dwrite d1/d35/d6b/df2/d20/d58/d93/f11b [0,4194304] 0 2024-04-22T00:12:40.301 INFO:tasks.workunit.client.0.smithi110.stdout:6/984: dread d16/d3d/f43 [0,4194304] 0 2024-04-22T00:12:40.514 INFO:tasks.workunit.client.0.smithi110.stdout:7/992: write d10/d45/d51/db1/dc9/df5/f44 [1585021,50020] 0 2024-04-22T00:12:40.519 INFO:tasks.workunit.client.0.smithi110.stdout:3/985: rmdir d6/d12/d3c/d65/d91 39 2024-04-22T00:12:40.563 INFO:tasks.workunit.client.0.smithi110.stdout:4/904: fdatasync d1/d35/d6b/df2/d20/d23/fc3 0 2024-04-22T00:12:40.592 INFO:tasks.workunit.client.0.smithi110.stdout:9/964: chown d1/d19/l4c 1537 1 2024-04-22T00:12:40.648 INFO:tasks.workunit.client.0.smithi110.stdout:3/986: readlink d6/d12/d16/l22 0 2024-04-22T00:12:40.731 INFO:tasks.workunit.client.0.smithi110.stdout:9/965: stat d1/d29/d6f/db4/fa3 0 2024-04-22T00:12:40.765 INFO:tasks.workunit.client.0.smithi110.stdout:5/963: dread d7/d24/d3a/d54/fa3 [0,4194304] 0 2024-04-22T00:12:40.851 INFO:tasks.workunit.client.0.smithi110.stdout:9/966: dread - d1/d29/d2a/d2b/d58/da8/fbc zero size 2024-04-22T00:12:41.315 INFO:tasks.workunit.client.0.smithi110.stdout:4/905: creat d1/d35/d6b/df2/d20/df5/f14a x:0 0 0 2024-04-22T00:12:41.654 INFO:tasks.workunit.client.0.smithi110.stdout:9/967: symlink d1/d29/d4d/l12a 0 2024-04-22T00:12:41.831 INFO:tasks.workunit.client.0.smithi110.stdout:1/960: creat d1/d2/d1b/d10/d5c/dc5/f14f x:0 0 0 2024-04-22T00:12:41.864 INFO:tasks.workunit.client.0.smithi110.stdout:5/964: dread d7/d9/d17/f51 [0,4194304] 0 2024-04-22T00:12:41.944 INFO:tasks.workunit.client.0.smithi110.stdout:7/993: unlink d10/d45/d51/d58/le7 0 2024-04-22T00:12:42.261 INFO:tasks.workunit.client.0.smithi110.stdout:6/985: dwrite d16/d1d/d38/d48/d5e/d62/fd7 [0,4194304] 0 2024-04-22T00:12:42.426 INFO:tasks.workunit.client.0.smithi110.stdout:4/906: rename d1/d35/d6b/df2/d20/d23/fac to d1/d35/d6b/df2/d20/d58/d7e/ddd/deb/f14b 0 2024-04-22T00:12:42.436 INFO:tasks.workunit.client.0.smithi110.stdout:0/962: link d0/d27/d4b/d7f/dc1/l126 d0/d27/d68/d12c/l147 0 2024-04-22T00:12:42.534 INFO:tasks.workunit.client.0.smithi110.stdout:9/968: dread - d1/d19/d42/f120 zero size 2024-04-22T00:12:42.622 INFO:tasks.workunit.client.0.smithi110.stdout:3/987: dwrite d6/d12/d14/f7e [0,4194304] 0 2024-04-22T00:12:42.787 INFO:tasks.workunit.client.0.smithi110.stdout:1/961: symlink d1/dd/d23/d48/d4e/ddc/d117/l150 0 2024-04-22T00:12:43.147 INFO:tasks.workunit.client.0.smithi110.stdout:7/994: rename d10/d15/d95/d101/lf3 to d10/d45/d51/d88/d39/d7f/l153 0 2024-04-22T00:12:43.295 INFO:tasks.workunit.client.0.smithi110.stdout:9/969: symlink d1/d29/d6f/l12b 0 2024-04-22T00:12:44.224 INFO:tasks.workunit.client.0.smithi110.stdout:7/995: mknod d10/d45/d60/d5e/c154 0 2024-04-22T00:12:44.887 INFO:tasks.workunit.client.0.smithi110.stdout:1/962: write d1/dd/d23/d48/d112/f148 [717431,29169] 0 2024-04-22T00:12:45.013 INFO:tasks.workunit.client.0.smithi110.stdout:5/965: link d7/d9/d17/d48/d69/ffd d7/d24/d49/ddb/f120 0 2024-04-22T00:12:45.077 INFO:tasks.workunit.client.0.smithi110.stdout:3/988: dwrite d6/d12/d16/d30/d67/f93 [0,4194304] 0 2024-04-22T00:12:45.219 INFO:tasks.workunit.client.0.smithi110.stdout:5/966: stat d7/d22/d5b/d68 0 2024-04-22T00:12:45.477 INFO:tasks.workunit.client.0.smithi110.stdout:7/996: truncate d10/d45/d51/d88/d46/fd8 2065653 0 2024-04-22T00:12:45.827 INFO:tasks.workunit.client.0.smithi110.stdout:6/986: link d16/d1e/d24/c140 d16/d1e/d24/d90/dec/c150 0 2024-04-22T00:12:46.023 INFO:tasks.workunit.client.0.smithi110.stdout:6/987: chown d16/d1d/d38/d48/d5e/d62/f10e 1 1 2024-04-22T00:12:46.144 INFO:tasks.workunit.client.0.smithi110.stdout:0/963: dwrite d0/f21 [0,4194304] 0 2024-04-22T00:12:46.158 INFO:tasks.workunit.client.0.smithi110.stdout:1/963: read - d1/d2/d1b/d10/d5c/d77/d78/fff zero size 2024-04-22T00:12:46.327 INFO:tasks.workunit.client.0.smithi110.stdout:5/967: mknod d7/d24/d49/ddb/c121 0 2024-04-22T00:12:46.460 INFO:tasks.workunit.client.0.smithi110.stdout:4/907: getdents d1/d35/d6b/df2/d20/d23 0 2024-04-22T00:12:46.652 INFO:tasks.workunit.client.0.smithi110.stdout:9/970: dwrite d1/d29/d2a/d6/d1d/f24 [0,4194304] 0 2024-04-22T00:12:47.754 INFO:tasks.workunit.client.0.smithi110.stdout:3/989: symlink d6/d12/d3c/d8d/dee/d14f/l154 0 2024-04-22T00:12:47.770 INFO:tasks.workunit.client.0.smithi110.stdout:6/988: unlink d16/d3d/d40/d46/f79 0 2024-04-22T00:12:47.993 INFO:tasks.workunit.client.0.smithi110.stdout:3/990: dread d6/d12/d16/d30/d67/f93 [0,4194304] 0 2024-04-22T00:12:48.188 INFO:tasks.workunit.client.0.smithi110.stdout:1/964: dread - d1/d2/d30/f127 zero size 2024-04-22T00:12:48.839 INFO:tasks.workunit.client.0.smithi110.stdout:9/971: symlink d1/d29/d2a/d9d/de0/l12c 0 2024-04-22T00:12:49.579 INFO:tasks.workunit.client.0.smithi110.stdout:3/991: dread - d6/d12/d14/d4b/ff4 zero size 2024-04-22T00:12:50.170 INFO:tasks.workunit.client.0.smithi110.stdout:1/965: dread d1/d2/d30/f99 [4194304,4194304] 0 2024-04-22T00:12:50.238 INFO:tasks.workunit.client.0.smithi110.stdout:7/997: dwrite d10/d45/d60/d5e/d65/d8a/deb/f116 [0,4194304] 0 2024-04-22T00:12:50.248 INFO:tasks.workunit.client.0.smithi110.stdout:6/989: mkdir d16/d14f/d151 0 2024-04-22T00:12:50.379 INFO:tasks.workunit.client.0.smithi110.stdout:0/964: write d0/d16/d42/d50/ff9 [5185006,121154] 0 2024-04-22T00:12:50.422 INFO:tasks.workunit.client.0.smithi110.stdout:6/990: chown d16/d1e/d24/f5d 647388 1 2024-04-22T00:12:50.443 INFO:tasks.workunit.client.0.smithi110.stdout:7/998: dread - d10/d45/d51/d88/d46/fdd zero size 2024-04-22T00:12:50.582 INFO:tasks.workunit.client.0.smithi110.stdout:3/992: mkdir d6/d12/d50/d138/d121/d141/db5/def/d155 0 2024-04-22T00:12:50.860 INFO:tasks.workunit.client.0.smithi110.stdout:5/968: dwrite d7/d9/d17/d48/d69/d6d/fff [0,4194304] 0 2024-04-22T00:12:51.317 INFO:tasks.workunit.client.0.smithi110.stdout:0/965: symlink d0/d27/dcd/l148 0 2024-04-22T00:12:51.472 INFO:tasks.workunit.client.0.smithi110.stdout:7/999: dread - d10/d45/d51/d58/f143 zero size 2024-04-22T00:12:51.705 INFO:tasks.workunit.client.0.smithi110.stdout:3/993: mknod d6/d12/d50/d138/d121/d141/dab/c156 0 2024-04-22T00:12:52.075 INFO:tasks.workunit.client.0.smithi110.stdout:1/966: symlink d1/l151 0 2024-04-22T00:12:52.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/972: creat d1/d29/d2a/d9d/f12d x:0 0 0 2024-04-22T00:12:52.537 INFO:tasks.workunit.client.0.smithi110.stdout:0/966: dread d0/d14/d23/d3b/fb5 [0,4194304] 0 2024-04-22T00:12:52.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/994: readlink d6/d12/d3c/l56 0 2024-04-22T00:12:52.685 INFO:tasks.workunit.client.0.smithi110.stdout:5/969: symlink d7/d22/d5d/l122 0 2024-04-22T00:12:52.741 INFO:tasks.workunit.client.0.smithi110.stdout:1/967: fdatasync d1/f115 0 2024-04-22T00:12:52.799 INFO:tasks.workunit.client.0.smithi110.stdout:1/968: chown d1/d2/d30/d8b/dc3/l126 508819754 1 2024-04-22T00:12:53.149 INFO:tasks.workunit.client.0.smithi110.stdout:4/908: dwrite d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8/ffb [0,4194304] 0 2024-04-22T00:12:53.264 INFO:tasks.workunit.client.0.smithi110.stdout:3/995: mkdir d6/d12/d50/d138/d121/d141/db5/dd3/d157 0 2024-04-22T00:12:53.451 INFO:tasks.workunit.client.0.smithi110.stdout:4/909: sync 2024-04-22T00:12:53.573 INFO:tasks.workunit.client.0.smithi110.stdout:5/970: dread d7/d9/d17/d48/d69/ffd [0,4194304] 0 2024-04-22T00:12:53.651 INFO:tasks.workunit.client.0.smithi110.stdout:4/910: dread d1/d35/d6b/df2/fda [0,4194304] 0 2024-04-22T00:12:53.682 INFO:tasks.workunit.client.0.smithi110.stdout:5/971: read - d7/d22/d5b/fdd zero size 2024-04-22T00:12:53.787 INFO:tasks.workunit.client.0.smithi110.stdout:4/911: readlink d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d131/l135 0 2024-04-22T00:12:54.089 INFO:tasks.workunit.client.0.smithi110.stdout:1/969: dread d1/d2/d30/db9/fce [0,4194304] 0 2024-04-22T00:12:54.138 INFO:tasks.workunit.client.0.smithi110.stdout:6/991: write d16/d1e/d24/d90/fc4 [4762108,100322] 0 2024-04-22T00:12:54.241 INFO:tasks.workunit.client.0.smithi110.stdout:5/972: dread - d7/d24/d37/f117 zero size 2024-04-22T00:12:54.311 INFO:tasks.workunit.client.0.smithi110.stdout:5/973: write d7/d9/d17/d48/d69/d6d/fff [1063944,57268] 0 2024-04-22T00:12:54.356 INFO:tasks.workunit.client.0.smithi110.stdout:5/974: readlink d7/d22/d5b/da5/lf1 0 2024-04-22T00:12:54.602 INFO:tasks.workunit.client.0.smithi110.stdout:4/912: creat d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8/f14c x:0 0 0 2024-04-22T00:12:55.119 INFO:tasks.workunit.client.0.smithi110.stdout:0/967: getdents d0/d56/dc9 0 2024-04-22T00:12:55.417 INFO:tasks.workunit.client.0.smithi110.stdout:6/992: mknod d16/d14f/d151/c152 0 2024-04-22T00:12:55.622 INFO:tasks.workunit.client.0.smithi110.stdout:9/973: write d1/d29/d2a/d6/d1d/f84 [423395,55616] 0 2024-04-22T00:12:55.623 INFO:tasks.workunit.client.0.smithi110.stdout:0/968: creat d0/d14/d23/d3b/f149 x:0 0 0 2024-04-22T00:12:55.870 INFO:tasks.workunit.client.0.smithi110.stdout:4/913: rename d1/d35/d6b/df2/d20/d23/d1c/d40/le9 to d1/d35/d6b/l14d 0 2024-04-22T00:12:56.181 INFO:tasks.workunit.client.0.smithi110.stdout:0/969: rmdir d0/d16/d42/d50/dbc 39 2024-04-22T00:12:56.359 INFO:tasks.workunit.client.0.smithi110.stdout:3/996: write d6/d12/d3c/d8d/dee/ffd [4315664,10424] 0 2024-04-22T00:12:56.681 INFO:tasks.workunit.client.0.smithi110.stdout:3/997: dread d6/d12/d14/d4b/f63 [0,4194304] 0 2024-04-22T00:12:56.905 INFO:tasks.workunit.client.0.smithi110.stdout:6/993: symlink d16/d3d/d40/l153 0 2024-04-22T00:12:56.972 INFO:tasks.workunit.client.0.smithi110.stdout:9/974: creat d1/de2/f12e x:0 0 0 2024-04-22T00:12:56.981 INFO:tasks.workunit.client.0.smithi110.stdout:0/970: creat d0/d25/d5a/f14a x:0 0 0 2024-04-22T00:12:57.767 INFO:tasks.workunit.client.0.smithi110.stdout:1/970: dwrite d1/d2/d1b/d10/d5c/d77/d78/ffb [0,4194304] 0 2024-04-22T00:12:57.964 INFO:tasks.workunit.client.0.smithi110.stdout:5/975: dwrite d7/d22/d5b/d6f/ff8 [0,4194304] 0 2024-04-22T00:12:58.275 INFO:tasks.workunit.client.0.smithi110.stdout:3/998: write d6/d12/d3c/f12b [1163037,127925] 0 2024-04-22T00:12:58.324 INFO:tasks.workunit.client.0.smithi110.stdout:3/999: readlink d6/d12/d16/d5d/lf6 0 2024-04-22T00:12:58.497 INFO:tasks.workunit.client.0.smithi110.stdout:4/914: creat d1/d35/d6b/df2/d20/d23/d1c/d47/f14e x:0 0 0 2024-04-22T00:12:58.726 INFO:tasks.workunit.client.0.smithi110.stdout:6/994: write d16/d1e/d24/d90/dac/f138 [86045,127156] 0 2024-04-22T00:12:59.093 INFO:tasks.workunit.client.0.smithi110.stdout:9/975: creat d1/d29/d2a/f12f x:0 0 0 2024-04-22T00:12:59.192 INFO:tasks.workunit.client.0.smithi110.stdout:0/971: dwrite d0/d14/d23/d6d/dde/d125/d104/f121 [0,4194304] 0 2024-04-22T00:12:59.328 INFO:tasks.workunit.client.0.smithi110.stdout:0/972: dread - d0/d25/d5a/f14a zero size 2024-04-22T00:12:59.478 INFO:tasks.workunit.client.0.smithi110.stdout:6/995: dread - d16/d3d/f122 zero size 2024-04-22T00:12:59.682 INFO:tasks.workunit.client.0.smithi110.stdout:1/971: write d1/d2/d14/f64 [4663210,107851] 0 2024-04-22T00:13:00.019 INFO:tasks.workunit.client.0.smithi110.stdout:0/973: truncate d0/d27/d4b/da0/f11e 332207 0 2024-04-22T00:13:00.691 INFO:tasks.workunit.client.0.smithi110.stdout:5/976: write d7/d24/d37/dd7/f11b [125215,10738] 0 2024-04-22T00:13:00.846 INFO:tasks.workunit.client.0.smithi110.stdout:6/996: truncate d16/d1e/d24/d33/d85/f14a 1019542 0 2024-04-22T00:13:01.051 INFO:tasks.workunit.client.0.smithi110.stdout:4/915: getdents d1/d35/d6b 0 2024-04-22T00:13:01.364 INFO:tasks.workunit.client.0.smithi110.stdout:0/974: mkdir d0/d27/d4b/da0/da4/d114/d12f/d14b 0 2024-04-22T00:13:01.447 INFO:tasks.workunit.client.0.smithi110.stdout:9/976: dwrite d1/d29/d4d/f80 [0,4194304] 0 2024-04-22T00:13:01.449 INFO:tasks.workunit.client.0.smithi110.stdout:5/977: dread - d7/d9/ff6 zero size 2024-04-22T00:13:01.653 INFO:tasks.workunit.client.0.smithi110.stdout:0/975: write d0/d25/d5a/f14a [235086,105071] 0 2024-04-22T00:13:01.705 INFO:tasks.workunit.client.0.smithi110.stdout:1/972: write d1/d2/d1b/d10/d5c/dc5/d27/fbf [4063542,88105] 0 2024-04-22T00:13:01.959 INFO:tasks.workunit.client.0.smithi110.stdout:1/973: sync 2024-04-22T00:13:01.967 INFO:tasks.workunit.client.0.smithi110.stdout:6/997: symlink d16/d3d/d144/l154 0 2024-04-22T00:13:01.970 INFO:tasks.workunit.client.0.smithi110.stdout:5/978: rmdir d7/d24/d3a/da7 39 2024-04-22T00:13:02.066 INFO:tasks.workunit.client.0.smithi110.stdout:1/974: sync 2024-04-22T00:13:02.070 INFO:tasks.workunit.client.0.smithi110.stdout:9/977: mknod d1/d29/d2a/d2b/d57/c130 0 2024-04-22T00:13:02.146 INFO:tasks.workunit.client.0.smithi110.stdout:9/978: readlink d1/d29/d4d/l60 0 2024-04-22T00:13:02.212 INFO:tasks.workunit.client.0.smithi110.stdout:0/976: dread d0/d25/d5a/d63/f12d [0,4194304] 0 2024-04-22T00:13:02.297 INFO:tasks.workunit.client.0.smithi110.stdout:5/979: truncate d7/f58 4771077 0 2024-04-22T00:13:02.535 INFO:tasks.workunit.client.0.smithi110.stdout:6/998: rename d16/d1d/d38/dab/fde to d16/d1d/d38/d48/d5e/d6a/db6/f155 0 2024-04-22T00:13:02.566 INFO:tasks.workunit.client.0.smithi110.stdout:6/999: stat d16/d1e/d24/d7b/f111 0 2024-04-22T00:13:02.780 INFO:tasks.workunit.client.0.smithi110.stdout:5/980: creat d7/d22/d5b/d109/f123 x:0 0 0 2024-04-22T00:13:02.886 INFO:tasks.workunit.client.0.smithi110.stdout:4/916: write d1/d35/d6b/df2/d20/dbf/d5f/fd1 [1003138,5447] 0 2024-04-22T00:13:03.251 INFO:tasks.workunit.client.0.smithi110.stdout:5/981: mknod d7/d24/d3a/d54/c124 0 2024-04-22T00:13:03.270 INFO:tasks.workunit.client.0.smithi110.stdout:5/982: chown d7/l84 567 1 2024-04-22T00:13:03.531 INFO:tasks.workunit.client.0.smithi110.stdout:0/977: creat d0/d27/d4b/f14c x:0 0 0 2024-04-22T00:13:03.778 INFO:tasks.workunit.client.0.smithi110.stdout:4/917: symlink d1/d35/d6b/df2/d20/df5/d132/l14f 0 2024-04-22T00:13:04.289 INFO:tasks.workunit.client.0.smithi110.stdout:0/978: dread d0/d56/dc9/fea [0,4194304] 0 2024-04-22T00:13:04.464 INFO:tasks.workunit.client.0.smithi110.stdout:5/983: creat d7/d9/d17/d48/f125 x:0 0 0 2024-04-22T00:13:04.554 INFO:tasks.workunit.client.0.smithi110.stdout:0/979: dread d0/d14/d23/d6d/f124 [0,4194304] 0 2024-04-22T00:13:04.692 INFO:tasks.workunit.client.0.smithi110.stdout:9/979: write d1/d29/d6f/db4/fdf [716196,54383] 0 2024-04-22T00:13:04.720 INFO:tasks.workunit.client.0.smithi110.stdout:1/975: dwrite d1/d2/d1b/f13 [0,4194304] 0 2024-04-22T00:13:04.723 INFO:tasks.workunit.client.0.smithi110.stdout:5/984: chown d7/d24/d31/f5e 176 1 2024-04-22T00:13:04.844 INFO:tasks.workunit.client.0.smithi110.stdout:9/980: stat d1/d29/d4d/f80 0 2024-04-22T00:13:04.870 INFO:tasks.workunit.client.0.smithi110.stdout:5/985: dread - d7/d9/d17/d48/f125 zero size 2024-04-22T00:13:04.892 INFO:tasks.workunit.client.0.smithi110.stdout:1/976: sync 2024-04-22T00:13:05.373 INFO:tasks.workunit.client.0.smithi110.stdout:9/981: dread - d1/d29/d4d/f113 zero size 2024-04-22T00:13:05.443 INFO:tasks.workunit.client.0.smithi110.stdout:5/986: chown d7/d24/d3a/da7 712591165 1 2024-04-22T00:13:05.463 INFO:tasks.workunit.client.0.smithi110.stdout:5/987: stat d7/d35/dc0/cd5 0 2024-04-22T00:13:05.496 INFO:tasks.workunit.client.0.smithi110.stdout:1/977: rmdir d1/d2/d1b/d10/d5c/d77/d78/deb 39 2024-04-22T00:13:05.759 INFO:tasks.workunit.client.0.smithi110.stdout:4/918: unlink d1/d35/d6b/df2/d20/d58/d93/d5e/lfc 0 2024-04-22T00:13:06.186 INFO:tasks.workunit.client.0.smithi110.stdout:0/980: creat d0/df1/f14d x:0 0 0 2024-04-22T00:13:06.308 INFO:tasks.workunit.client.0.smithi110.stdout:9/982: symlink d1/d19/d42/l131 0 2024-04-22T00:13:06.571 INFO:tasks.workunit.client.0.smithi110.stdout:1/978: fdatasync d1/dd/d23/d48/d112/fee 0 2024-04-22T00:13:06.582 INFO:tasks.workunit.client.0.smithi110.stdout:5/988: chown d7/d24/d37/d38/la2 290 1 2024-04-22T00:13:07.487 INFO:tasks.workunit.client.0.smithi110.stdout:0/981: dread d0/d16/d42/d50/f89 [0,4194304] 0 2024-04-22T00:13:07.697 INFO:tasks.workunit.client.0.smithi110.stdout:5/989: truncate d7/d35/f47 1431617 0 2024-04-22T00:13:07.708 INFO:tasks.workunit.client.0.smithi110.stdout:1/979: rename d1/d2/d1b/d10/d5c to d1/d2/d14/d152 0 2024-04-22T00:13:08.357 INFO:tasks.workunit.client.0.smithi110.stdout:1/980: creat d1/d2/d14/d152/d77/f153 x:0 0 0 2024-04-22T00:13:08.483 INFO:tasks.workunit.client.0.smithi110.stdout:5/990: mknod d7/d9/d17/d48/d69/d6d/c126 0 2024-04-22T00:13:08.658 INFO:tasks.workunit.client.0.smithi110.stdout:4/919: write d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d/fea [4580485,57369] 0 2024-04-22T00:13:08.806 INFO:tasks.workunit.client.0.smithi110.stdout:1/981: dread - d1/d2/d30/d8b/dc3/df0/f130 zero size 2024-04-22T00:13:09.227 INFO:tasks.workunit.client.0.smithi110.stdout:9/983: write d1/d29/d2a/dc/f40 [4029749,12741] 0 2024-04-22T00:13:09.263 INFO:tasks.workunit.client.0.smithi110.stdout:0/982: write d0/d16/f26 [2481161,32821] 0 2024-04-22T00:13:09.717 INFO:tasks.workunit.client.0.smithi110.stdout:5/991: symlink d7/d22/l127 0 2024-04-22T00:13:10.692 INFO:tasks.workunit.client.0.smithi110.stdout:5/992: mkdir d7/d24/d3a/da7/d128 0 2024-04-22T00:13:10.763 INFO:tasks.workunit.client.0.smithi110.stdout:0/983: dread d0/d27/d4b/da0/fb2 [0,4194304] 0 2024-04-22T00:13:10.934 INFO:tasks.workunit.client.0.smithi110.stdout:0/984: sync 2024-04-22T00:13:11.455 INFO:tasks.workunit.client.0.smithi110.stdout:5/993: creat d7/d24/f129 x:0 0 0 2024-04-22T00:13:11.604 INFO:tasks.workunit.client.0.smithi110.stdout:1/982: getdents d1/d2/d30/d8b 0 2024-04-22T00:13:11.828 INFO:tasks.workunit.client.0.smithi110.stdout:4/920: dwrite d1/d35/d6b/df2/d12/f65 [0,4194304] 0 2024-04-22T00:13:12.399 INFO:tasks.workunit.client.0.smithi110.stdout:9/984: link d1/d29/d2a/d6/cf5 d1/d29/d2a/d6/d1d/c132 0 2024-04-22T00:13:12.711 INFO:tasks.workunit.client.0.smithi110.stdout:9/985: read d1/f7 [3800686,29729] 0 2024-04-22T00:13:13.029 INFO:tasks.workunit.client.0.smithi110.stdout:0/985: write d0/d16/fa6 [512661,110925] 0 2024-04-22T00:13:13.333 INFO:tasks.workunit.client.0.smithi110.stdout:9/986: write d1/d19/f13 [3245200,17133] 0 2024-04-22T00:13:13.649 INFO:tasks.workunit.client.0.smithi110.stdout:0/986: chown d0/d27/d4b/f14c 45 1 2024-04-22T00:13:13.984 INFO:tasks.workunit.client.0.smithi110.stdout:4/921: dwrite d1/d35/d6b/df2/d12/f68 [0,4194304] 0 2024-04-22T00:13:13.998 INFO:tasks.workunit.client.0.smithi110.stdout:5/994: dwrite d7/d9/ff6 [0,4194304] 0 2024-04-22T00:13:14.215 INFO:tasks.workunit.client.0.smithi110.stdout:1/983: dwrite d1/d2/d14/fed [0,4194304] 0 2024-04-22T00:13:14.283 INFO:tasks.workunit.client.0.smithi110.stdout:5/995: sync 2024-04-22T00:13:14.311 INFO:tasks.workunit.client.0.smithi110.stdout:9/987: write d1/d29/d6f/db4/d79/d98/f101 [2644935,80377] 0 2024-04-22T00:13:14.390 INFO:tasks.workunit.client.0.smithi110.stdout:1/984: chown d1/d2/d30/d9c/f14b 183635939 1 2024-04-22T00:13:14.430 INFO:tasks.workunit.client.0.smithi110.stdout:5/996: chown d7/d22/d5b/da5/db6/f118 662 1 2024-04-22T00:13:14.471 INFO:tasks.workunit.client.0.smithi110.stdout:5/997: readlink d7/d22/d5d/l122 0 2024-04-22T00:13:14.523 INFO:tasks.workunit.client.0.smithi110.stdout:1/985: dread d1/d2/d14/fed [0,4194304] 0 2024-04-22T00:13:14.619 INFO:tasks.workunit.client.0.smithi110.stdout:1/986: sync 2024-04-22T00:13:14.859 INFO:tasks.workunit.client.0.smithi110.stdout:0/987: rename d0/d16/d5d/f90 to d0/d27/d4b/da0/da4/d114/f14e 0 2024-04-22T00:13:14.881 INFO:tasks.workunit.client.0.smithi110.stdout:4/922: dread - d1/d35/d6b/df2/d20/dbf/fa8 zero size 2024-04-22T00:13:14.882 INFO:tasks.workunit.client.0.smithi110.stdout:9/988: mkdir d1/de2/d133 0 2024-04-22T00:13:15.164 INFO:tasks.workunit.client.0.smithi110.stdout:5/998: mknod d7/d9/c12a 0 2024-04-22T00:13:15.361 INFO:tasks.workunit.client.0.smithi110.stdout:4/923: dread d1/d35/d6b/df2/d20/d50/f70 [0,4194304] 0 2024-04-22T00:13:15.483 INFO:tasks.workunit.client.0.smithi110.stdout:1/987: read - d1/d2/d14/d152/d77/d78/deb/d8d/f114 zero size 2024-04-22T00:13:15.485 INFO:tasks.workunit.client.0.smithi110.stdout:9/989: fsync d1/d29/d2a/d2b/d114/f124 0 2024-04-22T00:13:15.986 INFO:tasks.workunit.client.0.smithi110.stdout:4/924: mkdir d1/d35/df6/d150 0 2024-04-22T00:13:16.006 INFO:tasks.workunit.client.0.smithi110.stdout:0/988: symlink d0/d16/d42/l14f 0 2024-04-22T00:13:16.195 INFO:tasks.workunit.client.0.smithi110.stdout:5/999: mknod d7/d9/d17/d48/d69/c12b 0 2024-04-22T00:13:16.369 INFO:tasks.workunit.client.0.smithi110.stdout:0/989: fsync d0/d14/d23/d6d/dde/d125/d104/f121 0 2024-04-22T00:13:16.474 INFO:tasks.workunit.client.0.smithi110.stdout:4/925: symlink d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d/l151 0 2024-04-22T00:13:16.835 INFO:tasks.workunit.client.0.smithi110.stdout:0/990: creat d0/d56/d10f/f150 x:0 0 0 2024-04-22T00:13:16.962 INFO:tasks.workunit.client.0.smithi110.stdout:4/926: mknod d1/d35/d6b/df2/d20/d58/d7e/ddd/deb/c152 0 2024-04-22T00:13:17.429 INFO:tasks.workunit.client.0.smithi110.stdout:0/991: unlink d0/d27/d68/d7d/d11a/l13b 0 2024-04-22T00:13:17.451 INFO:tasks.workunit.client.0.smithi110.stdout:9/990: dwrite d1/d29/d4d/dac/db8/fc2 [0,4194304] 0 2024-04-22T00:13:17.570 INFO:tasks.workunit.client.0.smithi110.stdout:1/988: dwrite d1/dd/d23/dcc/d138/d57/f62 [0,4194304] 0 2024-04-22T00:13:17.886 INFO:tasks.workunit.client.0.smithi110.stdout:0/992: creat d0/f151 x:0 0 0 2024-04-22T00:13:17.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/991: symlink d1/d29/d2a/d2b/d114/l134 0 2024-04-22T00:13:18.011 INFO:tasks.workunit.client.0.smithi110.stdout:1/989: write d1/d2/d14/f64 [3371168,3848] 0 2024-04-22T00:13:18.263 INFO:tasks.workunit.client.0.smithi110.stdout:4/927: rename d1/d35/d6b/df2/d20/dbf/d5f/c67 to d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d/c153 0 2024-04-22T00:13:18.288 INFO:tasks.workunit.client.0.smithi110.stdout:0/993: creat d0/d25/f152 x:0 0 0 2024-04-22T00:13:18.466 INFO:tasks.workunit.client.0.smithi110.stdout:9/992: mkdir d1/d52/d76/d135 0 2024-04-22T00:13:18.540 INFO:tasks.workunit.client.0.smithi110.stdout:1/990: dread d1/d2/d30/f11e [0,4194304] 0 2024-04-22T00:13:18.602 INFO:tasks.workunit.client.0.smithi110.stdout:0/994: dread - d0/d27/d68/d7d/d11a/d11b/f143 zero size 2024-04-22T00:13:18.649 INFO:tasks.workunit.client.0.smithi110.stdout:9/993: fdatasync d1/d29/d4d/fb2 0 2024-04-22T00:13:19.098 INFO:tasks.workunit.client.0.smithi110.stdout:1/991: symlink d1/dd/d23/d9a/l154 0 2024-04-22T00:13:19.134 INFO:tasks.workunit.client.0.smithi110.stdout:4/928: truncate d1/d35/d6b/df2/d20/dbf/d5f/fd1 2829510 0 2024-04-22T00:13:19.136 INFO:tasks.workunit.client.0.smithi110.stdout:9/994: readlink d1/d29/l108 0 2024-04-22T00:13:19.255 INFO:tasks.workunit.client.0.smithi110.stdout:0/995: write d0/d27/d4b/d7f/dc1/f11d [109890,94536] 0 2024-04-22T00:13:19.289 INFO:tasks.workunit.client.0.smithi110.stdout:1/992: symlink d1/dd/d23/d48/d4e/l155 0 2024-04-22T00:13:19.705 INFO:tasks.workunit.client.0.smithi110.stdout:9/995: rename d1/d29/d2a/d6/d1d/l35 to d1/de2/l136 0 2024-04-22T00:13:19.932 INFO:tasks.workunit.client.0.smithi110.stdout:1/993: fdatasync d1/d2/d1b/f35 0 2024-04-22T00:13:19.968 INFO:tasks.workunit.client.0.smithi110.stdout:1/994: readlink d1/dd/d23/d48/ld2 0 2024-04-22T00:13:19.997 INFO:tasks.workunit.client.0.smithi110.stdout:1/995: chown d1/dd/d23/dcc/d106 2422 1 2024-04-22T00:13:20.018 INFO:tasks.workunit.client.0.smithi110.stdout:1/996: chown d1/dd/d23/d48 4831183 1 2024-04-22T00:13:20.561 INFO:tasks.workunit.client.0.smithi110.stdout:4/929: truncate d1/d35/d6b/df2/d20/d23/d1c/d40/f63 271545 0 2024-04-22T00:13:21.067 INFO:tasks.workunit.client.0.smithi110.stdout:4/930: mknod d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8/c154 0 2024-04-22T00:13:21.144 INFO:tasks.workunit.client.0.smithi110.stdout:1/997: link d1/dd/c56 d1/dd/d23/dcc/c156 0 2024-04-22T00:13:21.449 INFO:tasks.workunit.client.0.smithi110.stdout:1/998: creat d1/d2/d14/d152/d77/d78/deb/d8d/d119/f157 x:0 0 0 2024-04-22T00:13:22.332 INFO:tasks.workunit.client.0.smithi110.stdout:0/996: dwrite d0/d14/f5f [0,4194304] 0 2024-04-22T00:13:22.678 INFO:tasks.workunit.client.0.smithi110.stdout:9/996: dwrite d1/d29/d4d/dac/dbf/f128 [0,4194304] 0 2024-04-22T00:13:22.790 INFO:tasks.workunit.client.0.smithi110.stdout:1/999: dread d1/d2/d14/d65/d8a/ff5 [0,4194304] 0 2024-04-22T00:13:22.823 INFO:tasks.workunit.client.0.smithi110.stdout:4/931: dwrite d1/d35/d6b/df2/d20/d50/f70 [0,4194304] 0 2024-04-22T00:13:23.012 INFO:tasks.workunit.client.0.smithi110.stdout:9/997: read d1/d29/d2a/d6/fa9 [3776030,18856] 0 2024-04-22T00:13:23.163 INFO:tasks.workunit.client.0.smithi110.stdout:0/997: dread d0/d14/d23/d6d/dde/d125/d104/f121 [0,4194304] 0 2024-04-22T00:13:23.495 INFO:tasks.workunit.client.0.smithi110.stdout:9/998: read d1/d29/d2a/dc/f1f [2230220,22242] 0 2024-04-22T00:13:23.550 INFO:tasks.workunit.client.0.smithi110.stdout:0/998: mkdir d0/d14/d153 0 2024-04-22T00:13:23.829 INFO:tasks.workunit.client.0.smithi110.stdout:4/932: dwrite d1/d35/d6b/df2/d20/d23/d1c/d47/f14e [0,4194304] 0 2024-04-22T00:13:23.992 INFO:tasks.workunit.client.0.smithi110.stdout:0/999: rename d0/d25/cc0 to d0/d25/c154 0 2024-04-22T00:13:23.994 INFO:tasks.workunit.client.0.smithi110.stdout:9/999: dread - d1/d29/d4d/f11c zero size 2024-04-22T00:13:24.528 INFO:tasks.workunit.client.0.smithi110.stdout:4/933: dwrite d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d6a/f77 [0,4194304] 0 2024-04-22T00:13:25.410 INFO:tasks.workunit.client.0.smithi110.stdout:4/934: truncate d1/d35/d6b/df2/d20/d58/d93/d7c/fa5 2241250 0 2024-04-22T00:13:25.959 INFO:tasks.workunit.client.0.smithi110.stdout:4/935: creat d1/d35/d6b/df2/d20/dbf/f155 x:0 0 0 2024-04-22T00:13:26.019 INFO:tasks.workunit.client.0.smithi110.stdout:4/936: chown d1/d35/d6b/df2/d20/d58/d7e/ddd/deb/c152 8306286 1 2024-04-22T00:13:26.243 INFO:tasks.workunit.client.0.smithi110.stdout:4/937: link d1/d35/d6b/df2/d12/l17 d1/d35/d6b/df2/d20/dbf/db5/l156 0 2024-04-22T00:13:26.284 INFO:tasks.workunit.client.0.smithi110.stdout:4/938: chown d1/d35/d6b/df2/d20/d23/d1c/d47 61510606 1 2024-04-22T00:13:26.390 INFO:tasks.workunit.client.0.smithi110.stdout:4/939: mknod d1/c157 0 2024-04-22T00:13:26.642 INFO:tasks.workunit.client.0.smithi110.stdout:4/940: link d1/d35/d6b/df2/d20/d58/d93/c55 d1/d35/d6b/c158 0 2024-04-22T00:13:26.891 INFO:tasks.workunit.client.0.smithi110.stdout:4/941: truncate d1/d35/d6b/df2/d20/d23/d1c/d40/fe2 152857 0 2024-04-22T00:13:27.065 INFO:tasks.workunit.client.0.smithi110.stdout:4/942: creat d1/d35/d6b/df2/d20/dbf/d5f/f159 x:0 0 0 2024-04-22T00:13:27.204 INFO:tasks.workunit.client.0.smithi110.stdout:4/943: symlink d1/d35/d6b/df2/d20/d23/d1c/d47/d95/l15a 0 2024-04-22T00:13:27.901 INFO:tasks.workunit.client.0.smithi110.stdout:4/944: dwrite d1/d35/d6b/df2/d20/d23/fa1 [0,4194304] 0 2024-04-22T00:13:28.033 INFO:tasks.workunit.client.0.smithi110.stdout:4/945: readlink d1/d35/d6b/df2/d12/l36 0 2024-04-22T00:13:28.099 INFO:tasks.workunit.client.0.smithi110.stdout:4/946: chown d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/dc8/cd2 24422 1 2024-04-22T00:13:28.229 INFO:tasks.workunit.client.0.smithi110.stdout:4/947: creat d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/f15b x:0 0 0 2024-04-22T00:13:28.579 INFO:tasks.workunit.client.0.smithi110.stdout:4/948: dread d1/d35/d6b/df2/d20/dbf/f3f [0,4194304] 0 2024-04-22T00:13:28.793 INFO:tasks.workunit.client.0.smithi110.stdout:4/949: rename d1/d35/fb6 to d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d131/f15c 0 2024-04-22T00:13:29.353 INFO:tasks.workunit.client.0.smithi110.stdout:4/950: dwrite d1/d35/d6b/df2/d20/d50/f6e [0,4194304] 0 2024-04-22T00:13:29.502 INFO:tasks.workunit.client.0.smithi110.stdout:4/951: stat d1/d35/d6b/df2/d12/l117 0 2024-04-22T00:13:29.816 INFO:tasks.workunit.client.0.smithi110.stdout:4/952: dread d1/d35/f33 [0,4194304] 0 2024-04-22T00:13:30.086 INFO:tasks.workunit.client.0.smithi110.stdout:4/953: write d1/d35/d6b/df2/f66 [246930,120573] 0 2024-04-22T00:13:30.352 INFO:tasks.workunit.client.0.smithi110.stdout:4/954: sync 2024-04-22T00:13:30.465 INFO:tasks.workunit.client.0.smithi110.stdout:4/955: symlink d1/d35/d6b/df2/d20/d23/d105/l15d 0 2024-04-22T00:13:30.576 INFO:tasks.workunit.client.0.smithi110.stdout:4/956: mknod d1/d35/d6b/df2/d20/d58/d93/d5e/d120/c15e 0 2024-04-22T00:13:30.691 INFO:tasks.workunit.client.0.smithi110.stdout:4/957: symlink d1/d35/d6b/df2/d20/d23/d1c/dae/l15f 0 2024-04-22T00:13:30.926 INFO:tasks.workunit.client.0.smithi110.stdout:4/958: creat d1/d35/d6b/df2/d20/d23/d1c/d47/f160 x:0 0 0 2024-04-22T00:13:31.081 INFO:tasks.workunit.client.0.smithi110.stdout:4/959: creat d1/d35/d6b/dec/f161 x:0 0 0 2024-04-22T00:13:31.633 INFO:tasks.workunit.client.0.smithi110.stdout:4/960: dwrite d1/d35/d6b/df2/d20/d23/d1c/d40/fa9 [0,4194304] 0 2024-04-22T00:13:31.910 INFO:tasks.workunit.client.0.smithi110.stdout:4/961: fdatasync d1/f3 0 2024-04-22T00:13:32.050 INFO:tasks.workunit.client.0.smithi110.stdout:4/962: creat d1/d35/d6b/df2/d20/dc4/f162 x:0 0 0 2024-04-22T00:13:32.150 INFO:tasks.workunit.client.0.smithi110.stdout:4/963: fsync d1/d35/d6b/df2/d20/fa4 0 2024-04-22T00:13:32.354 INFO:tasks.workunit.client.0.smithi110.stdout:4/964: fdatasync d1/d35/df6/f111 0 2024-04-22T00:13:32.584 INFO:tasks.workunit.client.0.smithi110.stdout:4/965: symlink d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d/l163 0 2024-04-22T00:13:32.860 INFO:tasks.workunit.client.0.smithi110.stdout:4/966: write d1/d35/d6b/df2/d12/f18 [1336734,7104] 0 2024-04-22T00:13:33.028 INFO:tasks.workunit.client.0.smithi110.stdout:4/967: truncate d1/d35/d6b/df2/d20/d58/f104 3391816 0 2024-04-22T00:13:33.222 INFO:tasks.workunit.client.0.smithi110.stdout:4/968: truncate d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d/f126 921769 0 2024-04-22T00:13:33.476 INFO:tasks.workunit.client.0.smithi110.stdout:4/969: truncate d1/d35/d6b/df2/d20/d23/d1c/d40/f73 2778989 0 2024-04-22T00:13:33.516 INFO:tasks.workunit.client.0.smithi110.stdout:4/970: readlink d1/d35/d6b/df2/d20/d23/d1c/dae/l15f 0 2024-04-22T00:13:33.751 INFO:tasks.workunit.client.0.smithi110.stdout:4/971: write d1/d35/d6b/df2/d20/d58/d93/f11b [1501163,78484] 0 2024-04-22T00:13:34.154 INFO:tasks.workunit.client.0.smithi110.stdout:4/972: getdents d1/d35/d6b/df2/d20/d58/d102 0 2024-04-22T00:13:34.251 INFO:tasks.workunit.client.0.smithi110.stdout:4/973: creat d1/dbe/f164 x:0 0 0 2024-04-22T00:13:35.144 INFO:tasks.workunit.client.0.smithi110.stdout:4/974: truncate d1/d35/d6b/df2/d20/d50/f6e 2196607 0 2024-04-22T00:13:35.229 INFO:tasks.workunit.client.0.smithi110.stdout:4/975: write d1/d35/d6b/df2/d20/d23/d1c/d40/fa9 [4792174,89253] 0 2024-04-22T00:13:35.483 INFO:tasks.workunit.client.0.smithi110.stdout:4/976: rmdir d1/d35/d6b/df2/d20/dbf/d5f 39 2024-04-22T00:13:35.736 INFO:tasks.workunit.client.0.smithi110.stdout:4/977: creat d1/d35/df6/f165 x:0 0 0 2024-04-22T00:13:36.005 INFO:tasks.workunit.client.0.smithi110.stdout:4/978: truncate d1/f5 6807940 0 2024-04-22T00:13:36.033 INFO:tasks.workunit.client.0.smithi110.stdout:4/979: dread - d1/dbe/f164 zero size 2024-04-22T00:13:36.263 INFO:tasks.workunit.client.0.smithi110.stdout:4/980: getdents d1/d35/d6b/df2/d20/d58/d93/d7c 0 2024-04-22T00:13:36.382 INFO:tasks.workunit.client.0.smithi110.stdout:4/981: mknod d1/d35/d6b/df2/d20/dbf/db5/c166 0 2024-04-22T00:13:36.458 INFO:tasks.workunit.client.0.smithi110.stdout:4/982: dread d1/d35/d6b/df2/d20/d50/fa3 [0,4194304] 0 2024-04-22T00:13:36.722 INFO:tasks.workunit.client.0.smithi110.stdout:4/983: creat d1/d35/d6b/df2/d20/d23/d1c/d47/f167 x:0 0 0 2024-04-22T00:13:37.025 INFO:tasks.workunit.client.0.smithi110.stdout:4/984: dread d1/d35/d6b/f9b [0,4194304] 0 2024-04-22T00:13:37.206 INFO:tasks.workunit.client.0.smithi110.stdout:4/985: dread d1/d35/d6b/df2/d12/f68 [0,4194304] 0 2024-04-22T00:13:37.989 INFO:tasks.workunit.client.0.smithi110.stdout:4/986: dwrite d1/d35/d6b/df2/d20/dbf/f30 [0,4194304] 0 2024-04-22T00:13:38.220 INFO:tasks.workunit.client.0.smithi110.stdout:4/987: dread - d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d6a/f11c zero size 2024-04-22T00:13:38.335 INFO:tasks.workunit.client.0.smithi110.stdout:4/988: readlink d1/d35/d6b/df2/d20/l7f 0 2024-04-22T00:13:38.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/989: getdents d1/d35/d6b/df2/d20/d58 0 2024-04-22T00:13:38.858 INFO:tasks.workunit.client.0.smithi110.stdout:4/990: rename d1/d35/d6b/df2/d20/d23/d105/d147 to d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d6a/d168 0 2024-04-22T00:13:38.872 INFO:tasks.workunit.client.0.smithi110.stdout:4/991: readlink d1/l60 0 2024-04-22T00:13:38.964 INFO:tasks.workunit.client.0.smithi110.stdout:4/992: readlink d1/d35/d6b/df2/d20/d23/d1c/d47/d4f/d56/l87 0 2024-04-22T00:13:39.400 INFO:tasks.workunit.client.0.smithi110.stdout:4/993: write d1/d35/d6b/df2/d20/d23/d1c/d40/fe2 [839259,4325] 0 2024-04-22T00:13:39.725 INFO:tasks.workunit.client.0.smithi110.stdout:4/994: dread d1/d35/d6b/df2/d20/d23/d1c/d40/dcf/d12d/f126 [0,4194304] 0 2024-04-22T00:13:39.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/995: mkdir d1/d35/d6b/df2/d20/d23/d1c/d169 0 2024-04-22T00:13:40.111 INFO:tasks.workunit.client.0.smithi110.stdout:4/996: unlink d1/d35/d6b/df2/d20/dbf/d5f/dc0/d115/l118 0 2024-04-22T00:13:40.226 INFO:tasks.workunit.client.0.smithi110.stdout:4/997: creat d1/d35/d6b/df2/d20/d23/d1c/dae/f16a x:0 0 0 2024-04-22T00:13:40.406 INFO:tasks.workunit.client.0.smithi110.stdout:4/998: creat d1/d35/d6b/df2/d20/d58/d93/d5e/d120/d124/f16b x:0 0 0 2024-04-22T00:13:40.534 INFO:tasks.workunit.client.0.smithi110.stdout:4/999: mknod d1/d35/d6b/df2/d20/d58/d7e/ddd/c16c 0 2024-04-22T00:13:40.557 INFO:tasks.workunit.client.0.smithi110.stderr:+ rm -rf -- ./tmp.LWrKj73LHG 2024-04-22T00:15:02.741 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:22:42.996 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.765 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:22:42.958 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.770 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:22:42.962 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.778 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:22:42.970 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.785 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:22:42.977 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.828 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:22:43.085 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.935 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:22:43.127 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.942 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:22:43.135 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:15:02.986 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:22:43.242 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.478 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:23:50.733 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.480 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:23:50.737 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.563 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:23:50.819 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.601 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:23:50.793 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.604 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:23:50.797 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.648 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:23:50.840 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.652 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:23:50.844 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.667 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:23:50.859 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:16:10.736 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:23:50.928 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.088 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:25:11.343 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.178 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:25:11.434 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.218 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:25:11.410 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.227 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:25:11.419 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.264 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:25:11.520 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.298 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:25:11.490 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.308 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:25:11.500 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.309 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:25:11.502 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:17:31.418 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:25:11.610 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.068 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:26:50.323 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.095 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:26:50.351 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.096 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:26:50.288 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.107 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:26:50.299 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.112 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:26:50.305 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.137 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:26:50.329 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.231 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:26:50.487 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.240 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:26:50.432 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:19:10.279 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:26:50.471 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:18.773 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:30:59.028 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:18.785 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:30:59.040 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:18.808 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:30:59.000 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:18.823 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:30:59.014 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:18.861 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:30:59.049 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:18.867 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:30:59.058 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:18.923 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:30:59.178 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:19.021 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:30:59.212 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:23:19.026 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:30:59.218 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.633 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:32:13.887 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.639 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:32:13.894 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.704 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:32:13.959 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.748 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:32:13.940 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.753 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:32:13.945 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.753 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:32:13.945 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.770 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:32:13.962 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.829 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:32:14.020 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:24:33.860 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:32:14.051 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:41.137 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-22T00:25:41.137 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-22T00:25:54.582 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:33:34.836 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.589 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:33:34.845 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.643 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:33:34.898 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.707 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:33:34.899 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.712 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:33:34.904 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.712 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:33:34.904 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.716 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:33:34.908 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.775 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:33:34.967 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:25:54.815 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:33:35.007 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:25.978 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:35:06.232 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:25.991 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:35:06.246 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:26.008 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:35:06.200 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:26.013 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:35:06.205 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:26.023 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:35:06.215 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:26.023 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:35:06.215 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:26.123 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:35:06.315 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:26.143 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:35:06.398 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:27:26.161 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:35:06.353 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.122 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:39:15.374 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.123 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:39:15.313 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.132 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:39:15.324 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.137 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:39:15.328 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.152 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:39:15.344 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.195 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:39:15.449 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.313 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:39:15.505 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.342 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:39:15.597 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:31:35.399 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:39:15.591 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:56.915 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:40:37.169 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:56.918 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:40:37.173 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:56.976 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:40:37.230 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:57.026 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:40:37.218 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:57.033 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:40:37.225 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:57.034 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:40:37.226 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:57.036 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:40:37.228 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:57.082 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:40:37.274 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:32:57.110 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:40:37.302 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.772 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:41:58.026 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.775 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:41:58.030 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.847 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:41:58.101 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.892 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:41:58.084 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.895 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:41:58.088 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.899 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:41:58.091 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.905 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:41:58.097 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.945 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:41:58.137 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:34:17.970 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:41:58.162 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.124 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:43:21.378 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.146 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:43:21.400 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.190 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:43:21.382 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.201 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:43:21.393 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.226 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:43:21.481 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.258 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:43:21.449 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.261 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:43:21.453 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.328 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:43:21.520 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:35:41.461 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:43:21.652 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.309 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:47:30.563 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.315 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:47:30.570 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.357 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:47:30.549 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.358 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:47:30.550 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.367 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:47:30.559 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.381 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:47:30.573 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.447 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:47:30.702 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.549 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:47:30.741 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:39:50.553 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:47:30.745 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.172 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:49:00.426 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.176 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:49:00.431 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.210 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:49:00.401 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.233 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:49:00.489 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.294 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:49:00.485 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.297 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:49:00.490 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.299 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:49:00.491 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.363 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:49:00.556 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:41:20.381 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:49:00.573 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.720 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:50:20.975 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.737 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:50:20.993 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.792 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:50:21.047 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.849 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:50:21.042 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.852 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:50:21.045 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.857 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:50:21.050 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.864 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:50:21.057 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.897 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:50:21.090 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:42:40.941 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:50:21.133 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.339 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:51:37.594 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.343 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:51:37.599 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.372 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:51:37.565 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.378 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:51:37.572 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.388 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:51:37.582 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.390 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:51:37.584 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.411 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:51:37.667 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.488 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:51:37.681 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:43:57.490 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:51:37.683 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.395 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:55:46.651 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.412 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:55:46.668 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.431 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:55:46.625 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.434 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:55:46.628 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.441 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:55:46.635 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.441 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:55:46.635 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.589 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:55:46.845 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.639 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:55:46.833 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:48:06.642 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:55:46.837 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.331 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:57:23.587 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.332 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:57:23.589 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.404 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:57:23.660 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.442 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:57:23.637 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.445 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:57:23.640 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.445 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:57:23.640 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.455 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:57:23.650 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.536 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:57:23.730 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:49:43.545 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:57:23.740 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:03.930 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:58:44.185 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:03.942 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:58:44.199 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:04.032 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:58:44.289 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:04.057 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:58:44.251 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:04.060 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:58:44.255 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:04.064 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:58:44.259 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:04.065 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:58:44.260 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:04.116 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:58:44.311 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:51:04.129 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:58:44.324 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.448 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:59:52.704 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.454 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:59:52.711 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.484 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:59:52.679 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.485 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:59:52.680 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.494 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:59:52.689 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.498 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:59:52.692 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.591 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:01:59:52.786 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.594 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:01:59:52.789 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:52:12.642 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:01:59:52.899 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.535 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:04:00.791 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.546 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:04:00.803 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.581 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:04:00.775 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.596 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:04:00.790 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.599 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:04:00.793 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.618 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:04:00.813 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.743 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:04:01.000 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.766 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:04:00.961 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:56:20.841 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:04:01.036 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.290 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:05:42.546 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.295 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:05:42.552 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.356 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:05:42.550 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.362 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:05:42.556 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.362 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:05:42.556 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.366 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:05:42.560 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.367 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:05:42.625 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.457 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:05:42.651 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:58:02.458 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:05:42.652 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:22.947 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:07:03.203 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:22.952 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:07:03.209 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:23.023 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:07:03.280 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:23.058 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:07:03.252 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:23.061 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:07:03.255 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:23.070 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:07:03.264 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:23.076 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:07:03.270 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:23.125 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:07:03.319 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T00:59:23.157 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:07:03.351 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:27.905 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:08:08.161 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:27.959 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:08:08.153 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:27.968 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:08:08.162 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:28.001 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:08:08.195 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:28.014 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:08:08.208 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:28.081 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:08:08.338 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:28.178 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:08:08.372 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:28.210 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:08:08.404 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:00:28.253 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:08:08.511 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.169 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:12:17.426 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.177 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:12:17.434 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.208 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:12:17.401 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.209 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:12:17.401 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.217 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:12:17.410 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.219 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:12:17.413 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.389 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:12:17.646 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.393 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:12:17.586 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:04:37.397 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:12:17.590 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.795 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:14:01.052 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.799 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:14:01.056 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.897 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:14:01.155 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.904 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:14:01.097 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.904 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:14:01.097 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.911 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:14:01.104 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.913 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:14:01.106 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:20.999 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:14:01.192 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:06:21.000 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:14:01.194 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.322 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:15:26.578 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.325 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:15:26.583 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.441 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:15:26.634 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.443 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:15:26.636 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.444 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:15:26.637 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.446 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:15:26.639 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.492 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:15:26.685 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.511 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:15:26.768 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:07:46.534 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:15:26.726 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:42.859 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:16:23.115 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:42.875 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:16:23.133 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:42.893 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:16:23.085 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:42.903 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:16:23.096 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:42.913 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:16:23.105 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:42.915 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:16:23.108 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:43.000 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:16:23.192 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:43.002 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:16:23.195 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:08:43.115 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:16:23.372 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:10:41.825 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-22T01:10:41.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-22T01:10:42.150 DEBUG:teuthology.parallel:result is None 2024-04-22T01:10:42.151 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T01:10:42.520 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T01:10:42.520 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-22T01:10:42.530 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-22T01:10:42.531 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-22T01:10:42.531 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T01:10:42.538 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-22T01:10:42.538 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T01:10:42.588 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T01:10:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.764+0000 7f1f4b36e640 1 Processor -- start 2024-04-22T01:10:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.764+0000 7f1f4b36e640 1 -- start start 2024-04-22T01:10:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.764+0000 7f1f4b36e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4406ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.764+0000 7f1f4b36e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1f4406f3d0 0x7f1f440c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.764+0000 7f1f4b36e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f440c3320 con 0x7f1f44156950 2024-04-22T01:10:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.764+0000 7f1f4b36e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f1f440c5640 con 0x7f1f4406f3d0 2024-04-22T01:10:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.764+0000 7f1f4b36e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1f440c7300 con 0x7f1f44150c20 2024-04-22T01:10:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.768+0000 7f1f4990b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1f4406f3d0 0x7f1f440c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.768+0000 7f1f4990b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1f4406f3d0 0x7f1f440c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43894/0 (socket says 172.21.15.110:43894) 2024-04-22T01:10:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.768+0000 7f1f4990b640 1 -- 172.21.15.110:0/2024386292 learned_addr learned my addr 172.21.15.110:0/2024386292 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.768+0000 7f1f48909640 1 --2- 172.21.15.110:0/2024386292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4406ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.772+0000 7f1f4990b640 1 -- 172.21.15.110:0/2024386292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 msgr2=0x7f1f4406ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.772+0000 7f1f4990b640 1 --2- 172.21.15.110:0/2024386292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4406ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.772+0000 7f1f4990b640 1 -- 172.21.15.110:0/2024386292 >> v1:172.21.15.110:6789/0 conn(0x7f1f44156950 legacy=0x7f1f440c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:42.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.772+0000 7f1f4990b640 1 -- 172.21.15.110:0/2024386292 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f440c4da0 con 0x7f1f4406f3d0 2024-04-22T01:10:42.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.776+0000 7f1f4990b640 1 --2- 172.21.15.110:0/2024386292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f440c7ac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e50 tx=0x7f1f3c021420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156b10577a4fd76a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:42.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f3bfff640 1 -- 172.21.15.110:0/2024386292 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0b6070 con 0x7f1f4406f3d0 2024-04-22T01:10:42.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f3bfff640 1 -- 172.21.15.110:0/2024386292 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0b1400 con 0x7f1f4406f3d0 2024-04-22T01:10:42.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f3bfff640 1 -- 172.21.15.110:0/2024386292 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0b17d0 con 0x7f1f4406f3d0 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2024386292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 msgr2=0x7f1f440c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2024386292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f440c7ac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e50 tx=0x7f1f3c021420 comp rx=0 tx=0).stop 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2024386292 shutdown_connections 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2024386292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f440c7ac0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2024386292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4406ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2024386292 >> 172.21.15.110:0/2024386292 conn(0x7f1f440cb710 msgr2=0x7f1f440cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2024386292 shutdown_connections 2024-04-22T01:10:42.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2024386292 wait complete. 2024-04-22T01:10:42.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 Processor -- start 2024-04-22T01:10:42.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- start start 2024-04-22T01:10:42.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f44147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:42.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:42.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44156950 0x7f1f44148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:42.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1f440c75a0 con 0x7f1f4406f3d0 2024-04-22T01:10:42.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f440c5360 con 0x7f1f44156950 2024-04-22T01:10:42.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.784+0000 7f1f4b36e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1f44151060 con 0x7f1f44150c20 2024-04-22T01:10:42.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.788+0000 7f1f4910a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f44147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:42.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.788+0000 7f1f4910a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f44147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43900/0 (socket says 172.21.15.110:43900) 2024-04-22T01:10:42.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.788+0000 7f1f4910a640 1 -- 172.21.15.110:0/2530531284 learned_addr learned my addr 172.21.15.110:0/2530531284 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:42.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.788+0000 7f1f48909640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:42.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.788+0000 7f1f4990b640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44156950 0x7f1f44148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:42.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.792+0000 7f1f4910a640 1 -- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 msgr2=0x7f1f4414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:42.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.792+0000 7f1f4910a640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:42.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.792+0000 7f1f4910a640 1 -- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44156950 msgr2=0x7f1f44148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:42.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.792+0000 7f1f4910a640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44156950 0x7f1f44148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:42.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.792+0000 7f1f4910a640 1 -- 172.21.15.110:0/2530531284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f440ca0c0 con 0x7f1f4406f3d0 2024-04-22T01:10:42.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.792+0000 7f1f4910a640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f44147df0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c370 tx=0x7f1f4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:42.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.800+0000 7f1f39ffb640 1 -- 172.21.15.110:0/2530531284 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400052d0 con 0x7f1f4406f3d0 2024-04-22T01:10:42.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.800+0000 7f1f39ffb640 1 -- 172.21.15.110:0/2530531284 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f40005470 con 0x7f1f4406f3d0 2024-04-22T01:10:42.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.800+0000 7f1f39ffb640 1 -- 172.21.15.110:0/2530531284 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40007260 con 0x7f1f4406f3d0 2024-04-22T01:10:42.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.800+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f440ca3a0 con 0x7f1f4406f3d0 2024-04-22T01:10:42.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.800+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f441522b0 con 0x7f1f4406f3d0 2024-04-22T01:10:42.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:42.800+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4404f510 con 0x7f1f4406f3d0 2024-04-22T01:10:43.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.096+0000 7f1f39ffb640 1 -- 172.21.15.110:0/2530531284 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f40007400 con 0x7f1f4406f3d0 2024-04-22T01:10:43.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.096+0000 7f1f39ffb640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1f28067910 0x7f1f28069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:43.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.096+0000 7f1f48909640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1f28067910 0x7f1f28069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:43.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.096+0000 7f1f48909640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1f28067910 0x7f1f28069dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1f441496b0 tx=0x7f1f34009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:43.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.132+0000 7f1f39ffb640 1 -- 172.21.15.110:0/2530531284 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1f40053e00 con 0x7f1f4406f3d0 2024-04-22T01:10:43.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.132+0000 7f1f39ffb640 1 -- 172.21.15.110:0/2530531284 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f1f40055d60 con 0x7f1f4406f3d0 2024-04-22T01:10:43.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.308+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f440c6700 con 0x7f1f4406f3d0 2024-04-22T01:10:43.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.356+0000 7f1f39ffb640 1 -- 172.21.15.110:0/2530531284 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16682 (secure 0 0 0) 0x7f1f4005a060 con 0x7f1f4406f3d0 2024-04-22T01:10:43.357 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:10:43.358 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:54:44.154650+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T01:10:43.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1f28067910 msgr2=0x7f1f28069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:43.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1f28067910 0x7f1f28069dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1f441496b0 tx=0x7f1f34009190 comp rx=0 tx=0).stop 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 msgr2=0x7f1f44147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f44147df0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c370 tx=0x7f1f4000c830 comp rx=0 tx=0).stop 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 shutdown_connections 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1f28067910 0x7f1f28069dd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44156950 0x7f1f44148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f44150c20 0x7f1f4414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 --2- 172.21.15.110:0/2530531284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f4406f3d0 0x7f1f44147df0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 >> 172.21.15.110:0/2530531284 conn(0x7f1f440cb710 msgr2=0x7f1f440744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 shutdown_connections 2024-04-22T01:10:43.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.360+0000 7f1f4b36e640 1 -- 172.21.15.110:0/2530531284 wait complete. 2024-04-22T01:10:43.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:52:54.296733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:53:35.338548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:53:36.666246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T01:10:43.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T01:10:43.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.504+0000 7f7187639640 1 Processor -- start 2024-04-22T01:10:43.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7187639640 1 -- start start 2024-04-22T01:10:43.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7187639640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71800cdec0 0x7f71800cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:43.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7187639640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f718006d6a0 0x7f71800d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:43.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7187639640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f718015a450 con 0x7f71801548c0 2024-04-22T01:10:43.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7187639640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f718006db70 con 0x7f718006d6a0 2024-04-22T01:10:43.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7187639640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f71800ca740 con 0x7f71800cdec0 2024-04-22T01:10:43.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7185bd6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f718006d6a0 0x7f71800d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:43.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f71853d5640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f71801548c0 0x7f718015e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:38704/0 (socket says 172.21.15.110:38704) 2024-04-22T01:10:43.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f71853d5640 1 -- 172.21.15.110:0/3906101048 learned_addr learned my addr 172.21.15.110:0/3906101048 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:43.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.508+0000 7f7184bd4640 1 --2- 172.21.15.110:0/3906101048 >> v2:172.21.15.154:3300/0 conn(0x7f71800cdec0 0x7f71800cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:43.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.512+0000 7f7185bd6640 1 -- 172.21.15.110:0/3906101048 >> v2:172.21.15.154:3300/0 conn(0x7f71800cdec0 msgr2=0x7f71800cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:43.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.512+0000 7f7185bd6640 1 --2- 172.21.15.110:0/3906101048 >> v2:172.21.15.154:3300/0 conn(0x7f71800cdec0 0x7f71800cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.512+0000 7f7185bd6640 1 -- 172.21.15.110:0/3906101048 >> v1:172.21.15.110:6789/0 conn(0x7f71801548c0 legacy=0x7f718015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:43.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.512+0000 7f7185bd6640 1 -- 172.21.15.110:0/3906101048 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71800caa20 con 0x7f718006d6a0 2024-04-22T01:10:43.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.516+0000 7f7185bd6640 1 --2- 172.21.15.110:0/3906101048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71800d0080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7180062c10 tx=0x7f717801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7453f4ca976628 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:43.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7177fff640 1 -- 172.21.15.110:0/3906101048 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71780b2070 con 0x7f718006d6a0 2024-04-22T01:10:43.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7177fff640 1 -- 172.21.15.110:0/3906101048 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71780a57f0 con 0x7f718006d6a0 2024-04-22T01:10:43.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7177fff640 1 -- 172.21.15.110:0/3906101048 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71780a5bc0 con 0x7f718006d6a0 2024-04-22T01:10:43.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- 172.21.15.110:0/3906101048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 msgr2=0x7f71800d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:43.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 --2- 172.21.15.110:0/3906101048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71800d0080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7180062c10 tx=0x7f717801c930 comp rx=0 tx=0).stop 2024-04-22T01:10:43.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- 172.21.15.110:0/3906101048 shutdown_connections 2024-04-22T01:10:43.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 --2- 172.21.15.110:0/3906101048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71800d0080 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 --2- 172.21.15.110:0/3906101048 >> v2:172.21.15.154:3300/0 conn(0x7f71800cdec0 0x7f71800cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- 172.21.15.110:0/3906101048 >> 172.21.15.110:0/3906101048 conn(0x7f718006ca20 msgr2=0x7f7180061c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:43.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- 172.21.15.110:0/3906101048 shutdown_connections 2024-04-22T01:10:43.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- 172.21.15.110:0/3906101048 wait complete. 2024-04-22T01:10:43.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 Processor -- start 2024-04-22T01:10:43.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- start start 2024-04-22T01:10:43.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71801ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:43.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71800cdec0 0x7f71801f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:43.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718015c880 0x7f718014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:43.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7180167790 con 0x7f718006d6a0 2024-04-22T01:10:43.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7180167610 con 0x7f718015c880 2024-04-22T01:10:43.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.524+0000 7f7187639640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7180167910 con 0x7f71800cdec0 2024-04-22T01:10:43.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.528+0000 7f71853d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71801ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:43.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.528+0000 7f71853d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71801ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43922/0 (socket says 172.21.15.110:43922) 2024-04-22T01:10:43.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.528+0000 7f71853d5640 1 -- 172.21.15.110:0/1264306100 learned_addr learned my addr 172.21.15.110:0/1264306100 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:43.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.528+0000 7f7184bd4640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71800cdec0 0x7f71801f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:43.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.528+0000 7f7185bd6640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718015c880 0x7f718014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:43.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.532+0000 7f71853d5640 1 -- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71800cdec0 msgr2=0x7f71801f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:43.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.532+0000 7f71853d5640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71800cdec0 0x7f71801f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.532+0000 7f71853d5640 1 -- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718015c880 msgr2=0x7f718014e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:43.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.532+0000 7f71853d5640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718015c880 0x7f718014e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:43.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.532+0000 7f71853d5640 1 -- 172.21.15.110:0/1264306100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71800c3c80 con 0x7f718006d6a0 2024-04-22T01:10:43.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.532+0000 7f7185bd6640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718015c880 0x7f718014e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T01:10:43.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.532+0000 7f71853d5640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71801ed560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c3a0 tx=0x7f717c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.536+0000 7f7175ffb640 1 -- 172.21.15.110:0/1264306100 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c017070 con 0x7f718006d6a0 2024-04-22T01:10:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.536+0000 7f7175ffb640 1 -- 172.21.15.110:0/1264306100 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717c005cf0 con 0x7f718006d6a0 2024-04-22T01:10:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.536+0000 7f7175ffb640 1 -- 172.21.15.110:0/1264306100 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c0072f0 con 0x7f718006d6a0 2024-04-22T01:10:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.536+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71800c3f60 con 0x7f718006d6a0 2024-04-22T01:10:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.536+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71801eca80 con 0x7f718006d6a0 2024-04-22T01:10:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.540+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f718004f510 con 0x7f718006d6a0 2024-04-22T01:10:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.556+0000 7f7175ffb640 1 -- 172.21.15.110:0/1264306100 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f717c01a070 con 0x7f718006d6a0 2024-04-22T01:10:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.556+0000 7f7175ffb640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7164067910 0x7f7164069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:43.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.560+0000 7f7184bd4640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7164067910 0x7f7164069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:43.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.560+0000 7f7184bd4640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7164067910 0x7f7164069dd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71800d0440 tx=0x7f7170009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.568+0000 7f7175ffb640 1 -- 172.21.15.110:0/1264306100 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f717c053960 con 0x7f718006d6a0 2024-04-22T01:10:43.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:43.852+0000 7f7175ffb640 1 -- 172.21.15.110:0/1264306100 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f717c021020 con 0x7f718006d6a0 2024-04-22T01:10:44.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.020+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f718006df90 con 0x7f718006d6a0 2024-04-22T01:10:44.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7175ffb640 1 -- 172.21.15.110:0/1264306100 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f717c0558c0 con 0x7f718006d6a0 2024-04-22T01:10:44.027 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7164067910 msgr2=0x7f7164069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7164067910 0x7f7164069dd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71800d0440 tx=0x7f7170009190 comp rx=0 tx=0).stop 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 msgr2=0x7f71801ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71801ed560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c3a0 tx=0x7f717c00c860 comp rx=0 tx=0).stop 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 shutdown_connections 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7164067910 0x7f7164069dd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718015c880 0x7f718014e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71800cdec0 0x7f71801f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.028+0000 7f7187639640 1 --2- 172.21.15.110:0/1264306100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718006d6a0 0x7f71801ed560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.032+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 >> 172.21.15.110:0/1264306100 conn(0x7f718006ca20 msgr2=0x7f7180150b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:44.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.032+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 shutdown_connections 2024-04-22T01:10:44.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.032+0000 7f7187639640 1 -- 172.21.15.110:0/1264306100 wait complete. 2024-04-22T01:10:44.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T01:10:44.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d7aca4640 1 Processor -- start 2024-04-22T01:10:44.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d7aca4640 1 -- start start 2024-04-22T01:10:44.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d7aca4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d740721a0 0x7f4d7415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:44.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d7aca4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7415b300 con 0x7f4d740733a0 2024-04-22T01:10:44.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d7aca4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7415aa60 con 0x7f4d74154500 2024-04-22T01:10:44.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d7aca4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4d741548e0 con 0x7f4d740721a0 2024-04-22T01:10:44.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d78a40640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4d74154500 0x7f4d7415e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:34108/0 (socket says 172.21.15.110:34108) 2024-04-22T01:10:44.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.172+0000 7f4d78a40640 1 -- 172.21.15.110:0/2560578370 learned_addr learned my addr 172.21.15.110:0/2560578370 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:44.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.176+0000 7f4d73fff640 1 --2- 172.21.15.110:0/2560578370 >> v2:172.21.15.154:3300/0 conn(0x7f4d740721a0 0x7f4d7415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:44.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.180+0000 7f4d73fff640 1 -- 172.21.15.110:0/2560578370 >> v1:172.21.15.154:6789/0 conn(0x7f4d74154500 legacy=0x7f4d7415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.180+0000 7f4d73fff640 1 -- 172.21.15.110:0/2560578370 >> v1:172.21.15.110:6789/0 conn(0x7f4d740733a0 legacy=0x7f4d74072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.180+0000 7f4d73fff640 1 -- 172.21.15.110:0/2560578370 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7415ad40 con 0x7f4d740721a0 2024-04-22T01:10:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.192+0000 7f4d73fff640 1 --2- 172.21.15.110:0/2560578370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 0x7f4d7415a3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4d680097f0 tx=0x7f4d6801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4288943c1f56d830 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:44.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d737fe640 1 -- 172.21.15.110:0/2560578370 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d680b5070 con 0x7f4d740721a0 2024-04-22T01:10:44.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d737fe640 1 -- 172.21.15.110:0/2560578370 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d680a8950 con 0x7f4d740721a0 2024-04-22T01:10:44.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d737fe640 1 -- 172.21.15.110:0/2560578370 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d680a8d20 con 0x7f4d740721a0 2024-04-22T01:10:44.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 -- 172.21.15.110:0/2560578370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 msgr2=0x7f4d7415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/2560578370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 0x7f4d7415a3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4d680097f0 tx=0x7f4d6801ec50 comp rx=0 tx=0).stop 2024-04-22T01:10:44.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 -- 172.21.15.110:0/2560578370 shutdown_connections 2024-04-22T01:10:44.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/2560578370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 0x7f4d7415a3b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 -- 172.21.15.110:0/2560578370 >> 172.21.15.110:0/2560578370 conn(0x7f4d74062030 msgr2=0x7f4d7406f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:44.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 -- 172.21.15.110:0/2560578370 shutdown_connections 2024-04-22T01:10:44.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 -- 172.21.15.110:0/2560578370 wait complete. 2024-04-22T01:10:44.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 Processor -- start 2024-04-22T01:10:44.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.312+0000 7f4d7aca4640 1 -- start start 2024-04-22T01:10:44.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d7aca4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 0x7f4d741e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:44.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d7aca4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d740733a0 0x7f4d74151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:44.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d7aca4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d74154500 0x7f4d74158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:44.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d7aca4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4d740c2df0 con 0x7f4d740733a0 2024-04-22T01:10:44.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d7aca4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7415e950 con 0x7f4d740721a0 2024-04-22T01:10:44.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d7aca4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7415da40 con 0x7f4d74154500 2024-04-22T01:10:44.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d73fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d740733a0 0x7f4d74151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:44.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d79241640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d74154500 0x7f4d74158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:44.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d73fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d740733a0 0x7f4d74151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43936/0 (socket says 172.21.15.110:43936) 2024-04-22T01:10:44.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d73fff640 1 -- 172.21.15.110:0/1580228154 learned_addr learned my addr 172.21.15.110:0/1580228154 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:44.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.316+0000 7f4d78a40640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 0x7f4d741e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:44.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.320+0000 7f4d73fff640 1 -- 172.21.15.110:0/1580228154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d74154500 msgr2=0x7f4d74158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.320+0000 7f4d73fff640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d74154500 0x7f4d74158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.320+0000 7f4d73fff640 1 -- 172.21.15.110:0/1580228154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 msgr2=0x7f4d741e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.320+0000 7f4d73fff640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 0x7f4d741e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.320+0000 7f4d73fff640 1 -- 172.21.15.110:0/1580228154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d741f03e0 con 0x7f4d740733a0 2024-04-22T01:10:44.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.324+0000 7f4d73fff640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d740733a0 0x7f4d74151fd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009740 tx=0x7f4d6801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:44.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.328+0000 7f4d717fa640 1 -- 172.21.15.110:0/1580228154 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d680b5040 con 0x7f4d740733a0 2024-04-22T01:10:44.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.328+0000 7f4d717fa640 1 -- 172.21.15.110:0/1580228154 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d680c0070 con 0x7f4d740733a0 2024-04-22T01:10:44.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.328+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d741f06c0 con 0x7f4d740733a0 2024-04-22T01:10:44.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.328+0000 7f4d717fa640 1 -- 172.21.15.110:0/1580228154 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d680b0a90 con 0x7f4d740733a0 2024-04-22T01:10:44.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.328+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d741f0c80 con 0x7f4d740733a0 2024-04-22T01:10:44.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.332+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7404f510 con 0x7f4d740733a0 2024-04-22T01:10:44.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.352+0000 7f4d717fa640 1 -- 172.21.15.110:0/1580228154 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d680b8070 con 0x7f4d740733a0 2024-04-22T01:10:44.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.352+0000 7f4d717fa640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4d58067910 0x7f4d58069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:44.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.356+0000 7f4d78a40640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4d58067910 0x7f4d58069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:44.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.356+0000 7f4d78a40640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4d58067910 0x7f4d58069dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000f70 tx=0x7f4d60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:44.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.360+0000 7f4d717fa640 1 -- 172.21.15.110:0/1580228154 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4d680f2540 con 0x7f4d740733a0 2024-04-22T01:10:44.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.664+0000 7f4d717fa640 1 -- 172.21.15.110:0/1580228154 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f4d680ca020 con 0x7f4d740733a0 2024-04-22T01:10:44.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.852+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4d74071f80 con 0x7f4d740733a0 2024-04-22T01:10:44.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.860+0000 7f4d717fa640 1 -- 172.21.15.110:0/1580228154 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f4d680187b0 con 0x7f4d740733a0 2024-04-22T01:10:44.860 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-04-22T01:10:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4d58067910 msgr2=0x7f4d58069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4d58067910 0x7f4d58069dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000f70 tx=0x7f4d60009040 comp rx=0 tx=0).stop 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d740733a0 msgr2=0x7f4d74151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d740733a0 0x7f4d74151fd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009740 tx=0x7f4d6801b9f0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 shutdown_connections 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4d58067910 0x7f4d58069dd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d74154500 0x7f4d74158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d740733a0 0x7f4d74151fd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 --2- 172.21.15.110:0/1580228154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740721a0 0x7f4d741e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 >> 172.21.15.110:0/1580228154 conn(0x7f4d74062030 msgr2=0x7f4d74072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 shutdown_connections 2024-04-22T01:10:44.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:44.864+0000 7f4d7aca4640 1 -- 172.21.15.110:0/1580228154 wait complete. 2024-04-22T01:10:44.882 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T01:10:45.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.008+0000 7f5f68214640 1 Processor -- start 2024-04-22T01:10:45.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.008+0000 7f5f68214640 1 -- start start 2024-04-22T01:10:45.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f68214640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f60154940 0x7f5f60072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f68214640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f600c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f68214640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f600c8a70 con 0x7f5f60071a60 2024-04-22T01:10:45.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f68214640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5f600c84b0 con 0x7f5f60154940 2024-04-22T01:10:45.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f68214640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5f600c8790 con 0x7f5f6015b100 2024-04-22T01:10:45.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f65fb0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f60154940 0x7f5f60072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f65fb0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f60154940 0x7f5f60072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43950/0 (socket says 172.21.15.110:43950) 2024-04-22T01:10:45.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f65fb0640 1 -- 172.21.15.110:0/3637584739 learned_addr learned my addr 172.21.15.110:0/3637584739 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:45.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.012+0000 7f5f667b1640 1 --2- 172.21.15.110:0/3637584739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f600c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.016+0000 7f5f65fb0640 1 -- 172.21.15.110:0/3637584739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 msgr2=0x7f5f600c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:45.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.016+0000 7f5f65fb0640 1 --2- 172.21.15.110:0/3637584739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f600c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.016+0000 7f5f65fb0640 1 -- 172.21.15.110:0/3637584739 >> v1:172.21.15.154:6789/0 conn(0x7f5f60071a60 legacy=0x7f5f6015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.016+0000 7f5f65fb0640 1 -- 172.21.15.110:0/3637584739 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6015a620 con 0x7f5f60154940 2024-04-22T01:10:45.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.016+0000 7f5f667b1640 1 --2- 172.21.15.110:0/3637584739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f600c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T01:10:45.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.020+0000 7f5f65fb0640 1 --2- 172.21.15.110:0/3637584739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f60072140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009870 tx=0x7f5f5001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602c5072f9fb837d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:45.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f64fae640 1 -- 172.21.15.110:0/3637584739 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f500a7070 con 0x7f5f60154940 2024-04-22T01:10:45.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f64fae640 1 -- 172.21.15.110:0/3637584739 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f500b0070 con 0x7f5f60154940 2024-04-22T01:10:45.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f64fae640 1 -- 172.21.15.110:0/3637584739 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f500ab890 con 0x7f5f60154940 2024-04-22T01:10:45.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- 172.21.15.110:0/3637584739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 msgr2=0x7f5f60072140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 --2- 172.21.15.110:0/3637584739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f60072140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009870 tx=0x7f5f5001c560 comp rx=0 tx=0).stop 2024-04-22T01:10:45.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- 172.21.15.110:0/3637584739 shutdown_connections 2024-04-22T01:10:45.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 --2- 172.21.15.110:0/3637584739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f600c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 --2- 172.21.15.110:0/3637584739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f60072140 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- 172.21.15.110:0/3637584739 >> 172.21.15.110:0/3637584739 conn(0x7f5f600cb710 msgr2=0x7f5f600cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:45.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- 172.21.15.110:0/3637584739 shutdown_connections 2024-04-22T01:10:45.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- 172.21.15.110:0/3637584739 wait complete. 2024-04-22T01:10:45.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 Processor -- start 2024-04-22T01:10:45.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- start start 2024-04-22T01:10:45.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60071a60 0x7f5f60159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f6015d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f601f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60167830 con 0x7f5f60154940 2024-04-22T01:10:45.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601676b0 con 0x7f5f60071a60 2024-04-22T01:10:45.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f68214640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5f601679b0 con 0x7f5f6015b100 2024-04-22T01:10:45.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.024+0000 7f5f657af640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f6015d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.028+0000 7f5f657af640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f6015d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43962/0 (socket says 172.21.15.110:43962) 2024-04-22T01:10:45.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.028+0000 7f5f657af640 1 -- 172.21.15.110:0/3080766294 learned_addr learned my addr 172.21.15.110:0/3080766294 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:45.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.028+0000 7f5f65fb0640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60071a60 0x7f5f60159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.028+0000 7f5f667b1640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f601f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.032+0000 7f5f657af640 1 -- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 msgr2=0x7f5f601f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.032+0000 7f5f657af640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f601f6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.032+0000 7f5f657af640 1 -- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60071a60 msgr2=0x7f5f60159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.032+0000 7f5f657af640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60071a60 0x7f5f60159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.032+0000 7f5f657af640 1 -- 172.21.15.110:0/3080766294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6015dc40 con 0x7f5f60154940 2024-04-22T01:10:45.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.032+0000 7f5f657af640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f6015d700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00c370 tx=0x7f5f5c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.036+0000 7f5f567fc640 1 -- 172.21.15.110:0/3080766294 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0052d0 con 0x7f5f60154940 2024-04-22T01:10:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.036+0000 7f5f567fc640 1 -- 172.21.15.110:0/3080766294 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5c005470 con 0x7f5f60154940 2024-04-22T01:10:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.036+0000 7f5f567fc640 1 -- 172.21.15.110:0/3080766294 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c007260 con 0x7f5f60154940 2024-04-22T01:10:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.036+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f601f78f0 con 0x7f5f60154940 2024-04-22T01:10:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.036+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6015e410 con 0x7f5f60154940 2024-04-22T01:10:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.036+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6004f510 con 0x7f5f60154940 2024-04-22T01:10:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.328+0000 7f5f567fc640 1 -- 172.21.15.110:0/3080766294 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f5c007400 con 0x7f5f60154940 2024-04-22T01:10:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.328+0000 7f5f567fc640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5f44067910 0x7f5f44069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.328+0000 7f5f65fb0640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5f44067910 0x7f5f44069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.332+0000 7f5f65fb0640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5f44067910 0x7f5f44069dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5f500af000 tx=0x7f5f500a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:45.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.368+0000 7f5f567fc640 1 -- 172.21.15.110:0/3080766294 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5f5c053e50 con 0x7f5f60154940 2024-04-22T01:10:45.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.368+0000 7f5f567fc640 1 -- 172.21.15.110:0/3080766294 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f5f5c055db0 con 0x7f5f60154940 2024-04-22T01:10:45.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.548+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5f600c3530 con 0x7f5f60154940 2024-04-22T01:10:45.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.564+0000 7f5f567fc640 1 -- 172.21.15.110:0/3080766294 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f5f5c05a0b0 con 0x7f5f60154940 2024-04-22T01:10:45.563 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-04-22T01:10:45.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.564+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5f44067910 msgr2=0x7f5f44069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.564+0000 7f5f68214640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5f44067910 0x7f5f44069dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5f500af000 tx=0x7f5f500a7000 comp rx=0 tx=0).stop 2024-04-22T01:10:45.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.564+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 msgr2=0x7f5f6015d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.564+0000 7f5f68214640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f6015d700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00c370 tx=0x7f5f5c00c830 comp rx=0 tx=0).stop 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 shutdown_connections 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5f44067910 0x7f5f44069dd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f6015b100 0x7f5f601f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f60154940 0x7f5f6015d700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 --2- 172.21.15.110:0/3080766294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60071a60 0x7f5f60159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 >> 172.21.15.110:0/3080766294 conn(0x7f5f600cb710 msgr2=0x7f5f600c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 shutdown_connections 2024-04-22T01:10:45.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.568+0000 7f5f68214640 1 -- 172.21.15.110:0/3080766294 wait complete. 2024-04-22T01:10:45.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T01:10:45.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5ded3c2640 1 Processor -- start 2024-04-22T01:10:45.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5ded3c2640 1 -- start start 2024-04-22T01:10:45.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5ded3c2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 0x7f5de8062270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5ded3c2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5de80c7b90 0x7f5de8164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5ded3c2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de80627b0 con 0x7f5de80c7730 2024-04-22T01:10:45.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5ded3c2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5de806b1e0 con 0x7f5de80c7b90 2024-04-22T01:10:45.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5ded3c2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5de806b430 con 0x7f5de8061e90 2024-04-22T01:10:45.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5de77fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5de80c7b90 0x7f5de8164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5de77fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5de80c7b90 0x7f5de8164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43976/0 (socket says 172.21.15.110:43976) 2024-04-22T01:10:45.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.724+0000 7f5de77fe640 1 -- 172.21.15.110:0/32108696 learned_addr learned my addr 172.21.15.110:0/32108696 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:45.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.728+0000 7f5de77fe640 1 -- 172.21.15.110:0/32108696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 msgr2=0x7f5de8062270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:45.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.728+0000 7f5de77fe640 1 --2- 172.21.15.110:0/32108696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 0x7f5de8062270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.728+0000 7f5de77fe640 1 -- 172.21.15.110:0/32108696 >> v1:172.21.15.154:6789/0 conn(0x7f5de80c7730 legacy=0x7f5de81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:45.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.728+0000 7f5de77fe640 1 -- 172.21.15.110:0/32108696 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de806b710 con 0x7f5de80c7b90 2024-04-22T01:10:45.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.732+0000 7f5de77fe640 1 --2- 172.21.15.110:0/32108696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7b90 0x7f5de8164f50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009e50 tx=0x7f5de001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1e5760fb7ca80e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:45.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5de67fc640 1 -- 172.21.15.110:0/32108696 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de00a57b0 con 0x7f5de80c7b90 2024-04-22T01:10:45.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5de67fc640 1 -- 172.21.15.110:0/32108696 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de00a5950 con 0x7f5de80c7b90 2024-04-22T01:10:45.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5de67fc640 1 -- 172.21.15.110:0/32108696 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de00a5d20 con 0x7f5de80c7b90 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 -- 172.21.15.110:0/32108696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7b90 msgr2=0x7f5de8164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/32108696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7b90 0x7f5de8164f50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009e50 tx=0x7f5de001c930 comp rx=0 tx=0).stop 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 -- 172.21.15.110:0/32108696 shutdown_connections 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/32108696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7b90 0x7f5de8164f50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/32108696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 0x7f5de8062270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 -- 172.21.15.110:0/32108696 >> 172.21.15.110:0/32108696 conn(0x7f5de80cc7d0 msgr2=0x7f5de80ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 -- 172.21.15.110:0/32108696 shutdown_connections 2024-04-22T01:10:45.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 -- 172.21.15.110:0/32108696 wait complete. 2024-04-22T01:10:45.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 Processor -- start 2024-04-22T01:10:45.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.736+0000 7f5ded3c2640 1 -- start start 2024-04-22T01:10:45.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ded3c2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 0x7f5de815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ded3c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7730 0x7f5de81f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ded3c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5de80c7b90 0x7f5de81f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:45.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ded3c2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5de806c4d0 con 0x7f5de80c7730 2024-04-22T01:10:45.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ded3c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8062a70 con 0x7f5de80c7b90 2024-04-22T01:10:45.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ded3c2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5de815f7e0 con 0x7f5de8061e90 2024-04-22T01:10:45.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ddffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7730 0x7f5de81f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ddffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7730 0x7f5de81f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43980/0 (socket says 172.21.15.110:43980) 2024-04-22T01:10:45.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5ddffff640 1 -- 172.21.15.110:0/1639546184 learned_addr learned my addr 172.21.15.110:0/1639546184 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:45.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.740+0000 7f5de77fe640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5de80c7b90 0x7f5de81f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:45.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.744+0000 7f5ddffff640 1 -- 172.21.15.110:0/1639546184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 msgr2=0x7f5de815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.744+0000 7f5ddffff640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 0x7f5de815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.744+0000 7f5ddffff640 1 -- 172.21.15.110:0/1639546184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5de80c7b90 msgr2=0x7f5de81f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:45.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.744+0000 7f5ddffff640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5de80c7b90 0x7f5de81f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:45.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.744+0000 7f5ddffff640 1 -- 172.21.15.110:0/1639546184 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de815b070 con 0x7f5de80c7730 2024-04-22T01:10:45.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.744+0000 7f5ddffff640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7730 0x7f5de81f7330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c490 tx=0x7f5dd0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:45.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.748+0000 7f5ddf7fe640 1 -- 172.21.15.110:0/1639546184 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0017070 con 0x7f5de80c7730 2024-04-22T01:10:45.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.748+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de81ecb40 con 0x7f5de80c7730 2024-04-22T01:10:45.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.748+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de81ed100 con 0x7f5de80c7730 2024-04-22T01:10:45.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.748+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de804f510 con 0x7f5de80c7730 2024-04-22T01:10:45.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.752+0000 7f5ddf7fe640 1 -- 172.21.15.110:0/1639546184 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd0007030 con 0x7f5de80c7730 2024-04-22T01:10:45.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:45.752+0000 7f5ddf7fe640 1 -- 172.21.15.110:0/1639546184 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0021060 con 0x7f5de80c7730 2024-04-22T01:10:46.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.032+0000 7f5ddf7fe640 1 -- 172.21.15.110:0/1639546184 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5dd001a070 con 0x7f5de80c7730 2024-04-22T01:10:46.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.036+0000 7f5ddf7fe640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5dc80678f0 0x7f5dc8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.036+0000 7f5de6ffd640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5dc80678f0 0x7f5dc8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.036+0000 7f5de6ffd640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5dc80678f0 0x7f5dc8069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009730 tx=0x7f5dd8006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:46.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.072+0000 7f5ddf7fe640 1 -- 172.21.15.110:0/1639546184 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5dd00537b0 con 0x7f5de80c7730 2024-04-22T01:10:46.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.072+0000 7f5ddf7fe640 1 -- 172.21.15.110:0/1639546184 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f5dd0055710 con 0x7f5de80c7730 2024-04-22T01:10:46.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.248+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5de8153df0 con 0x7f5de80c7730 2024-04-22T01:10:46.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.260+0000 7f5ddf7fe640 1 -- 172.21.15.110:0/1639546184 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f5dd0059a10 con 0x7f5de80c7730 2024-04-22T01:10:46.261 INFO:teuthology.orchestra.run.smithi110.stderr:listed 0 entries 2024-04-22T01:10:46.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5dc80678f0 msgr2=0x7f5dc8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5dc80678f0 0x7f5dc8069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009730 tx=0x7f5dd8006ca0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7730 msgr2=0x7f5de81f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7730 0x7f5de81f7330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c490 tx=0x7f5dd0001e80 comp rx=0 tx=0).stop 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 shutdown_connections 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5dc80678f0 0x7f5dc8069db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5de80c7b90 0x7f5de81f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5de80c7730 0x7f5de81f7330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 --2- 172.21.15.110:0/1639546184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5de8061e90 0x7f5de815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 >> 172.21.15.110:0/1639546184 conn(0x7f5de80cc7d0 msgr2=0x7f5de80ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 shutdown_connections 2024-04-22T01:10:46.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.264+0000 7f5ded3c2640 1 -- 172.21.15.110:0/1639546184 wait complete. 2024-04-22T01:10:46.281 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-22T01:10:46.281 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T01:10:46.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T01:10:46.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.448+0000 7f217dd0d640 1 Processor -- start 2024-04-22T01:10:46.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.448+0000 7f217dd0d640 1 -- start start 2024-04-22T01:10:46.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f217dd0d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2178154600 0x7f217815e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f217dd0d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217806bd60 0x7f21780c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f217dd0d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217815a390 con 0x7f21780cc000 2024-04-22T01:10:46.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f217dd0d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f21781549e0 con 0x7f2178154600 2024-04-22T01:10:46.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f217dd0d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f217815ac80 con 0x7f217806bd60 2024-04-22T01:10:46.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f2177fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f21780cc000 0x7f21780c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:38732/0 (socket says 172.21.15.110:38732) 2024-04-22T01:10:46.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f2177fff640 1 -- 172.21.15.110:0/3169908260 learned_addr learned my addr 172.21.15.110:0/3169908260 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:46.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f21777fe640 1 --2- 172.21.15.110:0/3169908260 >> v2:172.21.15.154:3300/0 conn(0x7f2178154600 0x7f217815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.452+0000 7f2176ffd640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217806bd60 0x7f21780c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.456+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556483348 0 0) 0x7f217815a390 con 0x7f21780cc000 2024-04-22T01:10:46.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.456+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2164003530 con 0x7f21780cc000 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2430054357 0 0) 0x7f2164003530 con 0x7f21780cc000 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217806bd60 msgr2=0x7f21780c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217806bd60 0x7f21780c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 >> v2:172.21.15.154:3300/0 conn(0x7f2178154600 msgr2=0x7f217815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 --2- 172.21.15.110:0/3169908260 >> v2:172.21.15.154:3300/0 conn(0x7f2178154600 0x7f217815e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217815e7c0 con 0x7f21780cc000 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f2168001680 con 0x7f21780cc000 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 >> v1:172.21.15.110:6789/0 conn(0x7f21780cc000 legacy=0x7f21780c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640039c0 0x7f2164003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2164004810 0x7f2164004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217806bd60 0x7f21640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f217815ac80 con 0x7f2164004810 2024-04-22T01:10:46.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f216400b9d0 con 0x7f21640039c0 2024-04-22T01:10:46.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f216400bba0 con 0x7f217806bd60 2024-04-22T01:10:46.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.460+0000 7f2176ffd640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2164004810 0x7f2164004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.464+0000 7f2176ffd640 1 -- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217806bd60 msgr2=0x7f21640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.464+0000 7f2176ffd640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217806bd60 0x7f21640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.464+0000 7f2176ffd640 1 -- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640039c0 msgr2=0x7f2164003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.464+0000 7f2176ffd640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640039c0 0x7f2164003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.464+0000 7f2176ffd640 1 -- 172.21.15.110:0/3169908260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2164003530 con 0x7f2164004810 2024-04-22T01:10:46.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.468+0000 7f2176ffd640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2164004810 0x7f2164004c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2160009ae0 tx=0x7f216001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a0b7a800715981 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:46.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21600b2070 con 0x7f2164004810 2024-04-22T01:10:46.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21600a55c0 con 0x7f2164004810 2024-04-22T01:10:46.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f21767fc640 1 -- 172.21.15.110:0/3169908260 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21600096b0 con 0x7f2164004810 2024-04-22T01:10:46.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f217dd0d640 1 -- 172.21.15.110:0/3169908260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2164004810 msgr2=0x7f2164004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:46.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f217dd0d640 1 --2- 172.21.15.110:0/3169908260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2164004810 0x7f2164004c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2160009ae0 tx=0x7f216001cab0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f2177fff640 1 -- 172.21.15.110:0/3169908260 reap_dead start 2024-04-22T01:10:46.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f217dd0d640 1 -- 172.21.15.110:0/3169908260 shutdown_connections 2024-04-22T01:10:46.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f217dd0d640 1 -- 172.21.15.110:0/3169908260 >> 172.21.15.110:0/3169908260 conn(0x7f2178071f90 msgr2=0x7f21780723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:46.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f217dd0d640 1 -- 172.21.15.110:0/3169908260 shutdown_connections 2024-04-22T01:10:46.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.472+0000 7f217dd0d640 1 -- 172.21.15.110:0/3169908260 wait complete. 2024-04-22T01:10:46.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 Processor -- start 2024-04-22T01:10:46.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 -- start start 2024-04-22T01:10:46.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21781f3640 0x7f21781f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21781f3f60 0x7f2178145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2178153cc0 0x7f2178145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f217815a910 con 0x7f2178153cc0 2024-04-22T01:10:46.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f217815a630 con 0x7f21781f3640 2024-04-22T01:10:46.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f217dd0d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f217806b8e0 con 0x7f21781f3f60 2024-04-22T01:10:46.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f2177fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2178153cc0 0x7f2178145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f2177fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2178153cc0 0x7f2178145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43996/0 (socket says 172.21.15.110:43996) 2024-04-22T01:10:46.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f2177fff640 1 -- 172.21.15.110:0/1796928221 learned_addr learned my addr 172.21.15.110:0/1796928221 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:46.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f21777fe640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21781f3640 0x7f21781f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.476+0000 7f2176ffd640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21781f3f60 0x7f2178145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.480+0000 7f2177fff640 1 -- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21781f3f60 msgr2=0x7f2178145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.480+0000 7f2177fff640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21781f3f60 0x7f2178145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.480+0000 7f2177fff640 1 -- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21781f3640 msgr2=0x7f21781f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.480+0000 7f2177fff640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21781f3640 0x7f21781f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.480+0000 7f2177fff640 1 -- 172.21.15.110:0/1796928221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217815b8a0 con 0x7f2178153cc0 2024-04-22T01:10:46.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.484+0000 7f2177fff640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2178153cc0 0x7f2178145c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2178071b20 tx=0x7f216800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:46.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.488+0000 7f216ffff640 1 -- 172.21.15.110:0/1796928221 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168004cc0 con 0x7f2178153cc0 2024-04-22T01:10:46.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.488+0000 7f216ffff640 1 -- 172.21.15.110:0/1796928221 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2168007110 con 0x7f2178153cc0 2024-04-22T01:10:46.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.488+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217815d240 con 0x7f2178153cc0 2024-04-22T01:10:46.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.488+0000 7f216ffff640 1 -- 172.21.15.110:0/1796928221 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168004e60 con 0x7f2178153cc0 2024-04-22T01:10:46.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.488+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217815c9a0 con 0x7f2178153cc0 2024-04-22T01:10:46.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.488+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217804f510 con 0x7f2178153cc0 2024-04-22T01:10:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.508+0000 7f216ffff640 1 -- 172.21.15.110:0/1796928221 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2168007500 con 0x7f2178153cc0 2024-04-22T01:10:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.508+0000 7f216ffff640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2158067940 0x7f2158069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:46.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.508+0000 7f21777fe640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2158067940 0x7f2158069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:46.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.508+0000 7f21777fe640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2158067940 0x7f2158069e00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2170011420 tx=0x7f217000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:46.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.512+0000 7f216ffff640 1 -- 172.21.15.110:0/1796928221 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2168053fd0 con 0x7f2178153cc0 2024-04-22T01:10:46.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.788+0000 7f216ffff640 1 -- 172.21.15.110:0/1796928221 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2168023080 con 0x7f2178153cc0 2024-04-22T01:10:46.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:46.964+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2178157ca0 con 0x7f2178153cc0 2024-04-22T01:10:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f216ffff640 1 -- 172.21.15.110:0/1796928221 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16682 (secure 0 0 0) 0x7f2168056630 con 0x7f2178153cc0 2024-04-22T01:10:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:10:47.067 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:54:44.154650+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2158067940 msgr2=0x7f2158069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2158067940 0x7f2158069e00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2170011420 tx=0x7f217000b040 comp rx=0 tx=0).stop 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2178153cc0 msgr2=0x7f2178145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2178153cc0 0x7f2178145c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2178071b20 tx=0x7f216800c8c0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 shutdown_connections 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2158067940 0x7f2158069e00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2178153cc0 0x7f2178145c70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21781f3f60 0x7f2178145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 --2- 172.21.15.110:0/1796928221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21781f3640 0x7f21781f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 >> 172.21.15.110:0/1796928221 conn(0x7f2178071f90 msgr2=0x7f21780c7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 shutdown_connections 2024-04-22T01:10:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.068+0000 7f217dd0d640 1 -- 172.21.15.110:0/1796928221 wait complete. 2024-04-22T01:10:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:52:54.296733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:53:35.338548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:53:36.666246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T01:10:47.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T01:10:47.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 Processor -- start 2024-04-22T01:10:47.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 -- start start 2024-04-22T01:10:47.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758152400 0x7ff75806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7580ca2a0 0x7ff75815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff75815c300 0x7ff758070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff75815b930 con 0x7ff75815c300 2024-04-22T01:10:47.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff7581590d0 con 0x7ff7580ca2a0 2024-04-22T01:10:47.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff75cf9e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff758158b90 con 0x7ff758152400 2024-04-22T01:10:47.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff756d9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff75815c300 0x7ff758070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:47.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff756d9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff75815c300 0x7ff758070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44004/0 (socket says 172.21.15.110:44004) 2024-04-22T01:10:47.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.224+0000 7ff756d9d640 1 -- 172.21.15.110:0/1474856913 learned_addr learned my addr 172.21.15.110:0/1474856913 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:47.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.228+0000 7ff756d9d640 1 -- 172.21.15.110:0/1474856913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758152400 msgr2=0x7ff75806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:47.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.228+0000 7ff756d9d640 1 --2- 172.21.15.110:0/1474856913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758152400 0x7ff75806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.228+0000 7ff756d9d640 1 -- 172.21.15.110:0/1474856913 >> v2:172.21.15.154:3300/0 conn(0x7ff7580ca2a0 msgr2=0x7ff75815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:47.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.228+0000 7ff756d9d640 1 --2- 172.21.15.110:0/1474856913 >> v2:172.21.15.154:3300/0 conn(0x7ff7580ca2a0 0x7ff75815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.228+0000 7ff756d9d640 1 -- 172.21.15.110:0/1474856913 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff758158e30 con 0x7ff75815c300 2024-04-22T01:10:47.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.232+0000 7ff756d9d640 1 --2- 172.21.15.110:0/1474856913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758070580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7580c3e00 tx=0x7ff75001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e68ccefcb2b6467 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:47.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75559a640 1 -- 172.21.15.110:0/1474856913 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500a5670 con 0x7ff75815c300 2024-04-22T01:10:47.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75559a640 1 -- 172.21.15.110:0/1474856913 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7500a5810 con 0x7ff75815c300 2024-04-22T01:10:47.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75559a640 1 -- 172.21.15.110:0/1474856913 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500a5be0 con 0x7ff75815c300 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 -- 172.21.15.110:0/1474856913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 msgr2=0x7ff758070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/1474856913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758070580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7580c3e00 tx=0x7ff75001c9f0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 -- 172.21.15.110:0/1474856913 shutdown_connections 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/1474856913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758070580 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/1474856913 >> v2:172.21.15.154:3300/0 conn(0x7ff7580ca2a0 0x7ff75815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/1474856913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758152400 0x7ff75806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 -- 172.21.15.110:0/1474856913 >> 172.21.15.110:0/1474856913 conn(0x7ff75806e5c0 msgr2=0x7ff75806e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:47.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 -- 172.21.15.110:0/1474856913 shutdown_connections 2024-04-22T01:10:47.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 -- 172.21.15.110:0/1474856913 wait complete. 2024-04-22T01:10:47.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 Processor -- start 2024-04-22T01:10:47.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.236+0000 7ff75cf9e640 1 -- start start 2024-04-22T01:10:47.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff75cf9e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7580ca2a0 0x7ff75813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff75cf9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758152400 0x7ff758150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff75cf9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff75cf9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff7580738c0 con 0x7ff75815c300 2024-04-22T01:10:47.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff75cf9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff758073740 con 0x7ff758152400 2024-04-22T01:10:47.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff75cf9e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff7580cd380 con 0x7ff7580ca2a0 2024-04-22T01:10:47.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff756d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:47.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff756d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44008/0 (socket says 172.21.15.110:44008) 2024-04-22T01:10:47.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.240+0000 7ff756d9d640 1 -- 172.21.15.110:0/3590852782 learned_addr learned my addr 172.21.15.110:0/3590852782 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:47.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.244+0000 7ff756d9d640 1 -- 172.21.15.110:0/3590852782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7580ca2a0 msgr2=0x7ff75813d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.244+0000 7ff756d9d640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7580ca2a0 0x7ff75813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.244+0000 7ff756d9d640 1 -- 172.21.15.110:0/3590852782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758152400 msgr2=0x7ff758150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.244+0000 7ff756d9d640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758152400 0x7ff758150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.244+0000 7ff756d9d640 1 -- 172.21.15.110:0/3590852782 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75813de80 con 0x7ff75815c300 2024-04-22T01:10:47.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.244+0000 7ff756d9d640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758150bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7500af040 tx=0x7ff750019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:47.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.248+0000 7ff746ffd640 1 -- 172.21.15.110:0/3590852782 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500bc020 con 0x7ff75815c300 2024-04-22T01:10:47.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.248+0000 7ff746ffd640 1 -- 172.21.15.110:0/3590852782 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7500b8670 con 0x7ff75815c300 2024-04-22T01:10:47.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.248+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7581434d0 con 0x7ff75815c300 2024-04-22T01:10:47.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.248+0000 7ff746ffd640 1 -- 172.21.15.110:0/3590852782 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500b8a40 con 0x7ff75815c300 2024-04-22T01:10:47.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.248+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75815b580 con 0x7ff75815c300 2024-04-22T01:10:47.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.252+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75804f510 con 0x7ff75815c300 2024-04-22T01:10:47.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.532+0000 7ff746ffd640 1 -- 172.21.15.110:0/3590852782 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7500bf020 con 0x7ff75815c300 2024-04-22T01:10:47.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.532+0000 7ff746ffd640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff738067910 0x7ff738069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.536+0000 7ff75659c640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff738067910 0x7ff738069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:47.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.536+0000 7ff75659c640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff738067910 0x7ff738069dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff748009730 tx=0x7ff748006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:47.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.552+0000 7ff746ffd640 1 -- 172.21.15.110:0/3590852782 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff7500ef980 con 0x7ff75815c300 2024-04-22T01:10:47.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.552+0000 7ff746ffd640 1 -- 172.21.15.110:0/3590852782 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7ff7500c6030 con 0x7ff75815c300 2024-04-22T01:10:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.728+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff75806b830 con 0x7ff75815c300 2024-04-22T01:10:47.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff746ffd640 1 -- 172.21.15.110:0/3590852782 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff7500f6e20 con 0x7ff75815c300 2024-04-22T01:10:47.743 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-04-22T01:10:47.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff738067910 msgr2=0x7ff738069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff738067910 0x7ff738069dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff748009730 tx=0x7ff748006ca0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 msgr2=0x7ff758150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758150bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7500af040 tx=0x7ff750019790 comp rx=0 tx=0).stop 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 shutdown_connections 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7ff738067910 0x7ff738069dd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff75815c300 0x7ff758150bc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758152400 0x7ff758150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 --2- 172.21.15.110:0/3590852782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7580ca2a0 0x7ff75813d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 >> 172.21.15.110:0/3590852782 conn(0x7ff75806e5c0 msgr2=0x7ff75806e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 shutdown_connections 2024-04-22T01:10:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.744+0000 7ff75cf9e640 1 -- 172.21.15.110:0/3590852782 wait complete. 2024-04-22T01:10:47.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T01:10:47.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.892+0000 7fc3a346d640 1 Processor -- start 2024-04-22T01:10:47.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.892+0000 7fc3a346d640 1 -- start start 2024-04-22T01:10:47.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.896+0000 7fc3a346d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc39c0727a0 0x7fc39c0c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.896+0000 7fc3a346d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc39c0c3450 0x7fc39c0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:47.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.896+0000 7fc3a346d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc39c0733d0 con 0x7fc39c150f30 2024-04-22T01:10:47.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.896+0000 7fc3a346d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc39c0736b0 con 0x7fc39c0c3450 2024-04-22T01:10:47.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.896+0000 7fc3a346d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc39c157340 con 0x7fc39c0727a0 2024-04-22T01:10:47.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.960+0000 7fc3a1209640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc39c150f30 0x7fc39c1577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:38744/0 (socket says 172.21.15.110:38744) 2024-04-22T01:10:47.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.960+0000 7fc3a1209640 1 -- 172.21.15.110:0/1511917847 learned_addr learned my addr 172.21.15.110:0/1511917847 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:47.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.960+0000 7fc3a1a0a640 1 --2- 172.21.15.110:0/1511917847 >> v2:172.21.15.110:3300/0 conn(0x7fc39c0c3450 0x7fc39c0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:47.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.968+0000 7fc3a1a0a640 1 -- 172.21.15.110:0/1511917847 >> v2:172.21.15.154:3300/0 conn(0x7fc39c0727a0 msgr2=0x7fc39c0c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:47.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.968+0000 7fc3a1a0a640 1 --2- 172.21.15.110:0/1511917847 >> v2:172.21.15.154:3300/0 conn(0x7fc39c0727a0 0x7fc39c0c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:47.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.968+0000 7fc3a1a0a640 1 -- 172.21.15.110:0/1511917847 >> v1:172.21.15.110:6789/0 conn(0x7fc39c150f30 legacy=0x7fc39c1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:47.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.968+0000 7fc3a1a0a640 1 -- 172.21.15.110:0/1511917847 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c0c7680 con 0x7fc39c0c3450 2024-04-22T01:10:47.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:47.988+0000 7fc3a1a0a640 1 --2- 172.21.15.110:0/1511917847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c0c3450 0x7fc39c0c38c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc39c070550 tx=0x7fc39801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e8439ed9c103d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc393fff640 1 -- 172.21.15.110:0/1511917847 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980b0070 con 0x7fc39c0c3450 2024-04-22T01:10:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc393fff640 1 -- 172.21.15.110:0/1511917847 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3980ab600 con 0x7fc39c0c3450 2024-04-22T01:10:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc393fff640 1 -- 172.21.15.110:0/1511917847 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980ab9d0 con 0x7fc39c0c3450 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 -- 172.21.15.110:0/1511917847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c0c3450 msgr2=0x7fc39c0c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 --2- 172.21.15.110:0/1511917847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c0c3450 0x7fc39c0c38c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc39c070550 tx=0x7fc39801c480 comp rx=0 tx=0).stop 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 -- 172.21.15.110:0/1511917847 shutdown_connections 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 --2- 172.21.15.110:0/1511917847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c0c3450 0x7fc39c0c38c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 --2- 172.21.15.110:0/1511917847 >> v2:172.21.15.154:3300/0 conn(0x7fc39c0727a0 0x7fc39c0c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 -- 172.21.15.110:0/1511917847 >> 172.21.15.110:0/1511917847 conn(0x7fc39c06e590 msgr2=0x7fc39c06e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 -- 172.21.15.110:0/1511917847 shutdown_connections 2024-04-22T01:10:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.000+0000 7fc3a346d640 1 -- 172.21.15.110:0/1511917847 wait complete. 2024-04-22T01:10:48.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 Processor -- start 2024-04-22T01:10:48.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 -- start start 2024-04-22T01:10:48.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc39c0727a0 0x7fc39c1f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39c0c3450 0x7fc39c14c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c150f30 0x7fc39c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c15a6d0 con 0x7fc39c150f30 2024-04-22T01:10:48.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c15a550 con 0x7fc39c0c3450 2024-04-22T01:10:48.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.004+0000 7fc3a346d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc39c072cb0 con 0x7fc39c0727a0 2024-04-22T01:10:48.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.008+0000 7fc3a1a0a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c150f30 0x7fc39c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.008+0000 7fc3a1a0a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c150f30 0x7fc39c14c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44030/0 (socket says 172.21.15.110:44030) 2024-04-22T01:10:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.008+0000 7fc3a1a0a640 1 -- 172.21.15.110:0/3014305344 learned_addr learned my addr 172.21.15.110:0/3014305344 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.008+0000 7fc3a0a08640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39c0c3450 0x7fc39c14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.008+0000 7fc3a1209640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc39c0727a0 0x7fc39c1f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.012+0000 7fc3a1a0a640 1 -- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc39c0727a0 msgr2=0x7fc39c1f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.012+0000 7fc3a1a0a640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc39c0727a0 0x7fc39c1f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.012+0000 7fc3a1a0a640 1 -- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39c0c3450 msgr2=0x7fc39c14c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.012+0000 7fc3a1a0a640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39c0c3450 0x7fc39c14c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.012+0000 7fc3a1a0a640 1 -- 172.21.15.110:0/3014305344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c06b9c0 con 0x7fc39c150f30 2024-04-22T01:10:48.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.016+0000 7fc3a1a0a640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c150f30 0x7fc39c14c690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3980ae040 tx=0x7fc39801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:48.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.020+0000 7fc391ffb640 1 -- 172.21.15.110:0/3014305344 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980b0050 con 0x7fc39c150f30 2024-04-22T01:10:48.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.020+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39c1f3c80 con 0x7fc39c150f30 2024-04-22T01:10:48.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.020+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39c1f7130 con 0x7fc39c150f30 2024-04-22T01:10:48.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.020+0000 7fc391ffb640 1 -- 172.21.15.110:0/3014305344 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3980bc070 con 0x7fc39c150f30 2024-04-22T01:10:48.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.020+0000 7fc391ffb640 1 -- 172.21.15.110:0/3014305344 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980b5810 con 0x7fc39c150f30 2024-04-22T01:10:48.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.024+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c0052a0 con 0x7fc39c150f30 2024-04-22T01:10:48.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.316+0000 7fc391ffb640 1 -- 172.21.15.110:0/3014305344 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3980b59b0 con 0x7fc39c150f30 2024-04-22T01:10:48.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.316+0000 7fc391ffb640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc3800678c0 0x7fc380069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.316+0000 7fc3a1209640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc3800678c0 0x7fc380069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.316+0000 7fc3a1209640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc3800678c0 0x7fc380069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc3940012f0 tx=0x7fc3940019a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.340+0000 7fc391ffb640 1 -- 172.21.15.110:0/3014305344 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc3980ef510 con 0x7fc39c150f30 2024-04-22T01:10:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.340+0000 7fc391ffb640 1 -- 172.21.15.110:0/3014305344 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fc398016070 con 0x7fc39c150f30 2024-04-22T01:10:48.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.520+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc37c005860 con 0x7fc39c150f30 2024-04-22T01:10:48.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.532+0000 7fc391ffb640 1 -- 172.21.15.110:0/3014305344 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fc3980f1470 con 0x7fc39c150f30 2024-04-22T01:10:48.533 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc3800678c0 msgr2=0x7fc380069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc3800678c0 0x7fc380069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc3940012f0 tx=0x7fc3940019a0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c150f30 msgr2=0x7fc39c14c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c150f30 0x7fc39c14c690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3980ae040 tx=0x7fc39801acc0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 shutdown_connections 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc3800678c0 0x7fc380069d80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c150f30 0x7fc39c14c690 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39c0c3450 0x7fc39c14c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 --2- 172.21.15.110:0/3014305344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc39c0727a0 0x7fc39c1f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 >> 172.21.15.110:0/3014305344 conn(0x7fc39c06e590 msgr2=0x7fc39c15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:48.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 shutdown_connections 2024-04-22T01:10:48.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.536+0000 7fc3a346d640 1 -- 172.21.15.110:0/3014305344 wait complete. 2024-04-22T01:10:48.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T01:10:48.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb611f68640 1 Processor -- start 2024-04-22T01:10:48.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb611f68640 1 -- start start 2024-04-22T01:10:48.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb611f68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c1515e0 0x7fb60c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb611f68640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60c071770 con 0x7fb60c151200 2024-04-22T01:10:48.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb611f68640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60c072b50 con 0x7fb60c071980 2024-04-22T01:10:48.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb611f68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb60c157420 con 0x7fb60c1515e0 2024-04-22T01:10:48.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb60b7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb60c151200 0x7fb60c0c7a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:38756/0 (socket says 172.21.15.110:38756) 2024-04-22T01:10:48.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb60b7fe640 1 -- 172.21.15.110:0/293195196 learned_addr learned my addr 172.21.15.110:0/293195196 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:48.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.680+0000 7fb60affd640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c1515e0 0x7fb60c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.684+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501617567 0 0) 0x7fb60c071770 con 0x7fb60c151200 2024-04-22T01:10:48.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.684+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5f8003530 con 0x7fb60c151200 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2721983966 0 0) 0x7fb5f8003530 con 0x7fb60c151200 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c1515e0 msgr2=0x7fb60c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c1515e0 0x7fb60c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 >> v1:172.21.15.154:6789/0 conn(0x7fb60c071980 legacy=0x7fb60c0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c072df0 con 0x7fb60c151200 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7fb5f4001680 con 0x7fb60c151200 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 >> v1:172.21.15.110:6789/0 conn(0x7fb60c151200 legacy=0x7fb60c0c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c1515e0 0x7fb5f80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f8003f70 0x7fb5f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8004d50 0x7fb5f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c157420 con 0x7fb5f8003f70 2024-04-22T01:10:48.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f800dcc0 con 0x7fb5f8004d50 2024-04-22T01:10:48.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.688+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f800dec0 con 0x7fb60c1515e0 2024-04-22T01:10:48.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.692+0000 7fb60affd640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f8003f70 0x7fb5f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.692+0000 7fb60affd640 1 -- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c1515e0 msgr2=0x7fb5f80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:48.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.692+0000 7fb60affd640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c1515e0 0x7fb5f80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.692+0000 7fb60affd640 1 -- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8004d50 msgr2=0x7fb5f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:48.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.692+0000 7fb60affd640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8004d50 0x7fb5f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.692+0000 7fb60affd640 1 -- 172.21.15.110:0/293195196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f8003530 con 0x7fb5f8003f70 2024-04-22T01:10:48.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.696+0000 7fb60affd640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f8003f70 0x7fb5f8004810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009ae0 tx=0x7fb5fc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee49105a448c18c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:48.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0b2070 con 0x7fb5f8003f70 2024-04-22T01:10:48.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0a56a0 con 0x7fb5f8003f70 2024-04-22T01:10:48.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb60a7fc640 1 -- 172.21.15.110:0/293195196 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0096b0 con 0x7fb5f8003f70 2024-04-22T01:10:48.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb611f68640 1 -- 172.21.15.110:0/293195196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f8003f70 msgr2=0x7fb5f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb611f68640 1 --2- 172.21.15.110:0/293195196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f8003f70 0x7fb5f8004810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009ae0 tx=0x7fb5fc01cab0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb60bfff640 1 -- 172.21.15.110:0/293195196 reap_dead start 2024-04-22T01:10:48.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb611f68640 1 -- 172.21.15.110:0/293195196 shutdown_connections 2024-04-22T01:10:48.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb611f68640 1 -- 172.21.15.110:0/293195196 >> 172.21.15.110:0/293195196 conn(0x7fb60c0cb710 msgr2=0x7fb60c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:48.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb611f68640 1 -- 172.21.15.110:0/293195196 shutdown_connections 2024-04-22T01:10:48.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.700+0000 7fb611f68640 1 -- 172.21.15.110:0/293195196 wait complete. 2024-04-22T01:10:48.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 Processor -- start 2024-04-22T01:10:48.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 -- start start 2024-04-22T01:10:48.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c14f350 0x7fb60c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60c14f730 0x7fb60c143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c146d80 0x7fb60c1435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c0c88b0 con 0x7fb60c146d80 2024-04-22T01:10:48.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c0733b0 con 0x7fb60c14f730 2024-04-22T01:10:48.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb611f68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb60c0c8a30 con 0x7fb60c14f350 2024-04-22T01:10:48.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c146d80 0x7fb60c1435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c146d80 0x7fb60c1435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44040/0 (socket says 172.21.15.110:44040) 2024-04-22T01:10:48.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb60bfff640 1 -- 172.21.15.110:0/60999873 learned_addr learned my addr 172.21.15.110:0/60999873 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:48.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb60b7fe640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c14f350 0x7fb60c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.704+0000 7fb60affd640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60c14f730 0x7fb60c143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.708+0000 7fb60bfff640 1 -- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c14f350 msgr2=0x7fb60c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.708+0000 7fb60bfff640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c14f350 0x7fb60c149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.708+0000 7fb60bfff640 1 -- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60c14f730 msgr2=0x7fb60c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:48.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.708+0000 7fb60bfff640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60c14f730 0x7fb60c143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:48.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.708+0000 7fb60bfff640 1 -- 172.21.15.110:0/60999873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c14ac40 con 0x7fb60c146d80 2024-04-22T01:10:48.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.712+0000 7fb60bfff640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c146d80 0x7fb60c1435c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0c95e0 tx=0x7fb60400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:48.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.716+0000 7fb603fff640 1 -- 172.21.15.110:0/60999873 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604017070 con 0x7fb60c146d80 2024-04-22T01:10:48.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.716+0000 7fb603fff640 1 -- 172.21.15.110:0/60999873 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb604007070 con 0x7fb60c146d80 2024-04-22T01:10:48.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.716+0000 7fb603fff640 1 -- 172.21.15.110:0/60999873 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6040074a0 con 0x7fb60c146d80 2024-04-22T01:10:48.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.716+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c14af20 con 0x7fb60c146d80 2024-04-22T01:10:48.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.716+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c15ab40 con 0x7fb60c146d80 2024-04-22T01:10:48.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.716+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60c04f510 con 0x7fb60c146d80 2024-04-22T01:10:48.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.736+0000 7fb603fff640 1 -- 172.21.15.110:0/60999873 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb60401a070 con 0x7fb60c146d80 2024-04-22T01:10:48.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.736+0000 7fb603fff640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb5ec067940 0x7fb5ec069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:48.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.736+0000 7fb60b7fe640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb5ec067940 0x7fb5ec069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:48.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.740+0000 7fb60b7fe640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb5ec067940 0x7fb5ec069e00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4001980 tx=0x7fb5f400a9a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:48.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:48.740+0000 7fb603fff640 1 -- 172.21.15.110:0/60999873 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb6040537c0 con 0x7fb60c146d80 2024-04-22T01:10:49.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.028+0000 7fb603fff640 1 -- 172.21.15.110:0/60999873 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fb604021020 con 0x7fb60c146d80 2024-04-22T01:10:49.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.204+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb60c1471e0 con 0x7fb60c146d80 2024-04-22T01:10:49.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.212+0000 7fb603fff640 1 -- 172.21.15.110:0/60999873 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fb604055720 con 0x7fb60c146d80 2024-04-22T01:10:49.212 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb5ec067940 msgr2=0x7fb5ec069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb5ec067940 0x7fb5ec069e00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4001980 tx=0x7fb5f400a9a0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c146d80 msgr2=0x7fb60c1435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c146d80 0x7fb60c1435c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0c95e0 tx=0x7fb60400cad0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 shutdown_connections 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb5ec067940 0x7fb5ec069e00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c146d80 0x7fb60c1435c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60c14f730 0x7fb60c143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 --2- 172.21.15.110:0/60999873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60c14f350 0x7fb60c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 >> 172.21.15.110:0/60999873 conn(0x7fb60c0cb710 msgr2=0x7fb60c06f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 shutdown_connections 2024-04-22T01:10:49.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.216+0000 7fb611f68640 1 -- 172.21.15.110:0/60999873 wait complete. 2024-04-22T01:10:49.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T01:10:49.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.352+0000 7f1ba48eb640 1 Processor -- start 2024-04-22T01:10:49.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.352+0000 7f1ba48eb640 1 -- start start 2024-04-22T01:10:49.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.352+0000 7f1ba48eb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ba0154790 0x7f1ba015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:49.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.352+0000 7f1ba48eb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:49.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.352+0000 7f1ba48eb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ba006b430 con 0x7f1ba01543b0 2024-04-22T01:10:49.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.352+0000 7f1ba48eb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1ba00c7720 con 0x7f1ba0154790 2024-04-22T01:10:49.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.352+0000 7f1ba48eb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba006b1e0 con 0x7f1ba0061fc0 2024-04-22T01:10:49.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.380+0000 7f1b9dd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ba0154790 0x7f1ba015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:49.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.380+0000 7f1b9e59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1ba01543b0 0x7f1ba00c7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:60634/0 (socket says 172.21.15.110:60634) 2024-04-22T01:10:49.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.380+0000 7f1b9e59c640 1 -- 172.21.15.110:0/404409482 learned_addr learned my addr 172.21.15.110:0/404409482 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:49.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.392+0000 7f1b9ed9d640 1 --2- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:49.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.396+0000 7f1b9dd9b640 1 -- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 msgr2=0x7f1ba006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:49.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.396+0000 7f1b9dd9b640 1 --2- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba006de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.396+0000 7f1b9dd9b640 1 -- 172.21.15.110:0/404409482 >> v1:172.21.15.154:6789/0 conn(0x7f1ba01543b0 legacy=0x7f1ba00c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:49.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.396+0000 7f1b9dd9b640 1 -- 172.21.15.110:0/404409482 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba006b710 con 0x7f1ba0154790 2024-04-22T01:10:49.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.408+0000 7f1b9dd9b640 1 --2- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba0154790 0x7f1ba015acd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097c0 tx=0x7f1b9401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=674045583c11c597 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:49.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1b9d59a640 1 -- 172.21.15.110:0/404409482 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b940b2070 con 0x7f1ba0154790 2024-04-22T01:10:49.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1b9d59a640 1 -- 172.21.15.110:0/404409482 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b940ad640 con 0x7f1ba0154790 2024-04-22T01:10:49.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1b9d59a640 1 -- 172.21.15.110:0/404409482 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b940ada10 con 0x7f1ba0154790 2024-04-22T01:10:49.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 -- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba0154790 msgr2=0x7f1ba015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:49.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba0154790 0x7f1ba015acd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097c0 tx=0x7f1b9401c4a0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 -- 172.21.15.110:0/404409482 shutdown_connections 2024-04-22T01:10:49.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/404409482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba0154790 0x7f1ba015acd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 -- 172.21.15.110:0/404409482 >> 172.21.15.110:0/404409482 conn(0x7f1ba00cc250 msgr2=0x7f1ba00cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:49.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 -- 172.21.15.110:0/404409482 shutdown_connections 2024-04-22T01:10:49.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 -- 172.21.15.110:0/404409482 wait complete. 2024-04-22T01:10:49.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.420+0000 7f1ba48eb640 1 Processor -- start 2024-04-22T01:10:49.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1ba48eb640 1 -- start start 2024-04-22T01:10:49.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1ba48eb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba01429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:49.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1ba48eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba01543b0 0x7f1ba0141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:49.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1ba48eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ba0154790 0x7f1ba0141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:49.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1ba48eb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba01675c0 con 0x7f1ba0154790 2024-04-22T01:10:49.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1ba48eb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba0167440 con 0x7f1ba01543b0 2024-04-22T01:10:49.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1ba48eb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba0167740 con 0x7f1ba0061fc0 2024-04-22T01:10:49.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1b9e59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba01429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:49.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1b9dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba01543b0 0x7f1ba0141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:49.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1b9e59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba01429b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:47786/0 (socket says 172.21.15.110:47786) 2024-04-22T01:10:49.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.424+0000 7f1b9e59c640 1 -- 172.21.15.110:0/3031612466 learned_addr learned my addr 172.21.15.110:0/3031612466 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.436+0000 7f1b9e59c640 1 -- 172.21.15.110:0/3031612466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba01543b0 msgr2=0x7f1ba0141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.436+0000 7f1b9e59c640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba01543b0 0x7f1ba0141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.436+0000 7f1b9e59c640 1 -- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ba0154790 msgr2=0x7f1ba0141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.436+0000 7f1b9e59c640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ba0154790 0x7f1ba0141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.436+0000 7f1b9e59c640 1 -- 172.21.15.110:0/3031612466 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba01f6d90 con 0x7f1ba0061fc0 2024-04-22T01:10:49.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.440+0000 7f1b9e59c640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba01429b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c450 tx=0x7f1b9000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:49.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.456+0000 7f1b8effd640 1 -- 172.21.15.110:0/3031612466 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90017070 con 0x7f1ba0061fc0 2024-04-22T01:10:49.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.456+0000 7f1b8effd640 1 -- 172.21.15.110:0/3031612466 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b90005cf0 con 0x7f1ba0061fc0 2024-04-22T01:10:49.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.456+0000 7f1b8effd640 1 -- 172.21.15.110:0/3031612466 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90007290 con 0x7f1ba0061fc0 2024-04-22T01:10:49.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.456+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba01f7070 con 0x7f1ba0061fc0 2024-04-22T01:10:49.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.456+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba01f7630 con 0x7f1ba0061fc0 2024-04-22T01:10:49.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.460+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba004f510 con 0x7f1ba0061fc0 2024-04-22T01:10:49.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.784+0000 7f1b8effd640 1 -- 172.21.15.110:0/3031612466 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b9001a070 con 0x7f1ba0061fc0 2024-04-22T01:10:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.784+0000 7f1b8effd640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1b80067910 0x7f1b80069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:49.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.784+0000 7f1b9dd9b640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1b80067910 0x7f1b80069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:49.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.784+0000 7f1b9dd9b640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1b80067910 0x7f1b80069dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1b940af000 tx=0x7f1b940a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:49.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.784+0000 7f1b8effd640 1 -- 172.21.15.110:0/3031612466 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1b900538f0 con 0x7f1ba0061fc0 2024-04-22T01:10:49.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.796+0000 7f1b8effd640 1 -- 172.21.15.110:0/3031612466 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f1b90021020 con 0x7f1ba0061fc0 2024-04-22T01:10:49.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:49.984+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1ba0150d00 con 0x7f1ba0061fc0 2024-04-22T01:10:50.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.000+0000 7f1b8effd640 1 -- 172.21.15.110:0/3031612466 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f1b90055850 con 0x7f1ba0061fc0 2024-04-22T01:10:50.000 INFO:teuthology.orchestra.run.smithi110.stderr:listed 0 entries 2024-04-22T01:10:50.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1b80067910 msgr2=0x7f1b80069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1b80067910 0x7f1b80069dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1b940af000 tx=0x7f1b940a7070 comp rx=0 tx=0).stop 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 msgr2=0x7f1ba01429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba01429b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c450 tx=0x7f1b9000c910 comp rx=0 tx=0).stop 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 shutdown_connections 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f1b80067910 0x7f1b80069dd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ba0154790 0x7f1ba0141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba01543b0 0x7f1ba0141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 --2- 172.21.15.110:0/3031612466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba0061fc0 0x7f1ba01429b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 >> 172.21.15.110:0/3031612466 conn(0x7f1ba00cc250 msgr2=0x7f1ba00c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 shutdown_connections 2024-04-22T01:10:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:50.004+0000 7f1ba48eb640 1 -- 172.21.15.110:0/3031612466 wait complete. 2024-04-22T01:10:50.021 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi110.front.sepia.ceph.com... 2024-04-22T01:10:50.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T01:10:50.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-22T01:10:50.079 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:10:50.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:ceph-fuse[33652]: fuse finished with error 0 and tester_r 0 2024-04-22T01:10:50.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:==00:02:16:39.392 33652== 2024-04-22T01:10:50.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:==00:02:16:39.392 33652== Exit program on first error (--exit-on-first-error=yes) 2024-04-22T01:10:51.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:daemon-helper: command failed with exit status 42 2024-04-22T01:10:56.181 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-22T01:10:56.181 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-04-22T01:10:56.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T01:10:56.181 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-22T01:10:56.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T01:10:56.208 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-04-22T01:10:56.255 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-22T01:10:56.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T01:10:56.256 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T01:10:56.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T01:10:56.315 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-04-22T01:10:56.512 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-22T01:10:56.521 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T01:10:56.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T01:10:56.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2c6dc640 1 Processor -- start 2024-04-22T01:10:56.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2c6dc640 1 -- start start 2024-04-22T01:10:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2c6dc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24154560 0x7fec240705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2c6dc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2415e5b0 con 0x7fec2415ae70 2024-04-22T01:10:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2c6dc640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2415e890 con 0x7fec24154940 2024-04-22T01:10:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2c6dc640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fec2406b8d0 con 0x7fec24154560 2024-04-22T01:10:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2ac79640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fec2415ae70 0x7fec24164d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:53246/0 (socket says 172.21.15.110:53246) 2024-04-22T01:10:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.644+0000 7fec2ac79640 1 -- 172.21.15.110:0/2248832219 learned_addr learned my addr 172.21.15.110:0/2248832219 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:56.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.648+0000 7fec2a478640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24154560 0x7fec240705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:56.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.648+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242017490 0 0) 0x7fec2415e5b0 con 0x7fec2415ae70 2024-04-22T01:10:56.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.648+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec10003530 con 0x7fec2415ae70 2024-04-22T01:10:56.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1954580467 0 0) 0x7fec10003530 con 0x7fec2415ae70 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24154560 msgr2=0x7fec240705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24154560 0x7fec240705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 >> v1:172.21.15.154:6789/0 conn(0x7fec24154940 legacy=0x7fec2415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2406b280 con 0x7fec2415ae70 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7fec1c001a00 con 0x7fec2415ae70 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 >> v1:172.21.15.110:6789/0 conn(0x7fec2415ae70 legacy=0x7fec24164d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100039f0 0x7fec10003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24154560 0x7fec10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10004d50 0x7fec100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fec1000bb60 con 0x7fec10004d50 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec1000bce0 con 0x7fec100039f0 2024-04-22T01:10:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.652+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fec1000bee0 con 0x7fec24154560 2024-04-22T01:10:56.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.656+0000 7fec2ac79640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10004d50 0x7fec100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:56.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.660+0000 7fec2a478640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100039f0 0x7fec10003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:56.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.660+0000 7fec2ac79640 1 -- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24154560 msgr2=0x7fec10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:56.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.660+0000 7fec2ac79640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24154560 0x7fec10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:56.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.660+0000 7fec2ac79640 1 -- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100039f0 msgr2=0x7fec10003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:56.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.660+0000 7fec2ac79640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100039f0 0x7fec10003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:56.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.660+0000 7fec2ac79640 1 -- 172.21.15.110:0/2248832219 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec10003530 con 0x7fec10004d50 2024-04-22T01:10:56.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.664+0000 7fec2ac79640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10004d50 0x7fec100051d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00a770 tx=0x7fec1c01fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f98acdc229e0b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:56.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00a390 con 0x7fec10004d50 2024-04-22T01:10:56.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1c0aa650 con 0x7fec10004d50 2024-04-22T01:10:56.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec29476640 1 -- 172.21.15.110:0/2248832219 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0aaac0 con 0x7fec10004d50 2024-04-22T01:10:56.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 -- 172.21.15.110:0/2248832219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10004d50 msgr2=0x7fec100051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:56.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 --2- 172.21.15.110:0/2248832219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10004d50 0x7fec100051d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00a770 tx=0x7fec1c01fa00 comp rx=0 tx=0).stop 2024-04-22T01:10:56.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2ac79640 1 -- 172.21.15.110:0/2248832219 reap_dead start 2024-04-22T01:10:56.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 -- 172.21.15.110:0/2248832219 shutdown_connections 2024-04-22T01:10:56.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 -- 172.21.15.110:0/2248832219 >> 172.21.15.110:0/2248832219 conn(0x7fec2406e5c0 msgr2=0x7fec2406e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:56.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 -- 172.21.15.110:0/2248832219 shutdown_connections 2024-04-22T01:10:56.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 -- 172.21.15.110:0/2248832219 wait complete. 2024-04-22T01:10:56.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 Processor -- start 2024-04-22T01:10:56.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.668+0000 7fec2c6dc640 1 -- start start 2024-04-22T01:10:56.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2c6dc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec240707c0 0x7fec241efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2c6dc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec24070ba0 0x7fec241eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2c6dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240c4160 0x7fec241571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2c6dc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fec24073840 con 0x7fec24070ba0 2024-04-22T01:10:56.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2c6dc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec240736c0 con 0x7fec240c4160 2024-04-22T01:10:56.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2c6dc640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fec240727a0 con 0x7fec240707c0 2024-04-22T01:10:56.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec29c77640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec24070ba0 0x7fec241eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:56.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec29c77640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec24070ba0 0x7fec241eff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56182/0 (socket says 172.21.15.110:56182) 2024-04-22T01:10:56.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec29c77640 1 -- 172.21.15.110:0/3911839074 learned_addr learned my addr 172.21.15.110:0/3911839074 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:56.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2a478640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec240707c0 0x7fec241efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:56.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.672+0000 7fec2ac79640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240c4160 0x7fec241571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.676+0000 7fec29c77640 1 -- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec240707c0 msgr2=0x7fec241efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.676+0000 7fec29c77640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec240707c0 0x7fec241efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.676+0000 7fec29c77640 1 -- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240c4160 msgr2=0x7fec241571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.676+0000 7fec29c77640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240c4160 0x7fec241571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.676+0000 7fec29c77640 1 -- 172.21.15.110:0/3911839074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec240c6ae0 con 0x7fec24070ba0 2024-04-22T01:10:56.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.676+0000 7fec29c77640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec24070ba0 0x7fec241eff90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec1400c500 tx=0x7fec1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:56.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.680+0000 7fec1affd640 1 -- 172.21.15.110:0/3911839074 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14017070 con 0x7fec24070ba0 2024-04-22T01:10:56.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.680+0000 7fec1affd640 1 -- 172.21.15.110:0/3911839074 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec140052d0 con 0x7fec24070ba0 2024-04-22T01:10:56.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.680+0000 7fec1affd640 1 -- 172.21.15.110:0/3911839074 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14003840 con 0x7fec24070ba0 2024-04-22T01:10:56.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.680+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec240cd850 con 0x7fec24070ba0 2024-04-22T01:10:56.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.680+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec241f33c0 con 0x7fec24070ba0 2024-04-22T01:10:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.684+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec2404f510 con 0x7fec24070ba0 2024-04-22T01:10:56.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.964+0000 7fec1affd640 1 -- 172.21.15.110:0/3911839074 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec1401a070 con 0x7fec24070ba0 2024-04-22T01:10:56.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.968+0000 7fec1affd640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fec08067910 0x7fec08069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:56.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.968+0000 7fec2a478640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fec08067910 0x7fec08069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:56.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:56.968+0000 7fec2a478640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fec08067910 0x7fec08069dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec20009b00 tx=0x7fec20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:57.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.004+0000 7fec1affd640 1 -- 172.21.15.110:0/3911839074 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fec140539a0 con 0x7fec24070ba0 2024-04-22T01:10:57.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.004+0000 7fec1affd640 1 -- 172.21.15.110:0/3911839074 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fec14021020 con 0x7fec24070ba0 2024-04-22T01:10:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.168+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec240c7bd0 con 0x7fec08067910 2024-04-22T01:10:57.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.176+0000 7fec1affd640 1 -- 172.21.15.110:0/3911839074 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254398 (secure 0 0 0) 0x7fec240c7bd0 con 0x7fec08067910 2024-04-22T01:10:57.179 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:10:57.180 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-22T01:10:57.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fec08067910 msgr2=0x7fec08069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fec08067910 0x7fec08069dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec20009b00 tx=0x7fec20008040 comp rx=0 tx=0).stop 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec24070ba0 msgr2=0x7fec241eff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec24070ba0 0x7fec241eff90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec1400c500 tx=0x7fec1400c9c0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 shutdown_connections 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fec08067910 0x7fec08069dd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240c4160 0x7fec241571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec24070ba0 0x7fec241eff90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 --2- 172.21.15.110:0/3911839074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec240707c0 0x7fec241efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 >> 172.21.15.110:0/3911839074 conn(0x7fec2406e5c0 msgr2=0x7fec24152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 shutdown_connections 2024-04-22T01:10:57.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.180+0000 7fec2c6dc640 1 -- 172.21.15.110:0/3911839074 wait complete. 2024-04-22T01:10:57.198 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":4161,"stamp":"2024-04-22T01:10:56.499034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213720375,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":7236,"num_read_kb":1459077,"num_write":73026,"num_write_kb":4525199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65691,"ondisk_log_size":65691,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":946224,"kb_used_data":224816,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":754028496,"statfs":{"total":773094113280,"available":772125179904,"internally_reserved":0,"allocated":230211584,"data_stored":428189614,"data_compressed":52390758,"data_compressed_allocated":69984256,"data_compressed_original":269344768,"omap_allocated":12749,"internal_metadata":738643507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21265,"num_objects":-7,"num_object_clones":0,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":45,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004022"},"pg_stats":[{"pgid":"3.3f","version":"25'426","reported_seq":560,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.784372+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-22T01:10:50.784372+0000","last_peered":"2024-04-22T01:10:50.784372+0000","last_clean":"2024-04-22T01:10:50.784372+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-22T01:10:50.784372+0000","last_undegraded":"2024-04-22T01:10:50.784372+0000","last_fullsized":"2024-04-22T01:10:50.784372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28398,"num_write":395,"num_write_kb":75936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'442","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.636503+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-22T01:10:50.636503+0000","last_peered":"2024-04-22T01:10:50.636503+0000","last_clean":"2024-04-22T01:10:50.636503+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-22T01:10:50.636503+0000","last_undegraded":"2024-04-22T01:10:50.636503+0000","last_fullsized":"2024-04-22T01:10:50.636503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:25:19.748728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20820,"num_write":419,"num_write_kb":84104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'391","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672759+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-22T01:10:50.672759+0000","last_peered":"2024-04-22T01:10:50.672759+0000","last_clean":"2024-04-22T01:10:50.672759+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-22T01:10:50.672759+0000","last_undegraded":"2024-04-22T01:10:50.672759+0000","last_fullsized":"2024-04-22T01:10:50.672759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:27:16.978980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18719,"num_write":364,"num_write_kb":70997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'353","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.463402+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-22T01:10:50.463402+0000","last_peered":"2024-04-22T01:10:50.463402+0000","last_clean":"2024-04-22T01:10:50.463402+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-22T01:10:50.463402+0000","last_undegraded":"2024-04-22T01:10:50.463402+0000","last_fullsized":"2024-04-22T01:10:50.463402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":316,"num_write_kb":12972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'420","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787858+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-22T01:10:50.787858+0000","last_peered":"2024-04-22T01:10:50.787858+0000","last_clean":"2024-04-22T01:10:50.787858+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-22T01:10:50.787858+0000","last_undegraded":"2024-04-22T01:10:50.787858+0000","last_fullsized":"2024-04-22T01:10:50.787858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:26:22.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":394,"num_write_kb":67878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'395","reported_seq":498,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.462469+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-22T01:10:50.462469+0000","last_peered":"2024-04-22T01:10:50.462469+0000","last_clean":"2024-04-22T01:10:50.462469+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-22T01:10:50.462469+0000","last_undegraded":"2024-04-22T01:10:50.462469+0000","last_fullsized":"2024-04-22T01:10:50.462469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17967,"num_write":373,"num_write_kb":71499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787989+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-22T01:10:50.787989+0000","last_peered":"2024-04-22T01:10:50.787989+0000","last_clean":"2024-04-22T01:10:50.787989+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-22T01:10:50.787989+0000","last_undegraded":"2024-04-22T01:10:50.787989+0000","last_fullsized":"2024-04-22T01:10:50.787989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13670,"num_write":376,"num_write_kb":39263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'387","reported_seq":533,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671825+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-22T01:10:50.671825+0000","last_peered":"2024-04-22T01:10:50.671825+0000","last_clean":"2024-04-22T01:10:50.671825+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-22T01:10:50.671825+0000","last_undegraded":"2024-04-22T01:10:50.671825+0000","last_fullsized":"2024-04-22T01:10:50.671825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:40:03.621192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":42822,"num_write":351,"num_write_kb":100036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'424","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.793849+0000","last_change":"2024-04-21T22:53:38.576571+0000","last_active":"2024-04-22T01:10:50.793849+0000","last_peered":"2024-04-22T01:10:50.793849+0000","last_clean":"2024-04-22T01:10:50.793849+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-22T01:10:50.793849+0000","last_undegraded":"2024-04-22T01:10:50.793849+0000","last_fullsized":"2024-04-22T01:10:50.793849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20454,"num_write":396,"num_write_kb":59842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787702+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-22T01:10:50.787702+0000","last_peered":"2024-04-22T01:10:50.787702+0000","last_clean":"2024-04-22T01:10:50.787702+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-22T01:10:50.787702+0000","last_undegraded":"2024-04-22T01:10:50.787702+0000","last_fullsized":"2024-04-22T01:10:50.787702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:26.176484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5548,"num_write":382,"num_write_kb":76042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'383","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.788888+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-22T01:10:50.788888+0000","last_peered":"2024-04-22T01:10:50.788888+0000","last_clean":"2024-04-22T01:10:50.788888+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-22T01:10:50.788888+0000","last_undegraded":"2024-04-22T01:10:50.788888+0000","last_fullsized":"2024-04-22T01:10:50.788888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12739,"num_write":368,"num_write_kb":54575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'362","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.792220+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-22T01:10:50.792220+0000","last_peered":"2024-04-22T01:10:50.792220+0000","last_clean":"2024-04-22T01:10:50.792220+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-22T01:10:50.792220+0000","last_undegraded":"2024-04-22T01:10:50.792220+0000","last_fullsized":"2024-04-22T01:10:50.792220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:51:01.311466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9062,"num_write":334,"num_write_kb":50352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'384","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.511489+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-22T01:10:50.511489+0000","last_peered":"2024-04-22T01:10:50.511489+0000","last_clean":"2024-04-22T01:10:50.511489+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-22T01:10:50.511489+0000","last_undegraded":"2024-04-22T01:10:50.511489+0000","last_fullsized":"2024-04-22T01:10:50.511489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12819,"num_write":349,"num_write_kb":62920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'430","reported_seq":537,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.506564+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-22T01:10:50.506564+0000","last_peered":"2024-04-22T01:10:50.506564+0000","last_clean":"2024-04-22T01:10:50.506564+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-22T01:10:50.506564+0000","last_undegraded":"2024-04-22T01:10:50.506564+0000","last_fullsized":"2024-04-22T01:10:50.506564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21265,"num_write":396,"num_write_kb":88387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'436","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669670+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-22T01:10:50.669670+0000","last_peered":"2024-04-22T01:10:50.669670+0000","last_clean":"2024-04-22T01:10:50.669670+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-22T01:10:50.669670+0000","last_undegraded":"2024-04-22T01:10:50.669670+0000","last_fullsized":"2024-04-22T01:10:50.669670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:52:43.706899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21940,"num_write":398,"num_write_kb":112507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'433","reported_seq":557,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.618971+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-22T01:10:50.618971+0000","last_peered":"2024-04-22T01:10:50.618971+0000","last_clean":"2024-04-22T01:10:50.618971+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-22T01:10:50.618971+0000","last_undegraded":"2024-04-22T01:10:50.618971+0000","last_fullsized":"2024-04-22T01:10:50.618971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26769,"num_write":400,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'401","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.621571+0000","last_change":"2024-04-21T22:54:44.971067+0000","last_active":"2024-04-22T01:10:50.621571+0000","last_peered":"2024-04-22T01:10:50.621571+0000","last_clean":"2024-04-22T01:10:50.621571+0000","last_became_active":"2024-04-21T22:54:44.970288+0000","last_became_peered":"2024-04-21T22:54:44.970288+0000","last_unstale":"2024-04-22T01:10:50.621571+0000","last_undegraded":"2024-04-22T01:10:50.621571+0000","last_fullsized":"2024-04-22T01:10:50.621571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:37:41.657624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17556,"num_write":374,"num_write_kb":67589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'395","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.523427+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-22T01:10:50.523427+0000","last_peered":"2024-04-22T01:10:50.523427+0000","last_clean":"2024-04-22T01:10:50.523427+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-22T01:10:50.523427+0000","last_undegraded":"2024-04-22T01:10:50.523427+0000","last_fullsized":"2024-04-22T01:10:50.523427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22256,"num_write":365,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'432","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.610401+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-22T01:10:50.610401+0000","last_peered":"2024-04-22T01:10:50.610401+0000","last_clean":"2024-04-22T01:10:50.610401+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-22T01:10:50.610401+0000","last_undegraded":"2024-04-22T01:10:50.610401+0000","last_fullsized":"2024-04-22T01:10:50.610401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:37:06.081826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39722,"num_write":402,"num_write_kb":89327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.792125+0000","last_change":"2024-04-21T22:53:38.610862+0000","last_active":"2024-04-22T01:10:50.792125+0000","last_peered":"2024-04-22T01:10:50.792125+0000","last_clean":"2024-04-22T01:10:50.792125+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-22T01:10:50.792125+0000","last_undegraded":"2024-04-22T01:10:50.792125+0000","last_fullsized":"2024-04-22T01:10:50.792125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:51.748240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4220,"num_write":403,"num_write_kb":46421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'421","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675472+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-22T01:10:50.675472+0000","last_peered":"2024-04-22T01:10:50.675472+0000","last_clean":"2024-04-22T01:10:50.675472+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-22T01:10:50.675472+0000","last_undegraded":"2024-04-22T01:10:50.675472+0000","last_fullsized":"2024-04-22T01:10:50.675472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":8093,"num_write":400,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'410","reported_seq":535,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.791677+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-22T01:10:50.791677+0000","last_peered":"2024-04-22T01:10:50.791677+0000","last_clean":"2024-04-22T01:10:50.791677+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-22T01:10:50.791677+0000","last_undegraded":"2024-04-22T01:10:50.791677+0000","last_fullsized":"2024-04-22T01:10:50.791677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28547,"num_write":383,"num_write_kb":51065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'415","reported_seq":552,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.670125+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-22T01:10:50.670125+0000","last_peered":"2024-04-22T01:10:50.670125+0000","last_clean":"2024-04-22T01:10:50.670125+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-22T01:10:50.670125+0000","last_undegraded":"2024-04-22T01:10:50.670125+0000","last_fullsized":"2024-04-22T01:10:50.670125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:47:54.239652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":35420,"num_write":386,"num_write_kb":88354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'418","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.648468+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-22T01:10:50.648468+0000","last_peered":"2024-04-22T01:10:50.648468+0000","last_clean":"2024-04-22T01:10:50.648468+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-22T01:10:50.648468+0000","last_undegraded":"2024-04-22T01:10:50.648468+0000","last_fullsized":"2024-04-22T01:10:50.648468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6808,"num_write":388,"num_write_kb":34297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'391","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669224+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-22T01:10:50.669224+0000","last_peered":"2024-04-22T01:10:50.669224+0000","last_clean":"2024-04-22T01:10:50.669224+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-22T01:10:50.669224+0000","last_undegraded":"2024-04-22T01:10:50.669224+0000","last_fullsized":"2024-04-22T01:10:50.669224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:25:42.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4176,"num_write":374,"num_write_kb":46218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'491","reported_seq":621,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.486307+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-22T01:10:50.486307+0000","last_peered":"2024-04-22T01:10:50.486307+0000","last_clean":"2024-04-22T01:10:50.486307+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-22T01:10:50.486307+0000","last_undegraded":"2024-04-22T01:10:50.486307+0000","last_fullsized":"2024-04-22T01:10:50.486307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29218,"num_write":445,"num_write_kb":101143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'436","reported_seq":576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.476674+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-22T01:10:50.476674+0000","last_peered":"2024-04-22T01:10:50.476674+0000","last_clean":"2024-04-22T01:10:50.476674+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-22T01:10:50.476674+0000","last_undegraded":"2024-04-22T01:10:50.476674+0000","last_fullsized":"2024-04-22T01:10:50.476674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29285,"num_write":407,"num_write_kb":84259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'386","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.510987+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-22T01:10:50.510987+0000","last_peered":"2024-04-22T01:10:50.510987+0000","last_clean":"2024-04-22T01:10:50.510987+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-22T01:10:50.510987+0000","last_undegraded":"2024-04-22T01:10:50.510987+0000","last_fullsized":"2024-04-22T01:10:50.510987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28108,"num_write":361,"num_write_kb":80021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'403","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669252+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-22T01:10:50.669252+0000","last_peered":"2024-04-22T01:10:50.669252+0000","last_clean":"2024-04-22T01:10:50.669252+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-22T01:10:50.669252+0000","last_undegraded":"2024-04-22T01:10:50.669252+0000","last_fullsized":"2024-04-22T01:10:50.669252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:43:35.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31845,"num_write":369,"num_write_kb":46987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'465","reported_seq":604,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.597026+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-22T01:10:50.597026+0000","last_peered":"2024-04-22T01:10:50.597026+0000","last_clean":"2024-04-22T01:10:50.597026+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-22T01:10:50.597026+0000","last_undegraded":"2024-04-22T01:10:50.597026+0000","last_fullsized":"2024-04-22T01:10:50.597026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":45092,"num_write":433,"num_write_kb":99910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'465","reported_seq":619,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.515836+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-22T01:10:50.515836+0000","last_peered":"2024-04-22T01:10:50.515836+0000","last_clean":"2024-04-22T01:10:50.515836+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-22T01:10:50.515836+0000","last_undegraded":"2024-04-22T01:10:50.515836+0000","last_fullsized":"2024-04-22T01:10:50.515836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44084,"num_write":435,"num_write_kb":97059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'430","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.466232+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-22T01:10:50.466232+0000","last_peered":"2024-04-22T01:10:50.466232+0000","last_clean":"2024-04-22T01:10:50.466232+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-22T01:10:50.466232+0000","last_undegraded":"2024-04-22T01:10:50.466232+0000","last_fullsized":"2024-04-22T01:10:50.466232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14125,"num_write":397,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.789963+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-22T01:10:50.789963+0000","last_peered":"2024-04-22T01:10:50.789963+0000","last_clean":"2024-04-22T01:10:50.789963+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-22T01:10:50.789963+0000","last_undegraded":"2024-04-22T01:10:50.789963+0000","last_fullsized":"2024-04-22T01:10:50.789963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31266,"num_write":385,"num_write_kb":75657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'363","reported_seq":435,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:38.124898+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-22T01:08:38.124898+0000","last_peered":"2024-04-22T01:08:38.124898+0000","last_clean":"2024-04-22T01:08:38.124898+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-22T01:08:38.124898+0000","last_undegraded":"2024-04-22T01:08:38.124898+0000","last_fullsized":"2024-04-22T01:08:38.124898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'372","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675292+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-22T01:10:50.675292+0000","last_peered":"2024-04-22T01:10:50.675292+0000","last_clean":"2024-04-22T01:10:50.675292+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-22T01:10:50.675292+0000","last_undegraded":"2024-04-22T01:10:50.675292+0000","last_fullsized":"2024-04-22T01:10:50.675292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19141,"num_write":353,"num_write_kb":42712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'2175","reported_seq":2247,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:40.436426+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-22T01:08:40.436426+0000","last_peered":"2024-04-22T01:08:40.436426+0000","last_clean":"2024-04-22T01:08:40.436426+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-22T01:08:40.436426+0000","last_undegraded":"2024-04-22T01:08:40.436426+0000","last_fullsized":"2024-04-22T01:08:40.436426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2175,"log_dups_size":0,"ondisk_log_size":2175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:31.566421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2118,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'778","reported_seq":852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:45.527664+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-22T01:09:45.527664+0000","last_peered":"2024-04-22T01:09:45.527664+0000","last_clean":"2024-04-22T01:09:45.527664+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-22T01:09:45.527664+0000","last_undegraded":"2024-04-22T01:09:45.527664+0000","last_fullsized":"2024-04-22T01:09:45.527664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'427","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671412+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-22T01:10:50.671412+0000","last_peered":"2024-04-22T01:10:50.671412+0000","last_clean":"2024-04-22T01:10:50.671412+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-22T01:10:50.671412+0000","last_undegraded":"2024-04-22T01:10:50.671412+0000","last_fullsized":"2024-04-22T01:10:50.671412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:38:02.541775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27111,"num_write":394,"num_write_kb":58934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1416","reported_seq":1490,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:00.439752+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-22T01:09:00.439752+0000","last_peered":"2024-04-22T01:09:00.439752+0000","last_clean":"2024-04-22T01:09:00.439752+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-22T01:09:00.439752+0000","last_undegraded":"2024-04-22T01:09:00.439752+0000","last_fullsized":"2024-04-22T01:09:00.439752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":12962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'395","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.674564+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-22T01:10:50.674564+0000","last_peered":"2024-04-22T01:10:50.674564+0000","last_clean":"2024-04-22T01:10:50.674564+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-22T01:10:50.674564+0000","last_undegraded":"2024-04-22T01:10:50.674564+0000","last_fullsized":"2024-04-22T01:10:50.674564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":217,"num_write":366,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'56","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:00.407654+0000","last_change":"2024-04-21T22:53:37.185089+0000","last_active":"2024-04-22T01:09:00.407654+0000","last_peered":"2024-04-22T01:09:00.407654+0000","last_clean":"2024-04-22T01:09:00.407654+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-22T01:09:00.407654+0000","last_undegraded":"2024-04-22T01:09:00.407654+0000","last_fullsized":"2024-04-22T01:09:00.407654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'451","reported_seq":580,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.488185+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-22T01:10:50.488185+0000","last_peered":"2024-04-22T01:10:50.488185+0000","last_clean":"2024-04-22T01:10:50.488185+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-22T01:10:50.488185+0000","last_undegraded":"2024-04-22T01:10:50.488185+0000","last_fullsized":"2024-04-22T01:10:50.488185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:09.983320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27728,"num_write":424,"num_write_kb":88654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1252","reported_seq":1326,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.170034+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-22T01:10:50.170034+0000","last_peered":"2024-04-22T01:10:50.170034+0000","last_clean":"2024-04-22T01:10:50.170034+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-22T01:10:50.170034+0000","last_undegraded":"2024-04-22T01:10:50.170034+0000","last_fullsized":"2024-04-22T01:10:50.170034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10339768,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":10694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'398","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669454+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-22T01:10:50.669454+0000","last_peered":"2024-04-22T01:10:50.669454+0000","last_clean":"2024-04-22T01:10:50.669454+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-22T01:10:50.669454+0000","last_undegraded":"2024-04-22T01:10:50.669454+0000","last_fullsized":"2024-04-22T01:10:50.669454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:13.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27611,"num_write":368,"num_write_kb":80241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'3971","reported_seq":4045,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.475044+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-22T01:10:44.475044+0000","last_peered":"2024-04-22T01:10:44.475044+0000","last_clean":"2024-04-22T01:10:44.475044+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-22T01:10:44.475044+0000","last_undegraded":"2024-04-22T01:10:44.475044+0000","last_fullsized":"2024-04-22T01:10:44.475044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3971,"log_dups_size":0,"ondisk_log_size":3971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'395","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.643246+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-22T01:10:50.643246+0000","last_peered":"2024-04-22T01:10:50.643246+0000","last_clean":"2024-04-22T01:10:50.643246+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-22T01:10:50.643246+0000","last_undegraded":"2024-04-22T01:10:50.643246+0000","last_fullsized":"2024-04-22T01:10:50.643246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:50.140041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17003,"num_write":357,"num_write_kb":47379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2295","reported_seq":2371,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:33.710526+0000","last_change":"2024-04-21T22:53:37.134021+0000","last_active":"2024-04-22T01:10:33.710526+0000","last_peered":"2024-04-22T01:10:33.710526+0000","last_clean":"2024-04-22T01:10:33.710526+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-22T01:10:33.710526+0000","last_undegraded":"2024-04-22T01:10:33.710526+0000","last_fullsized":"2024-04-22T01:10:33.710526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:57.000042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2254,"num_write_kb":13663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'414","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.785058+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-22T01:10:50.785058+0000","last_peered":"2024-04-22T01:10:50.785058+0000","last_clean":"2024-04-22T01:10:50.785058+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-22T01:10:50.785058+0000","last_undegraded":"2024-04-22T01:10:50.785058+0000","last_fullsized":"2024-04-22T01:10:50.785058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26385,"num_write":381,"num_write_kb":92626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'720","reported_seq":796,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.927568+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-22T01:08:57.927568+0000","last_peered":"2024-04-22T01:08:57.927568+0000","last_clean":"2024-04-22T01:08:57.927568+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-22T01:08:57.927568+0000","last_undegraded":"2024-04-22T01:08:57.927568+0000","last_fullsized":"2024-04-22T01:08:57.927568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'386","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.479154+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-22T01:10:50.479154+0000","last_peered":"2024-04-22T01:10:50.479154+0000","last_clean":"2024-04-22T01:10:50.479154+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-22T01:10:50.479154+0000","last_undegraded":"2024-04-22T01:10:50.479154+0000","last_fullsized":"2024-04-22T01:10:50.479154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5166,"num_write":360,"num_write_kb":42321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'60","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:42.567375+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-22T01:10:42.567375+0000","last_peered":"2024-04-22T01:10:42.567375+0000","last_clean":"2024-04-22T01:10:42.567375+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-22T01:10:42.567375+0000","last_undegraded":"2024-04-22T01:10:42.567375+0000","last_fullsized":"2024-04-22T01:10:42.567375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:52.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'397","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.638638+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-22T01:10:50.638638+0000","last_peered":"2024-04-22T01:10:50.638638+0000","last_clean":"2024-04-22T01:10:50.638638+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-22T01:10:50.638638+0000","last_undegraded":"2024-04-22T01:10:50.638638+0000","last_fullsized":"2024-04-22T01:10:50.638638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:27.631111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27517,"num_write":361,"num_write_kb":56016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'51","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:01.350404+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-22T01:08:01.350404+0000","last_peered":"2024-04-22T01:08:01.350404+0000","last_clean":"2024-04-22T01:08:01.350404+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-22T01:08:01.350404+0000","last_undegraded":"2024-04-22T01:08:01.350404+0000","last_fullsized":"2024-04-22T01:08:01.350404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'460","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.776781+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-22T01:10:50.776781+0000","last_peered":"2024-04-22T01:10:50.776781+0000","last_clean":"2024-04-22T01:10:50.776781+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-22T01:10:50.776781+0000","last_undegraded":"2024-04-22T01:10:50.776781+0000","last_fullsized":"2024-04-22T01:10:50.776781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":20178,"num_write":438,"num_write_kb":96694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'919","reported_seq":995,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:40.532907+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-22T01:10:40.532907+0000","last_peered":"2024-04-22T01:10:40.532907+0000","last_clean":"2024-04-22T01:10:40.532907+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-22T01:10:40.532907+0000","last_undegraded":"2024-04-22T01:10:40.532907+0000","last_fullsized":"2024-04-22T01:10:40.532907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'481","reported_seq":612,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.607613+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-22T01:10:50.607613+0000","last_peered":"2024-04-22T01:10:50.607613+0000","last_clean":"2024-04-22T01:10:50.607613+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-22T01:10:50.607613+0000","last_undegraded":"2024-04-22T01:10:50.607613+0000","last_fullsized":"2024-04-22T01:10:50.607613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33204,"num_write":448,"num_write_kb":124685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'818","reported_seq":896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:05.182561+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-22T01:10:05.182561+0000","last_peered":"2024-04-22T01:10:05.182561+0000","last_clean":"2024-04-22T01:10:05.182561+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-22T01:10:05.182561+0000","last_undegraded":"2024-04-22T01:10:05.182561+0000","last_fullsized":"2024-04-22T01:10:05.182561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'350","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.488114+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-22T01:10:50.488114+0000","last_peered":"2024-04-22T01:10:50.488114+0000","last_clean":"2024-04-22T01:10:50.488114+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-22T01:10:50.488114+0000","last_undegraded":"2024-04-22T01:10:50.488114+0000","last_fullsized":"2024-04-22T01:10:50.488114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12827,"num_write":324,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'820","reported_seq":899,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:39.664467+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-22T01:08:39.664467+0000","last_peered":"2024-04-22T01:08:39.664467+0000","last_clean":"2024-04-22T01:08:39.664467+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-22T01:08:39.664467+0000","last_undegraded":"2024-04-22T01:08:39.664467+0000","last_fullsized":"2024-04-22T01:08:39.664467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'428","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790681+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-22T01:10:50.790681+0000","last_peered":"2024-04-22T01:10:50.790681+0000","last_clean":"2024-04-22T01:10:50.790681+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-22T01:10:50.790681+0000","last_undegraded":"2024-04-22T01:10:50.790681+0000","last_fullsized":"2024-04-22T01:10:50.790681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36323,"num_write":394,"num_write_kb":104531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'352","reported_seq":431,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:58.737044+0000","last_change":"2024-04-21T22:53:37.253316+0000","last_active":"2024-04-22T01:08:58.737044+0000","last_peered":"2024-04-22T01:08:58.737044+0000","last_clean":"2024-04-22T01:08:58.737044+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-22T01:08:58.737044+0000","last_undegraded":"2024-04-22T01:08:58.737044+0000","last_fullsized":"2024-04-22T01:08:58.737044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:45:21.383363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'429","reported_seq":547,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.789412+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-22T01:10:50.789412+0000","last_peered":"2024-04-22T01:10:50.789412+0000","last_clean":"2024-04-22T01:10:50.789412+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-22T01:10:50.789412+0000","last_undegraded":"2024-04-22T01:10:50.789412+0000","last_fullsized":"2024-04-22T01:10:50.789412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22478,"num_write":396,"num_write_kb":50602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'340","reported_seq":419,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:30.741959+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-22T01:10:30.741959+0000","last_peered":"2024-04-22T01:10:30.741959+0000","last_clean":"2024-04-22T01:10:30.741959+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-22T01:10:30.741959+0000","last_undegraded":"2024-04-22T01:10:30.741959+0000","last_fullsized":"2024-04-22T01:10:30.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'412","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.640083+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-22T01:10:50.640083+0000","last_peered":"2024-04-22T01:10:50.640083+0000","last_clean":"2024-04-22T01:10:50.640083+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-22T01:10:50.640083+0000","last_undegraded":"2024-04-22T01:10:50.640083+0000","last_fullsized":"2024-04-22T01:10:50.640083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:03.405030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12764,"num_write":388,"num_write_kb":59120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'161","reported_seq":296,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:07:35.524302+0000","last_change":"2024-04-21T22:52:58.454152+0000","last_active":"2024-04-22T01:07:35.524302+0000","last_peered":"2024-04-22T01:07:35.524302+0000","last_clean":"2024-04-22T01:07:35.524302+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-22T01:07:35.524302+0000","last_undegraded":"2024-04-22T01:07:35.524302+0000","last_fullsized":"2024-04-22T01:07:35.524302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_clean_scrub_stamp":"2024-04-21T22:52:55.145387+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:11:10.808812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'373","reported_seq":456,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:21.928762+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-22T01:10:21.928762+0000","last_peered":"2024-04-22T01:10:21.928762+0000","last_clean":"2024-04-22T01:10:21.928762+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-22T01:10:21.928762+0000","last_undegraded":"2024-04-22T01:10:21.928762+0000","last_fullsized":"2024-04-22T01:10:21.928762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:29.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'363","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672534+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-22T01:10:50.672534+0000","last_peered":"2024-04-22T01:10:50.672534+0000","last_clean":"2024-04-22T01:10:50.672534+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-22T01:10:50.672534+0000","last_undegraded":"2024-04-22T01:10:50.672534+0000","last_fullsized":"2024-04-22T01:10:50.672534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26229,"num_write":331,"num_write_kb":46345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'1075","reported_seq":1161,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:05.048176+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-22T01:10:05.048176+0000","last_peered":"2024-04-22T01:10:05.048176+0000","last_clean":"2024-04-22T01:10:05.048176+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-22T01:10:05.048176+0000","last_undegraded":"2024-04-22T01:10:05.048176+0000","last_fullsized":"2024-04-22T01:10:05.048176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'414","reported_seq":606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.504820+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-22T01:10:50.504820+0000","last_peered":"2024-04-22T01:10:50.504820+0000","last_clean":"2024-04-22T01:10:50.504820+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-22T01:10:50.504820+0000","last_undegraded":"2024-04-22T01:10:50.504820+0000","last_fullsized":"2024-04-22T01:10:50.504820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":57177,"num_write":383,"num_write_kb":104760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'4405","reported_seq":8837,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:45.464245+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-22T01:10:45.464245+0000","last_peered":"2024-04-22T01:10:45.464245+0000","last_clean":"2024-04-22T01:10:45.464245+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-22T01:10:45.464245+0000","last_undegraded":"2024-04-22T01:10:45.464245+0000","last_fullsized":"2024-04-22T01:10:45.464245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":4349,"num_write_kb":4731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671021+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-22T01:10:50.671021+0000","last_peered":"2024-04-22T01:10:50.671021+0000","last_clean":"2024-04-22T01:10:50.671021+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-22T01:10:50.671021+0000","last_undegraded":"2024-04-22T01:10:50.671021+0000","last_fullsized":"2024-04-22T01:10:50.671021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:23.439754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21533,"num_write":374,"num_write_kb":54814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1080","reported_seq":1163,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:07:00.563875+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-22T01:07:00.563875+0000","last_peered":"2024-04-22T01:07:00.563875+0000","last_clean":"2024-04-22T01:07:00.563875+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-22T01:07:00.563875+0000","last_undegraded":"2024-04-22T01:07:00.563875+0000","last_fullsized":"2024-04-22T01:07:00.563875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":8663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'379","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.780461+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-22T01:10:50.780461+0000","last_peered":"2024-04-22T01:10:50.780461+0000","last_clean":"2024-04-22T01:10:50.780461+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-22T01:10:50.780461+0000","last_undegraded":"2024-04-22T01:10:50.780461+0000","last_fullsized":"2024-04-22T01:10:50.780461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7866,"num_write":347,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'361","reported_seq":444,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:03.128688+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-22T01:09:03.128688+0000","last_peered":"2024-04-22T01:09:03.128688+0000","last_clean":"2024-04-22T01:09:03.128688+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-22T01:09:03.128688+0000","last_undegraded":"2024-04-22T01:09:03.128688+0000","last_fullsized":"2024-04-22T01:09:03.128688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'447","reported_seq":580,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.458124+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-22T01:10:50.458124+0000","last_peered":"2024-04-22T01:10:50.458124+0000","last_clean":"2024-04-22T01:10:50.458124+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-22T01:10:50.458124+0000","last_undegraded":"2024-04-22T01:10:50.458124+0000","last_fullsized":"2024-04-22T01:10:50.458124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21571,"num_write":411,"num_write_kb":92495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'995","reported_seq":1078,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:50.447575+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-22T01:09:50.447575+0000","last_peered":"2024-04-22T01:09:50.447575+0000","last_clean":"2024-04-22T01:09:50.447575+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-22T01:09:50.447575+0000","last_undegraded":"2024-04-22T01:09:50.447575+0000","last_fullsized":"2024-04-22T01:09:50.447575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:56.447185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'396","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.475188+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-22T01:10:50.475188+0000","last_peered":"2024-04-22T01:10:50.475188+0000","last_clean":"2024-04-22T01:10:50.475188+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-22T01:10:50.475188+0000","last_undegraded":"2024-04-22T01:10:50.475188+0000","last_fullsized":"2024-04-22T01:10:50.475188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32877,"num_write":358,"num_write_kb":75502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'6444","reported_seq":6525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.883708+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-22T01:10:44.883708+0000","last_peered":"2024-04-22T01:10:44.883708+0000","last_clean":"2024-04-22T01:10:44.883708+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-22T01:10:44.883708+0000","last_undegraded":"2024-04-22T01:10:44.883708+0000","last_fullsized":"2024-04-22T01:10:44.883708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6444,"log_dups_size":0,"ondisk_log_size":6444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17429,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'369","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672077+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-22T01:10:50.672077+0000","last_peered":"2024-04-22T01:10:50.672077+0000","last_clean":"2024-04-22T01:10:50.672077+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-22T01:10:50.672077+0000","last_undegraded":"2024-04-22T01:10:50.672077+0000","last_fullsized":"2024-04-22T01:10:50.672077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39028,"num_write":349,"num_write_kb":80130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'453","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:10.451303+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-22T01:10:10.451303+0000","last_peered":"2024-04-22T01:10:10.451303+0000","last_clean":"2024-04-22T01:10:10.451303+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-22T01:10:10.451303+0000","last_undegraded":"2024-04-22T01:10:10.451303+0000","last_fullsized":"2024-04-22T01:10:10.451303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":607,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669157+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-22T01:10:50.669157+0000","last_peered":"2024-04-22T01:10:50.669157+0000","last_clean":"2024-04-22T01:10:50.669157+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-22T01:10:50.669157+0000","last_undegraded":"2024-04-22T01:10:50.669157+0000","last_fullsized":"2024-04-22T01:10:50.669157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43751,"num_write":424,"num_write_kb":64176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'391","reported_seq":472,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:53.166520+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-22T01:09:53.166520+0000","last_peered":"2024-04-22T01:09:53.166520+0000","last_clean":"2024-04-22T01:09:53.166520+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-22T01:09:53.166520+0000","last_undegraded":"2024-04-22T01:09:53.166520+0000","last_fullsized":"2024-04-22T01:09:53.166520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":559,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.590229+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-22T01:10:50.590229+0000","last_peered":"2024-04-22T01:10:50.590229+0000","last_clean":"2024-04-22T01:10:50.590229+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-22T01:10:50.590229+0000","last_undegraded":"2024-04-22T01:10:50.590229+0000","last_fullsized":"2024-04-22T01:10:50.590229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21201,"num_write":420,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'469","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.661579+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-22T01:08:57.661579+0000","last_peered":"2024-04-22T01:08:57.661579+0000","last_clean":"2024-04-22T01:08:57.661579+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-22T01:08:57.661579+0000","last_undegraded":"2024-04-22T01:08:57.661579+0000","last_fullsized":"2024-04-22T01:08:57.661579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'409","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672574+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-22T01:10:50.672574+0000","last_peered":"2024-04-22T01:10:50.672574+0000","last_clean":"2024-04-22T01:10:50.672574+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-22T01:10:50.672574+0000","last_undegraded":"2024-04-22T01:10:50.672574+0000","last_fullsized":"2024-04-22T01:10:50.672574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6132,"num_write":377,"num_write_kb":79520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1237","reported_seq":1318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:54.289194+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-22T01:08:54.289194+0000","last_peered":"2024-04-22T01:08:54.289194+0000","last_clean":"2024-04-22T01:08:54.289194+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-22T01:08:54.289194+0000","last_undegraded":"2024-04-22T01:08:54.289194+0000","last_fullsized":"2024-04-22T01:08:54.289194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.524423+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-22T01:10:50.524423+0000","last_peered":"2024-04-22T01:10:50.524423+0000","last_clean":"2024-04-22T01:10:50.524423+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-22T01:10:50.524423+0000","last_undegraded":"2024-04-22T01:10:50.524423+0000","last_fullsized":"2024-04-22T01:10:50.524423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16119,"num_write":379,"num_write_kb":38543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1279","reported_seq":1358,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:21.528970+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-22T01:09:21.528970+0000","last_peered":"2024-04-22T01:09:21.528970+0000","last_clean":"2024-04-22T01:09:21.528970+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-22T01:09:21.528970+0000","last_undegraded":"2024-04-22T01:09:21.528970+0000","last_fullsized":"2024-04-22T01:09:21.528970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":12886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'432","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.639233+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-22T01:10:50.639233+0000","last_peered":"2024-04-22T01:10:50.639233+0000","last_clean":"2024-04-22T01:10:50.639233+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-22T01:10:50.639233+0000","last_undegraded":"2024-04-22T01:10:50.639233+0000","last_fullsized":"2024-04-22T01:10:50.639233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:24:31.689158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23225,"num_write":401,"num_write_kb":108270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'409","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.623563+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-22T01:10:50.623563+0000","last_peered":"2024-04-22T01:10:50.623563+0000","last_clean":"2024-04-22T01:10:50.623563+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-22T01:10:50.623563+0000","last_undegraded":"2024-04-22T01:10:50.623563+0000","last_fullsized":"2024-04-22T01:10:50.623563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:05.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22627,"num_write":363,"num_write_kb":69341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'792","reported_seq":864,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:51.433653+0000","last_change":"2024-04-21T22:53:37.189530+0000","last_active":"2024-04-22T01:09:51.433653+0000","last_peered":"2024-04-22T01:09:51.433653+0000","last_clean":"2024-04-22T01:09:51.433653+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-22T01:09:51.433653+0000","last_undegraded":"2024-04-22T01:09:51.433653+0000","last_fullsized":"2024-04-22T01:09:51.433653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:16.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'375","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790069+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-22T01:10:50.790069+0000","last_peered":"2024-04-22T01:10:50.790069+0000","last_clean":"2024-04-22T01:10:50.790069+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-22T01:10:50.790069+0000","last_undegraded":"2024-04-22T01:10:50.790069+0000","last_fullsized":"2024-04-22T01:10:50.790069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17046,"num_write":339,"num_write_kb":42889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2007","reported_seq":2079,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:20.993085+0000","last_change":"2024-04-21T22:53:37.187992+0000","last_active":"2024-04-22T01:10:20.993085+0000","last_peered":"2024-04-22T01:10:20.993085+0000","last_clean":"2024-04-22T01:10:20.993085+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-22T01:10:20.993085+0000","last_undegraded":"2024-04-22T01:10:20.993085+0000","last_fullsized":"2024-04-22T01:10:20.993085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2007,"log_dups_size":0,"ondisk_log_size":2007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:24.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":17305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'380","reported_seq":520,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.670029+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-22T01:10:50.670029+0000","last_peered":"2024-04-22T01:10:50.670029+0000","last_clean":"2024-04-22T01:10:50.670029+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-22T01:10:50.670029+0000","last_undegraded":"2024-04-22T01:10:50.670029+0000","last_fullsized":"2024-04-22T01:10:50.670029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:59:51.600148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35342,"num_write":358,"num_write_kb":67635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'688","reported_seq":774,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:56.438374+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-22T01:08:56.438374+0000","last_peered":"2024-04-22T01:08:56.438374+0000","last_clean":"2024-04-22T01:08:56.438374+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-22T01:08:56.438374+0000","last_undegraded":"2024-04-22T01:08:56.438374+0000","last_fullsized":"2024-04-22T01:08:56.438374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:31:56.768493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'405","reported_seq":553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.667505+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-22T01:10:50.667505+0000","last_peered":"2024-04-22T01:10:50.667505+0000","last_clean":"2024-04-22T01:10:50.667505+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-22T01:10:50.667505+0000","last_undegraded":"2024-04-22T01:10:50.667505+0000","last_fullsized":"2024-04-22T01:10:50.667505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:49.627279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37645,"num_write":381,"num_write_kb":68489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'718","reported_seq":801,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:43.880788+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-22T01:09:43.880788+0000","last_peered":"2024-04-22T01:09:43.880788+0000","last_clean":"2024-04-22T01:09:43.880788+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-22T01:09:43.880788+0000","last_undegraded":"2024-04-22T01:09:43.880788+0000","last_fullsized":"2024-04-22T01:09:43.880788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":676,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":1454219,"num_write":24465,"num_write_kb":4289319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213130007,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":48352,"num_write_kb":232418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228024320,"data_stored":426260014,"data_compressed":52327842,"data_compressed_allocated":69902336,"data_compressed_original":268197888,"omap_allocated":0,"internal_metadata":0},"log_size":39153,"ondisk_log_size":39153,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62916,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424511100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71724,"kb_used_data":18340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":18780160,"data_stored":33648040,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511100,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151488,"kb_used_data":43960,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94220352,"statfs":{"total":96636764160,"available":96481640448,"internally_reserved":0,"allocated":45015040,"data_stored":88174574,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424511100,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84940,"kb_used_data":17668,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286900,"statfs":{"total":96636764160,"available":96549785600,"internally_reserved":0,"allocated":18092032,"data_stored":33648712,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424511101,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93264,"kb_used_data":25992,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278576,"statfs":{"total":96636764160,"available":96541261824,"internally_reserved":0,"allocated":26615808,"data_stored":48772550,"data_compressed":5793004,"data_compressed_allocated":7802880,"data_compressed_original":30134272,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424511100,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137712,"kb_used_data":30184,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94234128,"statfs":{"total":96636764160,"available":96495747072,"internally_reserved":0,"allocated":30908416,"data_stored":54620904,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511099,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148336,"kb_used_data":44968,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94223504,"statfs":{"total":96636764160,"available":96484868096,"internally_reserved":0,"allocated":46047232,"data_stored":81736600,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543805,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128480,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94243360,"statfs":{"total":96636764160,"available":96505200640,"internally_reserved":0,"allocated":17195008,"data_stored":35110341,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543804,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130280,"kb_used_data":26912,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94241560,"statfs":{"total":96636764160,"available":96503357440,"internally_reserved":0,"allocated":27557888,"data_stored":52477893,"data_compressed":6455074,"data_compressed_allocated":8462336,"data_compressed_original":33558528,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45789184,"data_stored":81642992,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26296320,"data_stored":48088574,"data_compressed":5761546,"data_compressed_allocated":7761920,"data_compressed_original":29560832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17833984,"data_stored":33555104,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44756992,"data_stored":88080966,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30650368,"data_stored":54527296,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":51793917,"data_compressed":6423616,"data_compressed_allocated":8421376,"data_compressed_original":32985088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18522112,"data_stored":33554432,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16936960,"data_stored":35016733,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T01:10:57.203 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T01:10:57.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.364+0000 7f577464f640 1 Processor -- start 2024-04-22T01:10:57.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.364+0000 7f577464f640 1 -- start start 2024-04-22T01:10:57.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.368+0000 7f577464f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f576c154980 0x7f576c0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:57.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.368+0000 7f577464f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f576c0c8410 con 0x7f576c0c9cb0 2024-04-22T01:10:57.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.368+0000 7f577464f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f576c072d30 con 0x7f576c0c98d0 2024-04-22T01:10:57.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.368+0000 7f577464f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f576c0c81e0 con 0x7f576c154980 2024-04-22T01:10:57.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.372+0000 7f57723eb640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f576c0c98d0 0x7f576c154270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:60654/0 (socket says 172.21.15.110:60654) 2024-04-22T01:10:57.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.372+0000 7f57723eb640 1 -- 172.21.15.110:0/2868985798 learned_addr learned my addr 172.21.15.110:0/2868985798 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:57.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.372+0000 7f5771bea640 1 --2- 172.21.15.110:0/2868985798 >> v2:172.21.15.154:3300/0 conn(0x7f576c154980 0x7f576c0c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:57.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.380+0000 7f5771bea640 1 -- 172.21.15.110:0/2868985798 >> v1:172.21.15.154:6789/0 conn(0x7f576c0c98d0 legacy=0x7f576c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:57.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.380+0000 7f5771bea640 1 -- 172.21.15.110:0/2868985798 >> v1:172.21.15.110:6789/0 conn(0x7f576c0c9cb0 legacy=0x7f576c15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:57.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.380+0000 7f5771bea640 1 -- 172.21.15.110:0/2868985798 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c073010 con 0x7f576c154980 2024-04-22T01:10:57.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.408+0000 7f5771bea640 1 --2- 172.21.15.110:0/2868985798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c154980 0x7f576c0c1bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57680097c0 tx=0x7f576801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b764b50d8be9303 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.516+0000 7f57713e9640 1 -- 172.21.15.110:0/2868985798 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680b5070 con 0x7f576c154980 2024-04-22T01:10:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.516+0000 7f57713e9640 1 -- 172.21.15.110:0/2868985798 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57680a8950 con 0x7f576c154980 2024-04-22T01:10:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.516+0000 7f57713e9640 1 -- 172.21.15.110:0/2868985798 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680a8d20 con 0x7f576c154980 2024-04-22T01:10:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- 172.21.15.110:0/2868985798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c154980 msgr2=0x7f576c0c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 --2- 172.21.15.110:0/2868985798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c154980 0x7f576c0c1bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57680097c0 tx=0x7f576801ec50 comp rx=0 tx=0).stop 2024-04-22T01:10:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- 172.21.15.110:0/2868985798 shutdown_connections 2024-04-22T01:10:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 --2- 172.21.15.110:0/2868985798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c154980 0x7f576c0c1bb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- 172.21.15.110:0/2868985798 >> 172.21.15.110:0/2868985798 conn(0x7f576c06ca80 msgr2=0x7f576c070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- 172.21.15.110:0/2868985798 shutdown_connections 2024-04-22T01:10:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- 172.21.15.110:0/2868985798 wait complete. 2024-04-22T01:10:57.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 Processor -- start 2024-04-22T01:10:57.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- start start 2024-04-22T01:10:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f576c0c98d0 0x7f576c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c0c9cb0 0x7f576c1f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c154980 0x7f576c153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f576c072ae0 con 0x7f576c0c98d0 2024-04-22T01:10:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.520+0000 7f577464f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f576c073620 con 0x7f576c0c9cb0 2024-04-22T01:10:57.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.524+0000 7f577464f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f576c0737a0 con 0x7f576c154980 2024-04-22T01:10:57.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.524+0000 7f57723eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f576c0c98d0 0x7f576c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:57.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.524+0000 7f57723eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f576c0c98d0 0x7f576c0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56190/0 (socket says 172.21.15.110:56190) 2024-04-22T01:10:57.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.524+0000 7f57723eb640 1 -- 172.21.15.110:0/4111933312 learned_addr learned my addr 172.21.15.110:0/4111933312 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:57.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.524+0000 7f5771bea640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c0c9cb0 0x7f576c1f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:57.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.524+0000 7f5772bec640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c154980 0x7f576c153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.528+0000 7f5771bea640 1 -- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c154980 msgr2=0x7f576c153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.528+0000 7f5771bea640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c154980 0x7f576c153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.528+0000 7f5771bea640 1 -- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f576c0c98d0 msgr2=0x7f576c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.528+0000 7f5771bea640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f576c0c98d0 0x7f576c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:57.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.528+0000 7f5771bea640 1 -- 172.21.15.110:0/4111933312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c158990 con 0x7f576c0c9cb0 2024-04-22T01:10:57.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.532+0000 7f5771bea640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c0c9cb0 0x7f576c1f0190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f57680af000 tx=0x7f576801b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:57.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.540+0000 7f575effd640 1 -- 172.21.15.110:0/4111933312 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680b5040 con 0x7f576c0c9cb0 2024-04-22T01:10:57.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.540+0000 7f575effd640 1 -- 172.21.15.110:0/4111933312 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57680c0070 con 0x7f576c0c9cb0 2024-04-22T01:10:57.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.540+0000 7f575effd640 1 -- 172.21.15.110:0/4111933312 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680b0bd0 con 0x7f576c0c9cb0 2024-04-22T01:10:57.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.540+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576c1f4560 con 0x7f576c0c9cb0 2024-04-22T01:10:57.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.540+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576c1f37a0 con 0x7f576c0c9cb0 2024-04-22T01:10:57.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.540+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576c04f510 con 0x7f576c0c9cb0 2024-04-22T01:10:57.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.860+0000 7f575effd640 1 -- 172.21.15.110:0/4111933312 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57680b8070 con 0x7f576c0c9cb0 2024-04-22T01:10:57.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.864+0000 7f575effd640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5750067940 0x7f5750069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:57.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.864+0000 7f57723eb640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5750067940 0x7f5750069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:57.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.864+0000 7f57723eb640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5750067940 0x7f5750069e00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5760007fd0 tx=0x7f5760007f20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:57.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.868+0000 7f575effd640 1 -- 172.21.15.110:0/4111933312 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f57680a8900 con 0x7f576c0c9cb0 2024-04-22T01:10:57.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:57.896+0000 7f575effd640 1 -- 172.21.15.110:0/4111933312 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f576c158990 con 0x7f576c0c9cb0 2024-04-22T01:10:58.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.072+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f576c0cc900 con 0x7f5750067940 2024-04-22T01:10:58.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.088+0000 7f575effd640 1 -- 172.21.15.110:0/4111933312 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254398 (secure 0 0 0) 0x7f576c0cc900 con 0x7f5750067940 2024-04-22T01:10:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:10:58.094 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5750067940 msgr2=0x7f5750069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5750067940 0x7f5750069e00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5760007fd0 tx=0x7f5760007f20 comp rx=0 tx=0).stop 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c0c9cb0 msgr2=0x7f576c1f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c0c9cb0 0x7f576c1f0190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f57680af000 tx=0x7f576801b9f0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 shutdown_connections 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5750067940 0x7f5750069e00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c154980 0x7f576c153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c0c9cb0 0x7f576c1f0190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 --2- 172.21.15.110:0/4111933312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f576c0c98d0 0x7f576c0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 >> 172.21.15.110:0/4111933312 conn(0x7f576c06ca80 msgr2=0x7f576c15a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 shutdown_connections 2024-04-22T01:10:58.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.092+0000 7f577464f640 1 -- 172.21.15.110:0/4111933312 wait complete. 2024-04-22T01:10:58.113 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":4161,"stamp":"2024-04-22T01:10:56.499034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213720375,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":7236,"num_read_kb":1459077,"num_write":73026,"num_write_kb":4525199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65691,"ondisk_log_size":65691,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":946224,"kb_used_data":224816,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":754028496,"statfs":{"total":773094113280,"available":772125179904,"internally_reserved":0,"allocated":230211584,"data_stored":428189614,"data_compressed":52390758,"data_compressed_allocated":69984256,"data_compressed_original":269344768,"omap_allocated":12749,"internal_metadata":738643507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21265,"num_objects":-7,"num_object_clones":0,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":45,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004022"},"pg_stats":[{"pgid":"3.3f","version":"25'426","reported_seq":560,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.784372+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-22T01:10:50.784372+0000","last_peered":"2024-04-22T01:10:50.784372+0000","last_clean":"2024-04-22T01:10:50.784372+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-22T01:10:50.784372+0000","last_undegraded":"2024-04-22T01:10:50.784372+0000","last_fullsized":"2024-04-22T01:10:50.784372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28398,"num_write":395,"num_write_kb":75936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'442","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.636503+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-22T01:10:50.636503+0000","last_peered":"2024-04-22T01:10:50.636503+0000","last_clean":"2024-04-22T01:10:50.636503+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-22T01:10:50.636503+0000","last_undegraded":"2024-04-22T01:10:50.636503+0000","last_fullsized":"2024-04-22T01:10:50.636503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:25:19.748728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20820,"num_write":419,"num_write_kb":84104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'391","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672759+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-22T01:10:50.672759+0000","last_peered":"2024-04-22T01:10:50.672759+0000","last_clean":"2024-04-22T01:10:50.672759+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-22T01:10:50.672759+0000","last_undegraded":"2024-04-22T01:10:50.672759+0000","last_fullsized":"2024-04-22T01:10:50.672759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:27:16.978980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18719,"num_write":364,"num_write_kb":70997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'353","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.463402+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-22T01:10:50.463402+0000","last_peered":"2024-04-22T01:10:50.463402+0000","last_clean":"2024-04-22T01:10:50.463402+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-22T01:10:50.463402+0000","last_undegraded":"2024-04-22T01:10:50.463402+0000","last_fullsized":"2024-04-22T01:10:50.463402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":316,"num_write_kb":12972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'420","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787858+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-22T01:10:50.787858+0000","last_peered":"2024-04-22T01:10:50.787858+0000","last_clean":"2024-04-22T01:10:50.787858+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-22T01:10:50.787858+0000","last_undegraded":"2024-04-22T01:10:50.787858+0000","last_fullsized":"2024-04-22T01:10:50.787858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:26:22.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":394,"num_write_kb":67878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'395","reported_seq":498,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.462469+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-22T01:10:50.462469+0000","last_peered":"2024-04-22T01:10:50.462469+0000","last_clean":"2024-04-22T01:10:50.462469+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-22T01:10:50.462469+0000","last_undegraded":"2024-04-22T01:10:50.462469+0000","last_fullsized":"2024-04-22T01:10:50.462469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17967,"num_write":373,"num_write_kb":71499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787989+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-22T01:10:50.787989+0000","last_peered":"2024-04-22T01:10:50.787989+0000","last_clean":"2024-04-22T01:10:50.787989+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-22T01:10:50.787989+0000","last_undegraded":"2024-04-22T01:10:50.787989+0000","last_fullsized":"2024-04-22T01:10:50.787989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13670,"num_write":376,"num_write_kb":39263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'387","reported_seq":533,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671825+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-22T01:10:50.671825+0000","last_peered":"2024-04-22T01:10:50.671825+0000","last_clean":"2024-04-22T01:10:50.671825+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-22T01:10:50.671825+0000","last_undegraded":"2024-04-22T01:10:50.671825+0000","last_fullsized":"2024-04-22T01:10:50.671825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:40:03.621192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":42822,"num_write":351,"num_write_kb":100036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'424","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.793849+0000","last_change":"2024-04-21T22:53:38.576571+0000","last_active":"2024-04-22T01:10:50.793849+0000","last_peered":"2024-04-22T01:10:50.793849+0000","last_clean":"2024-04-22T01:10:50.793849+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-22T01:10:50.793849+0000","last_undegraded":"2024-04-22T01:10:50.793849+0000","last_fullsized":"2024-04-22T01:10:50.793849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20454,"num_write":396,"num_write_kb":59842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787702+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-22T01:10:50.787702+0000","last_peered":"2024-04-22T01:10:50.787702+0000","last_clean":"2024-04-22T01:10:50.787702+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-22T01:10:50.787702+0000","last_undegraded":"2024-04-22T01:10:50.787702+0000","last_fullsized":"2024-04-22T01:10:50.787702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:26.176484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5548,"num_write":382,"num_write_kb":76042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'383","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.788888+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-22T01:10:50.788888+0000","last_peered":"2024-04-22T01:10:50.788888+0000","last_clean":"2024-04-22T01:10:50.788888+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-22T01:10:50.788888+0000","last_undegraded":"2024-04-22T01:10:50.788888+0000","last_fullsized":"2024-04-22T01:10:50.788888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12739,"num_write":368,"num_write_kb":54575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'362","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.792220+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-22T01:10:50.792220+0000","last_peered":"2024-04-22T01:10:50.792220+0000","last_clean":"2024-04-22T01:10:50.792220+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-22T01:10:50.792220+0000","last_undegraded":"2024-04-22T01:10:50.792220+0000","last_fullsized":"2024-04-22T01:10:50.792220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:51:01.311466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9062,"num_write":334,"num_write_kb":50352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'384","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.511489+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-22T01:10:50.511489+0000","last_peered":"2024-04-22T01:10:50.511489+0000","last_clean":"2024-04-22T01:10:50.511489+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-22T01:10:50.511489+0000","last_undegraded":"2024-04-22T01:10:50.511489+0000","last_fullsized":"2024-04-22T01:10:50.511489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12819,"num_write":349,"num_write_kb":62920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'430","reported_seq":537,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.506564+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-22T01:10:50.506564+0000","last_peered":"2024-04-22T01:10:50.506564+0000","last_clean":"2024-04-22T01:10:50.506564+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-22T01:10:50.506564+0000","last_undegraded":"2024-04-22T01:10:50.506564+0000","last_fullsized":"2024-04-22T01:10:50.506564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21265,"num_write":396,"num_write_kb":88387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'436","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669670+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-22T01:10:50.669670+0000","last_peered":"2024-04-22T01:10:50.669670+0000","last_clean":"2024-04-22T01:10:50.669670+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-22T01:10:50.669670+0000","last_undegraded":"2024-04-22T01:10:50.669670+0000","last_fullsized":"2024-04-22T01:10:50.669670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:52:43.706899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21940,"num_write":398,"num_write_kb":112507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'433","reported_seq":557,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.618971+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-22T01:10:50.618971+0000","last_peered":"2024-04-22T01:10:50.618971+0000","last_clean":"2024-04-22T01:10:50.618971+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-22T01:10:50.618971+0000","last_undegraded":"2024-04-22T01:10:50.618971+0000","last_fullsized":"2024-04-22T01:10:50.618971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26769,"num_write":400,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'401","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.621571+0000","last_change":"2024-04-21T22:54:44.971067+0000","last_active":"2024-04-22T01:10:50.621571+0000","last_peered":"2024-04-22T01:10:50.621571+0000","last_clean":"2024-04-22T01:10:50.621571+0000","last_became_active":"2024-04-21T22:54:44.970288+0000","last_became_peered":"2024-04-21T22:54:44.970288+0000","last_unstale":"2024-04-22T01:10:50.621571+0000","last_undegraded":"2024-04-22T01:10:50.621571+0000","last_fullsized":"2024-04-22T01:10:50.621571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:37:41.657624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17556,"num_write":374,"num_write_kb":67589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'395","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.523427+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-22T01:10:50.523427+0000","last_peered":"2024-04-22T01:10:50.523427+0000","last_clean":"2024-04-22T01:10:50.523427+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-22T01:10:50.523427+0000","last_undegraded":"2024-04-22T01:10:50.523427+0000","last_fullsized":"2024-04-22T01:10:50.523427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22256,"num_write":365,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'432","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.610401+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-22T01:10:50.610401+0000","last_peered":"2024-04-22T01:10:50.610401+0000","last_clean":"2024-04-22T01:10:50.610401+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-22T01:10:50.610401+0000","last_undegraded":"2024-04-22T01:10:50.610401+0000","last_fullsized":"2024-04-22T01:10:50.610401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:37:06.081826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39722,"num_write":402,"num_write_kb":89327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.792125+0000","last_change":"2024-04-21T22:53:38.610862+0000","last_active":"2024-04-22T01:10:50.792125+0000","last_peered":"2024-04-22T01:10:50.792125+0000","last_clean":"2024-04-22T01:10:50.792125+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-22T01:10:50.792125+0000","last_undegraded":"2024-04-22T01:10:50.792125+0000","last_fullsized":"2024-04-22T01:10:50.792125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:51.748240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4220,"num_write":403,"num_write_kb":46421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'421","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675472+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-22T01:10:50.675472+0000","last_peered":"2024-04-22T01:10:50.675472+0000","last_clean":"2024-04-22T01:10:50.675472+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-22T01:10:50.675472+0000","last_undegraded":"2024-04-22T01:10:50.675472+0000","last_fullsized":"2024-04-22T01:10:50.675472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":8093,"num_write":400,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'410","reported_seq":535,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.791677+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-22T01:10:50.791677+0000","last_peered":"2024-04-22T01:10:50.791677+0000","last_clean":"2024-04-22T01:10:50.791677+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-22T01:10:50.791677+0000","last_undegraded":"2024-04-22T01:10:50.791677+0000","last_fullsized":"2024-04-22T01:10:50.791677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28547,"num_write":383,"num_write_kb":51065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'415","reported_seq":552,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.670125+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-22T01:10:50.670125+0000","last_peered":"2024-04-22T01:10:50.670125+0000","last_clean":"2024-04-22T01:10:50.670125+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-22T01:10:50.670125+0000","last_undegraded":"2024-04-22T01:10:50.670125+0000","last_fullsized":"2024-04-22T01:10:50.670125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:47:54.239652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":35420,"num_write":386,"num_write_kb":88354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'418","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.648468+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-22T01:10:50.648468+0000","last_peered":"2024-04-22T01:10:50.648468+0000","last_clean":"2024-04-22T01:10:50.648468+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-22T01:10:50.648468+0000","last_undegraded":"2024-04-22T01:10:50.648468+0000","last_fullsized":"2024-04-22T01:10:50.648468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6808,"num_write":388,"num_write_kb":34297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'391","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669224+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-22T01:10:50.669224+0000","last_peered":"2024-04-22T01:10:50.669224+0000","last_clean":"2024-04-22T01:10:50.669224+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-22T01:10:50.669224+0000","last_undegraded":"2024-04-22T01:10:50.669224+0000","last_fullsized":"2024-04-22T01:10:50.669224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:25:42.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4176,"num_write":374,"num_write_kb":46218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'491","reported_seq":621,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.486307+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-22T01:10:50.486307+0000","last_peered":"2024-04-22T01:10:50.486307+0000","last_clean":"2024-04-22T01:10:50.486307+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-22T01:10:50.486307+0000","last_undegraded":"2024-04-22T01:10:50.486307+0000","last_fullsized":"2024-04-22T01:10:50.486307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29218,"num_write":445,"num_write_kb":101143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'436","reported_seq":576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.476674+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-22T01:10:50.476674+0000","last_peered":"2024-04-22T01:10:50.476674+0000","last_clean":"2024-04-22T01:10:50.476674+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-22T01:10:50.476674+0000","last_undegraded":"2024-04-22T01:10:50.476674+0000","last_fullsized":"2024-04-22T01:10:50.476674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29285,"num_write":407,"num_write_kb":84259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'386","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.510987+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-22T01:10:50.510987+0000","last_peered":"2024-04-22T01:10:50.510987+0000","last_clean":"2024-04-22T01:10:50.510987+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-22T01:10:50.510987+0000","last_undegraded":"2024-04-22T01:10:50.510987+0000","last_fullsized":"2024-04-22T01:10:50.510987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28108,"num_write":361,"num_write_kb":80021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'403","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669252+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-22T01:10:50.669252+0000","last_peered":"2024-04-22T01:10:50.669252+0000","last_clean":"2024-04-22T01:10:50.669252+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-22T01:10:50.669252+0000","last_undegraded":"2024-04-22T01:10:50.669252+0000","last_fullsized":"2024-04-22T01:10:50.669252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:43:35.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31845,"num_write":369,"num_write_kb":46987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'465","reported_seq":604,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.597026+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-22T01:10:50.597026+0000","last_peered":"2024-04-22T01:10:50.597026+0000","last_clean":"2024-04-22T01:10:50.597026+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-22T01:10:50.597026+0000","last_undegraded":"2024-04-22T01:10:50.597026+0000","last_fullsized":"2024-04-22T01:10:50.597026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":45092,"num_write":433,"num_write_kb":99910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'465","reported_seq":619,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.515836+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-22T01:10:50.515836+0000","last_peered":"2024-04-22T01:10:50.515836+0000","last_clean":"2024-04-22T01:10:50.515836+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-22T01:10:50.515836+0000","last_undegraded":"2024-04-22T01:10:50.515836+0000","last_fullsized":"2024-04-22T01:10:50.515836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44084,"num_write":435,"num_write_kb":97059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'430","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.466232+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-22T01:10:50.466232+0000","last_peered":"2024-04-22T01:10:50.466232+0000","last_clean":"2024-04-22T01:10:50.466232+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-22T01:10:50.466232+0000","last_undegraded":"2024-04-22T01:10:50.466232+0000","last_fullsized":"2024-04-22T01:10:50.466232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14125,"num_write":397,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.789963+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-22T01:10:50.789963+0000","last_peered":"2024-04-22T01:10:50.789963+0000","last_clean":"2024-04-22T01:10:50.789963+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-22T01:10:50.789963+0000","last_undegraded":"2024-04-22T01:10:50.789963+0000","last_fullsized":"2024-04-22T01:10:50.789963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31266,"num_write":385,"num_write_kb":75657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'363","reported_seq":435,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:38.124898+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-22T01:08:38.124898+0000","last_peered":"2024-04-22T01:08:38.124898+0000","last_clean":"2024-04-22T01:08:38.124898+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-22T01:08:38.124898+0000","last_undegraded":"2024-04-22T01:08:38.124898+0000","last_fullsized":"2024-04-22T01:08:38.124898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'372","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675292+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-22T01:10:50.675292+0000","last_peered":"2024-04-22T01:10:50.675292+0000","last_clean":"2024-04-22T01:10:50.675292+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-22T01:10:50.675292+0000","last_undegraded":"2024-04-22T01:10:50.675292+0000","last_fullsized":"2024-04-22T01:10:50.675292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19141,"num_write":353,"num_write_kb":42712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'2175","reported_seq":2247,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:40.436426+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-22T01:08:40.436426+0000","last_peered":"2024-04-22T01:08:40.436426+0000","last_clean":"2024-04-22T01:08:40.436426+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-22T01:08:40.436426+0000","last_undegraded":"2024-04-22T01:08:40.436426+0000","last_fullsized":"2024-04-22T01:08:40.436426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2175,"log_dups_size":0,"ondisk_log_size":2175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:31.566421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2118,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'778","reported_seq":852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:45.527664+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-22T01:09:45.527664+0000","last_peered":"2024-04-22T01:09:45.527664+0000","last_clean":"2024-04-22T01:09:45.527664+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-22T01:09:45.527664+0000","last_undegraded":"2024-04-22T01:09:45.527664+0000","last_fullsized":"2024-04-22T01:09:45.527664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'427","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671412+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-22T01:10:50.671412+0000","last_peered":"2024-04-22T01:10:50.671412+0000","last_clean":"2024-04-22T01:10:50.671412+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-22T01:10:50.671412+0000","last_undegraded":"2024-04-22T01:10:50.671412+0000","last_fullsized":"2024-04-22T01:10:50.671412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:38:02.541775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27111,"num_write":394,"num_write_kb":58934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1416","reported_seq":1490,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:00.439752+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-22T01:09:00.439752+0000","last_peered":"2024-04-22T01:09:00.439752+0000","last_clean":"2024-04-22T01:09:00.439752+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-22T01:09:00.439752+0000","last_undegraded":"2024-04-22T01:09:00.439752+0000","last_fullsized":"2024-04-22T01:09:00.439752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":12962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'395","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.674564+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-22T01:10:50.674564+0000","last_peered":"2024-04-22T01:10:50.674564+0000","last_clean":"2024-04-22T01:10:50.674564+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-22T01:10:50.674564+0000","last_undegraded":"2024-04-22T01:10:50.674564+0000","last_fullsized":"2024-04-22T01:10:50.674564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":217,"num_write":366,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'56","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:00.407654+0000","last_change":"2024-04-21T22:53:37.185089+0000","last_active":"2024-04-22T01:09:00.407654+0000","last_peered":"2024-04-22T01:09:00.407654+0000","last_clean":"2024-04-22T01:09:00.407654+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-22T01:09:00.407654+0000","last_undegraded":"2024-04-22T01:09:00.407654+0000","last_fullsized":"2024-04-22T01:09:00.407654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'451","reported_seq":580,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.488185+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-22T01:10:50.488185+0000","last_peered":"2024-04-22T01:10:50.488185+0000","last_clean":"2024-04-22T01:10:50.488185+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-22T01:10:50.488185+0000","last_undegraded":"2024-04-22T01:10:50.488185+0000","last_fullsized":"2024-04-22T01:10:50.488185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:09.983320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27728,"num_write":424,"num_write_kb":88654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1252","reported_seq":1326,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.170034+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-22T01:10:50.170034+0000","last_peered":"2024-04-22T01:10:50.170034+0000","last_clean":"2024-04-22T01:10:50.170034+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-22T01:10:50.170034+0000","last_undegraded":"2024-04-22T01:10:50.170034+0000","last_fullsized":"2024-04-22T01:10:50.170034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10339768,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":10694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'398","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669454+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-22T01:10:50.669454+0000","last_peered":"2024-04-22T01:10:50.669454+0000","last_clean":"2024-04-22T01:10:50.669454+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-22T01:10:50.669454+0000","last_undegraded":"2024-04-22T01:10:50.669454+0000","last_fullsized":"2024-04-22T01:10:50.669454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:13.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27611,"num_write":368,"num_write_kb":80241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'3971","reported_seq":4045,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.475044+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-22T01:10:44.475044+0000","last_peered":"2024-04-22T01:10:44.475044+0000","last_clean":"2024-04-22T01:10:44.475044+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-22T01:10:44.475044+0000","last_undegraded":"2024-04-22T01:10:44.475044+0000","last_fullsized":"2024-04-22T01:10:44.475044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3971,"log_dups_size":0,"ondisk_log_size":3971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'395","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.643246+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-22T01:10:50.643246+0000","last_peered":"2024-04-22T01:10:50.643246+0000","last_clean":"2024-04-22T01:10:50.643246+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-22T01:10:50.643246+0000","last_undegraded":"2024-04-22T01:10:50.643246+0000","last_fullsized":"2024-04-22T01:10:50.643246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:50.140041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17003,"num_write":357,"num_write_kb":47379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2295","reported_seq":2371,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:33.710526+0000","last_change":"2024-04-21T22:53:37.134021+0000","last_active":"2024-04-22T01:10:33.710526+0000","last_peered":"2024-04-22T01:10:33.710526+0000","last_clean":"2024-04-22T01:10:33.710526+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-22T01:10:33.710526+0000","last_undegraded":"2024-04-22T01:10:33.710526+0000","last_fullsized":"2024-04-22T01:10:33.710526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:57.000042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2254,"num_write_kb":13663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'414","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.785058+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-22T01:10:50.785058+0000","last_peered":"2024-04-22T01:10:50.785058+0000","last_clean":"2024-04-22T01:10:50.785058+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-22T01:10:50.785058+0000","last_undegraded":"2024-04-22T01:10:50.785058+0000","last_fullsized":"2024-04-22T01:10:50.785058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26385,"num_write":381,"num_write_kb":92626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'720","reported_seq":796,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.927568+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-22T01:08:57.927568+0000","last_peered":"2024-04-22T01:08:57.927568+0000","last_clean":"2024-04-22T01:08:57.927568+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-22T01:08:57.927568+0000","last_undegraded":"2024-04-22T01:08:57.927568+0000","last_fullsized":"2024-04-22T01:08:57.927568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'386","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.479154+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-22T01:10:50.479154+0000","last_peered":"2024-04-22T01:10:50.479154+0000","last_clean":"2024-04-22T01:10:50.479154+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-22T01:10:50.479154+0000","last_undegraded":"2024-04-22T01:10:50.479154+0000","last_fullsized":"2024-04-22T01:10:50.479154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5166,"num_write":360,"num_write_kb":42321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'60","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:42.567375+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-22T01:10:42.567375+0000","last_peered":"2024-04-22T01:10:42.567375+0000","last_clean":"2024-04-22T01:10:42.567375+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-22T01:10:42.567375+0000","last_undegraded":"2024-04-22T01:10:42.567375+0000","last_fullsized":"2024-04-22T01:10:42.567375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:52.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'397","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.638638+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-22T01:10:50.638638+0000","last_peered":"2024-04-22T01:10:50.638638+0000","last_clean":"2024-04-22T01:10:50.638638+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-22T01:10:50.638638+0000","last_undegraded":"2024-04-22T01:10:50.638638+0000","last_fullsized":"2024-04-22T01:10:50.638638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:27.631111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27517,"num_write":361,"num_write_kb":56016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'51","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:01.350404+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-22T01:08:01.350404+0000","last_peered":"2024-04-22T01:08:01.350404+0000","last_clean":"2024-04-22T01:08:01.350404+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-22T01:08:01.350404+0000","last_undegraded":"2024-04-22T01:08:01.350404+0000","last_fullsized":"2024-04-22T01:08:01.350404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'460","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.776781+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-22T01:10:50.776781+0000","last_peered":"2024-04-22T01:10:50.776781+0000","last_clean":"2024-04-22T01:10:50.776781+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-22T01:10:50.776781+0000","last_undegraded":"2024-04-22T01:10:50.776781+0000","last_fullsized":"2024-04-22T01:10:50.776781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":20178,"num_write":438,"num_write_kb":96694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'919","reported_seq":995,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:40.532907+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-22T01:10:40.532907+0000","last_peered":"2024-04-22T01:10:40.532907+0000","last_clean":"2024-04-22T01:10:40.532907+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-22T01:10:40.532907+0000","last_undegraded":"2024-04-22T01:10:40.532907+0000","last_fullsized":"2024-04-22T01:10:40.532907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'481","reported_seq":612,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.607613+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-22T01:10:50.607613+0000","last_peered":"2024-04-22T01:10:50.607613+0000","last_clean":"2024-04-22T01:10:50.607613+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-22T01:10:50.607613+0000","last_undegraded":"2024-04-22T01:10:50.607613+0000","last_fullsized":"2024-04-22T01:10:50.607613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33204,"num_write":448,"num_write_kb":124685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'818","reported_seq":896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:05.182561+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-22T01:10:05.182561+0000","last_peered":"2024-04-22T01:10:05.182561+0000","last_clean":"2024-04-22T01:10:05.182561+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-22T01:10:05.182561+0000","last_undegraded":"2024-04-22T01:10:05.182561+0000","last_fullsized":"2024-04-22T01:10:05.182561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'350","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.488114+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-22T01:10:50.488114+0000","last_peered":"2024-04-22T01:10:50.488114+0000","last_clean":"2024-04-22T01:10:50.488114+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-22T01:10:50.488114+0000","last_undegraded":"2024-04-22T01:10:50.488114+0000","last_fullsized":"2024-04-22T01:10:50.488114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12827,"num_write":324,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'820","reported_seq":899,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:39.664467+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-22T01:08:39.664467+0000","last_peered":"2024-04-22T01:08:39.664467+0000","last_clean":"2024-04-22T01:08:39.664467+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-22T01:08:39.664467+0000","last_undegraded":"2024-04-22T01:08:39.664467+0000","last_fullsized":"2024-04-22T01:08:39.664467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'428","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790681+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-22T01:10:50.790681+0000","last_peered":"2024-04-22T01:10:50.790681+0000","last_clean":"2024-04-22T01:10:50.790681+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-22T01:10:50.790681+0000","last_undegraded":"2024-04-22T01:10:50.790681+0000","last_fullsized":"2024-04-22T01:10:50.790681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36323,"num_write":394,"num_write_kb":104531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'352","reported_seq":431,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:58.737044+0000","last_change":"2024-04-21T22:53:37.253316+0000","last_active":"2024-04-22T01:08:58.737044+0000","last_peered":"2024-04-22T01:08:58.737044+0000","last_clean":"2024-04-22T01:08:58.737044+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-22T01:08:58.737044+0000","last_undegraded":"2024-04-22T01:08:58.737044+0000","last_fullsized":"2024-04-22T01:08:58.737044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:45:21.383363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'429","reported_seq":547,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.789412+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-22T01:10:50.789412+0000","last_peered":"2024-04-22T01:10:50.789412+0000","last_clean":"2024-04-22T01:10:50.789412+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-22T01:10:50.789412+0000","last_undegraded":"2024-04-22T01:10:50.789412+0000","last_fullsized":"2024-04-22T01:10:50.789412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22478,"num_write":396,"num_write_kb":50602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'340","reported_seq":419,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:30.741959+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-22T01:10:30.741959+0000","last_peered":"2024-04-22T01:10:30.741959+0000","last_clean":"2024-04-22T01:10:30.741959+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-22T01:10:30.741959+0000","last_undegraded":"2024-04-22T01:10:30.741959+0000","last_fullsized":"2024-04-22T01:10:30.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'412","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.640083+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-22T01:10:50.640083+0000","last_peered":"2024-04-22T01:10:50.640083+0000","last_clean":"2024-04-22T01:10:50.640083+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-22T01:10:50.640083+0000","last_undegraded":"2024-04-22T01:10:50.640083+0000","last_fullsized":"2024-04-22T01:10:50.640083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:03.405030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12764,"num_write":388,"num_write_kb":59120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'161","reported_seq":296,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:07:35.524302+0000","last_change":"2024-04-21T22:52:58.454152+0000","last_active":"2024-04-22T01:07:35.524302+0000","last_peered":"2024-04-22T01:07:35.524302+0000","last_clean":"2024-04-22T01:07:35.524302+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-22T01:07:35.524302+0000","last_undegraded":"2024-04-22T01:07:35.524302+0000","last_fullsized":"2024-04-22T01:07:35.524302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_clean_scrub_stamp":"2024-04-21T22:52:55.145387+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:11:10.808812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'373","reported_seq":456,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:21.928762+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-22T01:10:21.928762+0000","last_peered":"2024-04-22T01:10:21.928762+0000","last_clean":"2024-04-22T01:10:21.928762+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-22T01:10:21.928762+0000","last_undegraded":"2024-04-22T01:10:21.928762+0000","last_fullsized":"2024-04-22T01:10:21.928762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:29.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'363","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672534+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-22T01:10:50.672534+0000","last_peered":"2024-04-22T01:10:50.672534+0000","last_clean":"2024-04-22T01:10:50.672534+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-22T01:10:50.672534+0000","last_undegraded":"2024-04-22T01:10:50.672534+0000","last_fullsized":"2024-04-22T01:10:50.672534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26229,"num_write":331,"num_write_kb":46345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'1075","reported_seq":1161,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:05.048176+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-22T01:10:05.048176+0000","last_peered":"2024-04-22T01:10:05.048176+0000","last_clean":"2024-04-22T01:10:05.048176+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-22T01:10:05.048176+0000","last_undegraded":"2024-04-22T01:10:05.048176+0000","last_fullsized":"2024-04-22T01:10:05.048176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'414","reported_seq":606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.504820+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-22T01:10:50.504820+0000","last_peered":"2024-04-22T01:10:50.504820+0000","last_clean":"2024-04-22T01:10:50.504820+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-22T01:10:50.504820+0000","last_undegraded":"2024-04-22T01:10:50.504820+0000","last_fullsized":"2024-04-22T01:10:50.504820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":57177,"num_write":383,"num_write_kb":104760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'4405","reported_seq":8837,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:45.464245+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-22T01:10:45.464245+0000","last_peered":"2024-04-22T01:10:45.464245+0000","last_clean":"2024-04-22T01:10:45.464245+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-22T01:10:45.464245+0000","last_undegraded":"2024-04-22T01:10:45.464245+0000","last_fullsized":"2024-04-22T01:10:45.464245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":4349,"num_write_kb":4731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671021+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-22T01:10:50.671021+0000","last_peered":"2024-04-22T01:10:50.671021+0000","last_clean":"2024-04-22T01:10:50.671021+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-22T01:10:50.671021+0000","last_undegraded":"2024-04-22T01:10:50.671021+0000","last_fullsized":"2024-04-22T01:10:50.671021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:23.439754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21533,"num_write":374,"num_write_kb":54814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1080","reported_seq":1163,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:07:00.563875+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-22T01:07:00.563875+0000","last_peered":"2024-04-22T01:07:00.563875+0000","last_clean":"2024-04-22T01:07:00.563875+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-22T01:07:00.563875+0000","last_undegraded":"2024-04-22T01:07:00.563875+0000","last_fullsized":"2024-04-22T01:07:00.563875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":8663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'379","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.780461+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-22T01:10:50.780461+0000","last_peered":"2024-04-22T01:10:50.780461+0000","last_clean":"2024-04-22T01:10:50.780461+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-22T01:10:50.780461+0000","last_undegraded":"2024-04-22T01:10:50.780461+0000","last_fullsized":"2024-04-22T01:10:50.780461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7866,"num_write":347,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'361","reported_seq":444,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:03.128688+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-22T01:09:03.128688+0000","last_peered":"2024-04-22T01:09:03.128688+0000","last_clean":"2024-04-22T01:09:03.128688+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-22T01:09:03.128688+0000","last_undegraded":"2024-04-22T01:09:03.128688+0000","last_fullsized":"2024-04-22T01:09:03.128688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'447","reported_seq":580,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.458124+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-22T01:10:50.458124+0000","last_peered":"2024-04-22T01:10:50.458124+0000","last_clean":"2024-04-22T01:10:50.458124+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-22T01:10:50.458124+0000","last_undegraded":"2024-04-22T01:10:50.458124+0000","last_fullsized":"2024-04-22T01:10:50.458124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21571,"num_write":411,"num_write_kb":92495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'995","reported_seq":1078,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:50.447575+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-22T01:09:50.447575+0000","last_peered":"2024-04-22T01:09:50.447575+0000","last_clean":"2024-04-22T01:09:50.447575+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-22T01:09:50.447575+0000","last_undegraded":"2024-04-22T01:09:50.447575+0000","last_fullsized":"2024-04-22T01:09:50.447575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:56.447185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'396","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.475188+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-22T01:10:50.475188+0000","last_peered":"2024-04-22T01:10:50.475188+0000","last_clean":"2024-04-22T01:10:50.475188+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-22T01:10:50.475188+0000","last_undegraded":"2024-04-22T01:10:50.475188+0000","last_fullsized":"2024-04-22T01:10:50.475188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32877,"num_write":358,"num_write_kb":75502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'6444","reported_seq":6525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.883708+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-22T01:10:44.883708+0000","last_peered":"2024-04-22T01:10:44.883708+0000","last_clean":"2024-04-22T01:10:44.883708+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-22T01:10:44.883708+0000","last_undegraded":"2024-04-22T01:10:44.883708+0000","last_fullsized":"2024-04-22T01:10:44.883708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6444,"log_dups_size":0,"ondisk_log_size":6444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17429,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'369","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672077+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-22T01:10:50.672077+0000","last_peered":"2024-04-22T01:10:50.672077+0000","last_clean":"2024-04-22T01:10:50.672077+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-22T01:10:50.672077+0000","last_undegraded":"2024-04-22T01:10:50.672077+0000","last_fullsized":"2024-04-22T01:10:50.672077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39028,"num_write":349,"num_write_kb":80130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'453","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:10.451303+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-22T01:10:10.451303+0000","last_peered":"2024-04-22T01:10:10.451303+0000","last_clean":"2024-04-22T01:10:10.451303+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-22T01:10:10.451303+0000","last_undegraded":"2024-04-22T01:10:10.451303+0000","last_fullsized":"2024-04-22T01:10:10.451303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":607,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669157+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-22T01:10:50.669157+0000","last_peered":"2024-04-22T01:10:50.669157+0000","last_clean":"2024-04-22T01:10:50.669157+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-22T01:10:50.669157+0000","last_undegraded":"2024-04-22T01:10:50.669157+0000","last_fullsized":"2024-04-22T01:10:50.669157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43751,"num_write":424,"num_write_kb":64176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'391","reported_seq":472,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:53.166520+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-22T01:09:53.166520+0000","last_peered":"2024-04-22T01:09:53.166520+0000","last_clean":"2024-04-22T01:09:53.166520+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-22T01:09:53.166520+0000","last_undegraded":"2024-04-22T01:09:53.166520+0000","last_fullsized":"2024-04-22T01:09:53.166520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":559,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.590229+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-22T01:10:50.590229+0000","last_peered":"2024-04-22T01:10:50.590229+0000","last_clean":"2024-04-22T01:10:50.590229+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-22T01:10:50.590229+0000","last_undegraded":"2024-04-22T01:10:50.590229+0000","last_fullsized":"2024-04-22T01:10:50.590229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21201,"num_write":420,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'469","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.661579+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-22T01:08:57.661579+0000","last_peered":"2024-04-22T01:08:57.661579+0000","last_clean":"2024-04-22T01:08:57.661579+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-22T01:08:57.661579+0000","last_undegraded":"2024-04-22T01:08:57.661579+0000","last_fullsized":"2024-04-22T01:08:57.661579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'409","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672574+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-22T01:10:50.672574+0000","last_peered":"2024-04-22T01:10:50.672574+0000","last_clean":"2024-04-22T01:10:50.672574+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-22T01:10:50.672574+0000","last_undegraded":"2024-04-22T01:10:50.672574+0000","last_fullsized":"2024-04-22T01:10:50.672574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6132,"num_write":377,"num_write_kb":79520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1237","reported_seq":1318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:54.289194+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-22T01:08:54.289194+0000","last_peered":"2024-04-22T01:08:54.289194+0000","last_clean":"2024-04-22T01:08:54.289194+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-22T01:08:54.289194+0000","last_undegraded":"2024-04-22T01:08:54.289194+0000","last_fullsized":"2024-04-22T01:08:54.289194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.524423+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-22T01:10:50.524423+0000","last_peered":"2024-04-22T01:10:50.524423+0000","last_clean":"2024-04-22T01:10:50.524423+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-22T01:10:50.524423+0000","last_undegraded":"2024-04-22T01:10:50.524423+0000","last_fullsized":"2024-04-22T01:10:50.524423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16119,"num_write":379,"num_write_kb":38543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1279","reported_seq":1358,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:21.528970+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-22T01:09:21.528970+0000","last_peered":"2024-04-22T01:09:21.528970+0000","last_clean":"2024-04-22T01:09:21.528970+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-22T01:09:21.528970+0000","last_undegraded":"2024-04-22T01:09:21.528970+0000","last_fullsized":"2024-04-22T01:09:21.528970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":12886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'432","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.639233+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-22T01:10:50.639233+0000","last_peered":"2024-04-22T01:10:50.639233+0000","last_clean":"2024-04-22T01:10:50.639233+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-22T01:10:50.639233+0000","last_undegraded":"2024-04-22T01:10:50.639233+0000","last_fullsized":"2024-04-22T01:10:50.639233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:24:31.689158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23225,"num_write":401,"num_write_kb":108270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'409","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.623563+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-22T01:10:50.623563+0000","last_peered":"2024-04-22T01:10:50.623563+0000","last_clean":"2024-04-22T01:10:50.623563+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-22T01:10:50.623563+0000","last_undegraded":"2024-04-22T01:10:50.623563+0000","last_fullsized":"2024-04-22T01:10:50.623563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:05.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22627,"num_write":363,"num_write_kb":69341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'792","reported_seq":864,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:51.433653+0000","last_change":"2024-04-21T22:53:37.189530+0000","last_active":"2024-04-22T01:09:51.433653+0000","last_peered":"2024-04-22T01:09:51.433653+0000","last_clean":"2024-04-22T01:09:51.433653+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-22T01:09:51.433653+0000","last_undegraded":"2024-04-22T01:09:51.433653+0000","last_fullsized":"2024-04-22T01:09:51.433653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:16.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'375","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790069+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-22T01:10:50.790069+0000","last_peered":"2024-04-22T01:10:50.790069+0000","last_clean":"2024-04-22T01:10:50.790069+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-22T01:10:50.790069+0000","last_undegraded":"2024-04-22T01:10:50.790069+0000","last_fullsized":"2024-04-22T01:10:50.790069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17046,"num_write":339,"num_write_kb":42889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2007","reported_seq":2079,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:20.993085+0000","last_change":"2024-04-21T22:53:37.187992+0000","last_active":"2024-04-22T01:10:20.993085+0000","last_peered":"2024-04-22T01:10:20.993085+0000","last_clean":"2024-04-22T01:10:20.993085+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-22T01:10:20.993085+0000","last_undegraded":"2024-04-22T01:10:20.993085+0000","last_fullsized":"2024-04-22T01:10:20.993085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2007,"log_dups_size":0,"ondisk_log_size":2007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:24.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":17305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'380","reported_seq":520,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.670029+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-22T01:10:50.670029+0000","last_peered":"2024-04-22T01:10:50.670029+0000","last_clean":"2024-04-22T01:10:50.670029+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-22T01:10:50.670029+0000","last_undegraded":"2024-04-22T01:10:50.670029+0000","last_fullsized":"2024-04-22T01:10:50.670029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:59:51.600148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35342,"num_write":358,"num_write_kb":67635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'688","reported_seq":774,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:56.438374+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-22T01:08:56.438374+0000","last_peered":"2024-04-22T01:08:56.438374+0000","last_clean":"2024-04-22T01:08:56.438374+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-22T01:08:56.438374+0000","last_undegraded":"2024-04-22T01:08:56.438374+0000","last_fullsized":"2024-04-22T01:08:56.438374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:31:56.768493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'405","reported_seq":553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.667505+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-22T01:10:50.667505+0000","last_peered":"2024-04-22T01:10:50.667505+0000","last_clean":"2024-04-22T01:10:50.667505+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-22T01:10:50.667505+0000","last_undegraded":"2024-04-22T01:10:50.667505+0000","last_fullsized":"2024-04-22T01:10:50.667505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:49.627279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37645,"num_write":381,"num_write_kb":68489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'718","reported_seq":801,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:43.880788+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-22T01:09:43.880788+0000","last_peered":"2024-04-22T01:09:43.880788+0000","last_clean":"2024-04-22T01:09:43.880788+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-22T01:09:43.880788+0000","last_undegraded":"2024-04-22T01:09:43.880788+0000","last_fullsized":"2024-04-22T01:09:43.880788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":676,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":1454219,"num_write":24465,"num_write_kb":4289319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213130007,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":48352,"num_write_kb":232418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228024320,"data_stored":426260014,"data_compressed":52327842,"data_compressed_allocated":69902336,"data_compressed_original":268197888,"omap_allocated":0,"internal_metadata":0},"log_size":39153,"ondisk_log_size":39153,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62916,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424511100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71724,"kb_used_data":18340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":18780160,"data_stored":33648040,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511100,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151488,"kb_used_data":43960,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94220352,"statfs":{"total":96636764160,"available":96481640448,"internally_reserved":0,"allocated":45015040,"data_stored":88174574,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424511100,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84940,"kb_used_data":17668,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286900,"statfs":{"total":96636764160,"available":96549785600,"internally_reserved":0,"allocated":18092032,"data_stored":33648712,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424511101,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93264,"kb_used_data":25992,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278576,"statfs":{"total":96636764160,"available":96541261824,"internally_reserved":0,"allocated":26615808,"data_stored":48772550,"data_compressed":5793004,"data_compressed_allocated":7802880,"data_compressed_original":30134272,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424511100,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137712,"kb_used_data":30184,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94234128,"statfs":{"total":96636764160,"available":96495747072,"internally_reserved":0,"allocated":30908416,"data_stored":54620904,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511099,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148336,"kb_used_data":44968,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94223504,"statfs":{"total":96636764160,"available":96484868096,"internally_reserved":0,"allocated":46047232,"data_stored":81736600,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543805,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128480,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94243360,"statfs":{"total":96636764160,"available":96505200640,"internally_reserved":0,"allocated":17195008,"data_stored":35110341,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543804,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130280,"kb_used_data":26912,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94241560,"statfs":{"total":96636764160,"available":96503357440,"internally_reserved":0,"allocated":27557888,"data_stored":52477893,"data_compressed":6455074,"data_compressed_allocated":8462336,"data_compressed_original":33558528,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45789184,"data_stored":81642992,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26296320,"data_stored":48088574,"data_compressed":5761546,"data_compressed_allocated":7761920,"data_compressed_original":29560832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17833984,"data_stored":33555104,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44756992,"data_stored":88080966,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30650368,"data_stored":54527296,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":51793917,"data_compressed":6423616,"data_compressed_allocated":8421376,"data_compressed_original":32985088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18522112,"data_stored":33554432,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16936960,"data_stored":35016733,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T01:10:58.117 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T01:10:58.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T01:10:58.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.272+0000 7f5e33dfc640 1 Processor -- start 2024-04-22T01:10:58.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e33dfc640 1 -- start start 2024-04-22T01:10:58.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e33dfc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e2c152180 0x7f5e2c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:58.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e33dfc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2c0c6110 con 0x7f5e2c152560 2024-04-22T01:10:58.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e33dfc640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2c0716c0 con 0x7f5e2c072460 2024-04-22T01:10:58.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e33dfc640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2c0c63d0 con 0x7f5e2c152180 2024-04-22T01:10:58.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e31b98640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e2c152180 0x7f5e2c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:58.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e31397640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5e2c152560 0x7f5e2c06fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:53262/0 (socket says 172.21.15.110:53262) 2024-04-22T01:10:58.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.276+0000 7f5e31397640 1 -- 172.21.15.110:0/1625903819 learned_addr learned my addr 172.21.15.110:0/1625903819 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:58.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.284+0000 7f5e31b98640 1 -- 172.21.15.110:0/1625903819 >> v1:172.21.15.154:6789/0 conn(0x7f5e2c072460 legacy=0x7f5e2c0c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.284+0000 7f5e31b98640 1 -- 172.21.15.110:0/1625903819 >> v1:172.21.15.110:6789/0 conn(0x7f5e2c152560 legacy=0x7f5e2c06fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.284+0000 7f5e31b98640 1 -- 172.21.15.110:0/1625903819 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0c66b0 con 0x7f5e2c152180 2024-04-22T01:10:58.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.288+0000 7f5e31b98640 1 --2- 172.21.15.110:0/1625903819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152180 0x7f5e2c0c7490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097c0 tx=0x7f5e1c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba1a74a55583847 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e30b96640 1 -- 172.21.15.110:0/1625903819 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0b5070 con 0x7f5e2c152180 2024-04-22T01:10:58.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e30b96640 1 -- 172.21.15.110:0/1625903819 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1c0a8990 con 0x7f5e2c152180 2024-04-22T01:10:58.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e30b96640 1 -- 172.21.15.110:0/1625903819 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0a8d60 con 0x7f5e2c152180 2024-04-22T01:10:58.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e33dfc640 1 -- 172.21.15.110:0/1625903819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152180 msgr2=0x7f5e2c0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/1625903819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152180 0x7f5e2c0c7490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097c0 tx=0x7f5e1c01ec90 comp rx=0 tx=0).stop 2024-04-22T01:10:58.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e33dfc640 1 -- 172.21.15.110:0/1625903819 shutdown_connections 2024-04-22T01:10:58.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/1625903819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152180 0x7f5e2c0c7490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e33dfc640 1 -- 172.21.15.110:0/1625903819 >> 172.21.15.110:0/1625903819 conn(0x7f5e2c0cb710 msgr2=0x7f5e2c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:58.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e33dfc640 1 -- 172.21.15.110:0/1625903819 shutdown_connections 2024-04-22T01:10:58.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.292+0000 7f5e33dfc640 1 -- 172.21.15.110:0/1625903819 wait complete. 2024-04-22T01:10:58.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 Processor -- start 2024-04-22T01:10:58.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 -- start start 2024-04-22T01:10:58.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e2c072460 0x7f5e2c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:58.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152560 0x7f5e2c1e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:58.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2c0ca670 0x7f5e2c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:58.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c071f40 con 0x7f5e2c152560 2024-04-22T01:10:58.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c071c60 con 0x7f5e2c0ca670 2024-04-22T01:10:58.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e33dfc640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c0c5530 con 0x7f5e2c072460 2024-04-22T01:10:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e31397640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152560 0x7f5e2c1e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e31397640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152560 0x7f5e2c1e4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56206/0 (socket says 172.21.15.110:56206) 2024-04-22T01:10:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e31397640 1 -- 172.21.15.110:0/3476460871 learned_addr learned my addr 172.21.15.110:0/3476460871 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e32399640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2c0ca670 0x7f5e2c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.296+0000 7f5e31b98640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e2c072460 0x7f5e2c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:58.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.300+0000 7f5e31397640 1 -- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e2c072460 msgr2=0x7f5e2c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.300+0000 7f5e31397640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e2c072460 0x7f5e2c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.300+0000 7f5e31397640 1 -- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2c0ca670 msgr2=0x7f5e2c153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.300+0000 7f5e31397640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2c0ca670 0x7f5e2c153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.300+0000 7f5e31397640 1 -- 172.21.15.110:0/3476460871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0c9a00 con 0x7f5e2c152560 2024-04-22T01:10:58.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.324+0000 7f5e31397640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152560 0x7f5e2c1e4fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800c310 tx=0x7f5e2800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:58.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.336+0000 7f5e227fc640 1 -- 172.21.15.110:0/3476460871 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28017070 con 0x7f5e2c152560 2024-04-22T01:10:58.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.336+0000 7f5e227fc640 1 -- 172.21.15.110:0/3476460871 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e28005cf0 con 0x7f5e2c152560 2024-04-22T01:10:58.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.336+0000 7f5e227fc640 1 -- 172.21.15.110:0/3476460871 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28007310 con 0x7f5e2c152560 2024-04-22T01:10:58.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.336+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c1f1c00 con 0x7f5e2c152560 2024-04-22T01:10:58.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.336+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c1edf40 con 0x7f5e2c152560 2024-04-22T01:10:58.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.340+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c04f510 con 0x7f5e2c152560 2024-04-22T01:10:58.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.656+0000 7f5e227fc640 1 -- 172.21.15.110:0/3476460871 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e2801a070 con 0x7f5e2c152560 2024-04-22T01:10:58.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.660+0000 7f5e227fc640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5e10067940 0x7f5e10069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:58.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.660+0000 7f5e31b98640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5e10067940 0x7f5e10069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:58.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.660+0000 7f5e31b98640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5e10067940 0x7f5e10069e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0b2000 tx=0x7f5e1c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:58.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.696+0000 7f5e227fc640 1 -- 172.21.15.110:0/3476460871 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5e280538f0 con 0x7f5e2c152560 2024-04-22T01:10:58.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.700+0000 7f5e227fc640 1 -- 172.21.15.110:0/3476460871 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f5e28021020 con 0x7f5e2c152560 2024-04-22T01:10:58.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.956+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e2c0008e0 con 0x7f5e10067940 2024-04-22T01:10:58.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.976+0000 7f5e227fc640 1 -- 172.21.15.110:0/3476460871 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254369 (secure 0 0 0) 0x7f5e2c0008e0 con 0x7f5e10067940 2024-04-22T01:10:58.978 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:10:58.979 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-22T01:10:58.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5e10067940 msgr2=0x7f5e10069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5e10067940 0x7f5e10069e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0b2000 tx=0x7f5e1c0aa070 comp rx=0 tx=0).stop 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152560 msgr2=0x7f5e2c1e4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152560 0x7f5e2c1e4fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800c310 tx=0x7f5e2800c7d0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 shutdown_connections 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5e10067940 0x7f5e10069e00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2c0ca670 0x7f5e2c153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e2c152560 0x7f5e2c1e4fd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 --2- 172.21.15.110:0/3476460871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e2c072460 0x7f5e2c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 >> 172.21.15.110:0/3476460871 conn(0x7f5e2c0cb710 msgr2=0x7f5e2c0cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 shutdown_connections 2024-04-22T01:10:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:58.980+0000 7f5e33dfc640 1 -- 172.21.15.110:0/3476460871 wait complete. 2024-04-22T01:10:58.998 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":4162,"stamp":"2024-04-22T01:10:58.499649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213720375,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":7236,"num_read_kb":1459077,"num_write":73026,"num_write_kb":4525199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65691,"ondisk_log_size":65691,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":946224,"kb_used_data":224816,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":754028496,"statfs":{"total":773094113280,"available":772125179904,"internally_reserved":0,"allocated":230211584,"data_stored":428189614,"data_compressed":52390758,"data_compressed_allocated":69984256,"data_compressed_original":269344768,"omap_allocated":12749,"internal_metadata":738643507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3049,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003948"},"pg_stats":[{"pgid":"3.3f","version":"25'426","reported_seq":560,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.784372+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-22T01:10:50.784372+0000","last_peered":"2024-04-22T01:10:50.784372+0000","last_clean":"2024-04-22T01:10:50.784372+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-22T01:10:50.784372+0000","last_undegraded":"2024-04-22T01:10:50.784372+0000","last_fullsized":"2024-04-22T01:10:50.784372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28398,"num_write":395,"num_write_kb":75936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'442","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.636503+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-22T01:10:50.636503+0000","last_peered":"2024-04-22T01:10:50.636503+0000","last_clean":"2024-04-22T01:10:50.636503+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-22T01:10:50.636503+0000","last_undegraded":"2024-04-22T01:10:50.636503+0000","last_fullsized":"2024-04-22T01:10:50.636503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:25:19.748728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20820,"num_write":419,"num_write_kb":84104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'391","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672759+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-22T01:10:50.672759+0000","last_peered":"2024-04-22T01:10:50.672759+0000","last_clean":"2024-04-22T01:10:50.672759+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-22T01:10:50.672759+0000","last_undegraded":"2024-04-22T01:10:50.672759+0000","last_fullsized":"2024-04-22T01:10:50.672759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:27:16.978980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18719,"num_write":364,"num_write_kb":70997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'353","reported_seq":449,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.463402+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-22T01:10:50.463402+0000","last_peered":"2024-04-22T01:10:50.463402+0000","last_clean":"2024-04-22T01:10:50.463402+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-22T01:10:50.463402+0000","last_undegraded":"2024-04-22T01:10:50.463402+0000","last_fullsized":"2024-04-22T01:10:50.463402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":316,"num_write_kb":12972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'420","reported_seq":502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787858+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-22T01:10:50.787858+0000","last_peered":"2024-04-22T01:10:50.787858+0000","last_clean":"2024-04-22T01:10:50.787858+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-22T01:10:50.787858+0000","last_undegraded":"2024-04-22T01:10:50.787858+0000","last_fullsized":"2024-04-22T01:10:50.787858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:26:22.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":394,"num_write_kb":67878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'395","reported_seq":498,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.462469+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-22T01:10:50.462469+0000","last_peered":"2024-04-22T01:10:50.462469+0000","last_clean":"2024-04-22T01:10:50.462469+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-22T01:10:50.462469+0000","last_undegraded":"2024-04-22T01:10:50.462469+0000","last_fullsized":"2024-04-22T01:10:50.462469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17967,"num_write":373,"num_write_kb":71499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787989+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-22T01:10:50.787989+0000","last_peered":"2024-04-22T01:10:50.787989+0000","last_clean":"2024-04-22T01:10:50.787989+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-22T01:10:50.787989+0000","last_undegraded":"2024-04-22T01:10:50.787989+0000","last_fullsized":"2024-04-22T01:10:50.787989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13670,"num_write":376,"num_write_kb":39263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'387","reported_seq":533,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671825+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-22T01:10:50.671825+0000","last_peered":"2024-04-22T01:10:50.671825+0000","last_clean":"2024-04-22T01:10:50.671825+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-22T01:10:50.671825+0000","last_undegraded":"2024-04-22T01:10:50.671825+0000","last_fullsized":"2024-04-22T01:10:50.671825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:40:03.621192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":42822,"num_write":351,"num_write_kb":100036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'424","reported_seq":541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.793849+0000","last_change":"2024-04-21T22:53:38.576571+0000","last_active":"2024-04-22T01:10:50.793849+0000","last_peered":"2024-04-22T01:10:50.793849+0000","last_clean":"2024-04-22T01:10:50.793849+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-22T01:10:50.793849+0000","last_undegraded":"2024-04-22T01:10:50.793849+0000","last_fullsized":"2024-04-22T01:10:50.793849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20454,"num_write":396,"num_write_kb":59842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787702+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-22T01:10:50.787702+0000","last_peered":"2024-04-22T01:10:50.787702+0000","last_clean":"2024-04-22T01:10:50.787702+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-22T01:10:50.787702+0000","last_undegraded":"2024-04-22T01:10:50.787702+0000","last_fullsized":"2024-04-22T01:10:50.787702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:26.176484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5548,"num_write":382,"num_write_kb":76042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'383","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.788888+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-22T01:10:50.788888+0000","last_peered":"2024-04-22T01:10:50.788888+0000","last_clean":"2024-04-22T01:10:50.788888+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-22T01:10:50.788888+0000","last_undegraded":"2024-04-22T01:10:50.788888+0000","last_fullsized":"2024-04-22T01:10:50.788888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12739,"num_write":368,"num_write_kb":54575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'362","reported_seq":466,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.792220+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-22T01:10:50.792220+0000","last_peered":"2024-04-22T01:10:50.792220+0000","last_clean":"2024-04-22T01:10:50.792220+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-22T01:10:50.792220+0000","last_undegraded":"2024-04-22T01:10:50.792220+0000","last_fullsized":"2024-04-22T01:10:50.792220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:51:01.311466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9062,"num_write":334,"num_write_kb":50352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'384","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.511489+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-22T01:10:50.511489+0000","last_peered":"2024-04-22T01:10:50.511489+0000","last_clean":"2024-04-22T01:10:50.511489+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-22T01:10:50.511489+0000","last_undegraded":"2024-04-22T01:10:50.511489+0000","last_fullsized":"2024-04-22T01:10:50.511489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12819,"num_write":349,"num_write_kb":62920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'430","reported_seq":537,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.506564+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-22T01:10:50.506564+0000","last_peered":"2024-04-22T01:10:50.506564+0000","last_clean":"2024-04-22T01:10:50.506564+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-22T01:10:50.506564+0000","last_undegraded":"2024-04-22T01:10:50.506564+0000","last_fullsized":"2024-04-22T01:10:50.506564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21265,"num_write":396,"num_write_kb":88387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'436","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669670+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-22T01:10:50.669670+0000","last_peered":"2024-04-22T01:10:50.669670+0000","last_clean":"2024-04-22T01:10:50.669670+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-22T01:10:50.669670+0000","last_undegraded":"2024-04-22T01:10:50.669670+0000","last_fullsized":"2024-04-22T01:10:50.669670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:52:43.706899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21940,"num_write":398,"num_write_kb":112507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'433","reported_seq":557,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.618971+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-22T01:10:50.618971+0000","last_peered":"2024-04-22T01:10:50.618971+0000","last_clean":"2024-04-22T01:10:50.618971+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-22T01:10:50.618971+0000","last_undegraded":"2024-04-22T01:10:50.618971+0000","last_fullsized":"2024-04-22T01:10:50.618971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26769,"num_write":400,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'401","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.621571+0000","last_change":"2024-04-21T22:54:44.971067+0000","last_active":"2024-04-22T01:10:50.621571+0000","last_peered":"2024-04-22T01:10:50.621571+0000","last_clean":"2024-04-22T01:10:50.621571+0000","last_became_active":"2024-04-21T22:54:44.970288+0000","last_became_peered":"2024-04-21T22:54:44.970288+0000","last_unstale":"2024-04-22T01:10:50.621571+0000","last_undegraded":"2024-04-22T01:10:50.621571+0000","last_fullsized":"2024-04-22T01:10:50.621571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:37:41.657624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17556,"num_write":374,"num_write_kb":67589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'395","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.523427+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-22T01:10:50.523427+0000","last_peered":"2024-04-22T01:10:50.523427+0000","last_clean":"2024-04-22T01:10:50.523427+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-22T01:10:50.523427+0000","last_undegraded":"2024-04-22T01:10:50.523427+0000","last_fullsized":"2024-04-22T01:10:50.523427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22256,"num_write":365,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'432","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.610401+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-22T01:10:50.610401+0000","last_peered":"2024-04-22T01:10:50.610401+0000","last_clean":"2024-04-22T01:10:50.610401+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-22T01:10:50.610401+0000","last_undegraded":"2024-04-22T01:10:50.610401+0000","last_fullsized":"2024-04-22T01:10:50.610401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:37:06.081826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39722,"num_write":402,"num_write_kb":89327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.792125+0000","last_change":"2024-04-21T22:53:38.610862+0000","last_active":"2024-04-22T01:10:50.792125+0000","last_peered":"2024-04-22T01:10:50.792125+0000","last_clean":"2024-04-22T01:10:50.792125+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-22T01:10:50.792125+0000","last_undegraded":"2024-04-22T01:10:50.792125+0000","last_fullsized":"2024-04-22T01:10:50.792125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:51.748240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4220,"num_write":403,"num_write_kb":46421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'421","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675472+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-22T01:10:50.675472+0000","last_peered":"2024-04-22T01:10:50.675472+0000","last_clean":"2024-04-22T01:10:50.675472+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-22T01:10:50.675472+0000","last_undegraded":"2024-04-22T01:10:50.675472+0000","last_fullsized":"2024-04-22T01:10:50.675472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":8093,"num_write":400,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'410","reported_seq":535,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.791677+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-22T01:10:50.791677+0000","last_peered":"2024-04-22T01:10:50.791677+0000","last_clean":"2024-04-22T01:10:50.791677+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-22T01:10:50.791677+0000","last_undegraded":"2024-04-22T01:10:50.791677+0000","last_fullsized":"2024-04-22T01:10:50.791677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28547,"num_write":383,"num_write_kb":51065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'415","reported_seq":552,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.670125+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-22T01:10:50.670125+0000","last_peered":"2024-04-22T01:10:50.670125+0000","last_clean":"2024-04-22T01:10:50.670125+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-22T01:10:50.670125+0000","last_undegraded":"2024-04-22T01:10:50.670125+0000","last_fullsized":"2024-04-22T01:10:50.670125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:47:54.239652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":35420,"num_write":386,"num_write_kb":88354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'418","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.648468+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-22T01:10:50.648468+0000","last_peered":"2024-04-22T01:10:50.648468+0000","last_clean":"2024-04-22T01:10:50.648468+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-22T01:10:50.648468+0000","last_undegraded":"2024-04-22T01:10:50.648468+0000","last_fullsized":"2024-04-22T01:10:50.648468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:14:58.858486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6808,"num_write":388,"num_write_kb":34297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'391","reported_seq":477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669224+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-22T01:10:50.669224+0000","last_peered":"2024-04-22T01:10:50.669224+0000","last_clean":"2024-04-22T01:10:50.669224+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-22T01:10:50.669224+0000","last_undegraded":"2024-04-22T01:10:50.669224+0000","last_fullsized":"2024-04-22T01:10:50.669224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:25:42.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4176,"num_write":374,"num_write_kb":46218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'491","reported_seq":621,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.486307+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-22T01:10:50.486307+0000","last_peered":"2024-04-22T01:10:50.486307+0000","last_clean":"2024-04-22T01:10:50.486307+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-22T01:10:50.486307+0000","last_undegraded":"2024-04-22T01:10:50.486307+0000","last_fullsized":"2024-04-22T01:10:50.486307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:53.737881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29218,"num_write":445,"num_write_kb":101143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'436","reported_seq":576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.476674+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-22T01:10:50.476674+0000","last_peered":"2024-04-22T01:10:50.476674+0000","last_clean":"2024-04-22T01:10:50.476674+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-22T01:10:50.476674+0000","last_undegraded":"2024-04-22T01:10:50.476674+0000","last_fullsized":"2024-04-22T01:10:50.476674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29285,"num_write":407,"num_write_kb":84259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'386","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.510987+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-22T01:10:50.510987+0000","last_peered":"2024-04-22T01:10:50.510987+0000","last_clean":"2024-04-22T01:10:50.510987+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-22T01:10:50.510987+0000","last_undegraded":"2024-04-22T01:10:50.510987+0000","last_fullsized":"2024-04-22T01:10:50.510987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28108,"num_write":361,"num_write_kb":80021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'403","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669252+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-22T01:10:50.669252+0000","last_peered":"2024-04-22T01:10:50.669252+0000","last_clean":"2024-04-22T01:10:50.669252+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-22T01:10:50.669252+0000","last_undegraded":"2024-04-22T01:10:50.669252+0000","last_fullsized":"2024-04-22T01:10:50.669252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:43:35.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31845,"num_write":369,"num_write_kb":46987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'465","reported_seq":604,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.597026+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-22T01:10:50.597026+0000","last_peered":"2024-04-22T01:10:50.597026+0000","last_clean":"2024-04-22T01:10:50.597026+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-22T01:10:50.597026+0000","last_undegraded":"2024-04-22T01:10:50.597026+0000","last_fullsized":"2024-04-22T01:10:50.597026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":45092,"num_write":433,"num_write_kb":99910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'465","reported_seq":619,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.515836+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-22T01:10:50.515836+0000","last_peered":"2024-04-22T01:10:50.515836+0000","last_clean":"2024-04-22T01:10:50.515836+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-22T01:10:50.515836+0000","last_undegraded":"2024-04-22T01:10:50.515836+0000","last_fullsized":"2024-04-22T01:10:50.515836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44084,"num_write":435,"num_write_kb":97059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'430","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.466232+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-22T01:10:50.466232+0000","last_peered":"2024-04-22T01:10:50.466232+0000","last_clean":"2024-04-22T01:10:50.466232+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-22T01:10:50.466232+0000","last_undegraded":"2024-04-22T01:10:50.466232+0000","last_fullsized":"2024-04-22T01:10:50.466232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14125,"num_write":397,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.789963+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-22T01:10:50.789963+0000","last_peered":"2024-04-22T01:10:50.789963+0000","last_clean":"2024-04-22T01:10:50.789963+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-22T01:10:50.789963+0000","last_undegraded":"2024-04-22T01:10:50.789963+0000","last_fullsized":"2024-04-22T01:10:50.789963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:32.783416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31266,"num_write":385,"num_write_kb":75657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'363","reported_seq":435,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:38.124898+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-22T01:08:38.124898+0000","last_peered":"2024-04-22T01:08:38.124898+0000","last_clean":"2024-04-22T01:08:38.124898+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-22T01:08:38.124898+0000","last_undegraded":"2024-04-22T01:08:38.124898+0000","last_fullsized":"2024-04-22T01:08:38.124898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'372","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675292+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-22T01:10:50.675292+0000","last_peered":"2024-04-22T01:10:50.675292+0000","last_clean":"2024-04-22T01:10:50.675292+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-22T01:10:50.675292+0000","last_undegraded":"2024-04-22T01:10:50.675292+0000","last_fullsized":"2024-04-22T01:10:50.675292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19141,"num_write":353,"num_write_kb":42712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'2175","reported_seq":2247,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:40.436426+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-22T01:08:40.436426+0000","last_peered":"2024-04-22T01:08:40.436426+0000","last_clean":"2024-04-22T01:08:40.436426+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-22T01:08:40.436426+0000","last_undegraded":"2024-04-22T01:08:40.436426+0000","last_fullsized":"2024-04-22T01:08:40.436426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2175,"log_dups_size":0,"ondisk_log_size":2175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:03:31.566421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2118,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'778","reported_seq":852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:45.527664+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-22T01:09:45.527664+0000","last_peered":"2024-04-22T01:09:45.527664+0000","last_clean":"2024-04-22T01:09:45.527664+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-22T01:09:45.527664+0000","last_undegraded":"2024-04-22T01:09:45.527664+0000","last_fullsized":"2024-04-22T01:09:45.527664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'427","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671412+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-22T01:10:50.671412+0000","last_peered":"2024-04-22T01:10:50.671412+0000","last_clean":"2024-04-22T01:10:50.671412+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-22T01:10:50.671412+0000","last_undegraded":"2024-04-22T01:10:50.671412+0000","last_fullsized":"2024-04-22T01:10:50.671412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:38:02.541775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27111,"num_write":394,"num_write_kb":58934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1416","reported_seq":1490,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:00.439752+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-22T01:09:00.439752+0000","last_peered":"2024-04-22T01:09:00.439752+0000","last_clean":"2024-04-22T01:09:00.439752+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-22T01:09:00.439752+0000","last_undegraded":"2024-04-22T01:09:00.439752+0000","last_fullsized":"2024-04-22T01:09:00.439752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":12962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'395","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.674564+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-22T01:10:50.674564+0000","last_peered":"2024-04-22T01:10:50.674564+0000","last_clean":"2024-04-22T01:10:50.674564+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-22T01:10:50.674564+0000","last_undegraded":"2024-04-22T01:10:50.674564+0000","last_fullsized":"2024-04-22T01:10:50.674564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":217,"num_write":366,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'56","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:00.407654+0000","last_change":"2024-04-21T22:53:37.185089+0000","last_active":"2024-04-22T01:09:00.407654+0000","last_peered":"2024-04-22T01:09:00.407654+0000","last_clean":"2024-04-22T01:09:00.407654+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-22T01:09:00.407654+0000","last_undegraded":"2024-04-22T01:09:00.407654+0000","last_fullsized":"2024-04-22T01:09:00.407654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'451","reported_seq":580,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.488185+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-22T01:10:50.488185+0000","last_peered":"2024-04-22T01:10:50.488185+0000","last_clean":"2024-04-22T01:10:50.488185+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-22T01:10:50.488185+0000","last_undegraded":"2024-04-22T01:10:50.488185+0000","last_fullsized":"2024-04-22T01:10:50.488185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:09.983320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27728,"num_write":424,"num_write_kb":88654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1252","reported_seq":1326,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.170034+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-22T01:10:50.170034+0000","last_peered":"2024-04-22T01:10:50.170034+0000","last_clean":"2024-04-22T01:10:50.170034+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-22T01:10:50.170034+0000","last_undegraded":"2024-04-22T01:10:50.170034+0000","last_fullsized":"2024-04-22T01:10:50.170034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10339768,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":10694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'398","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669454+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-22T01:10:50.669454+0000","last_peered":"2024-04-22T01:10:50.669454+0000","last_clean":"2024-04-22T01:10:50.669454+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-22T01:10:50.669454+0000","last_undegraded":"2024-04-22T01:10:50.669454+0000","last_fullsized":"2024-04-22T01:10:50.669454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:13.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27611,"num_write":368,"num_write_kb":80241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'3971","reported_seq":4045,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.475044+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-22T01:10:44.475044+0000","last_peered":"2024-04-22T01:10:44.475044+0000","last_clean":"2024-04-22T01:10:44.475044+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-22T01:10:44.475044+0000","last_undegraded":"2024-04-22T01:10:44.475044+0000","last_fullsized":"2024-04-22T01:10:44.475044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3971,"log_dups_size":0,"ondisk_log_size":3971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'395","reported_seq":511,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.643246+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-22T01:10:50.643246+0000","last_peered":"2024-04-22T01:10:50.643246+0000","last_clean":"2024-04-22T01:10:50.643246+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-22T01:10:50.643246+0000","last_undegraded":"2024-04-22T01:10:50.643246+0000","last_fullsized":"2024-04-22T01:10:50.643246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:50.140041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17003,"num_write":357,"num_write_kb":47379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2295","reported_seq":2371,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:33.710526+0000","last_change":"2024-04-21T22:53:37.134021+0000","last_active":"2024-04-22T01:10:33.710526+0000","last_peered":"2024-04-22T01:10:33.710526+0000","last_clean":"2024-04-22T01:10:33.710526+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-22T01:10:33.710526+0000","last_undegraded":"2024-04-22T01:10:33.710526+0000","last_fullsized":"2024-04-22T01:10:33.710526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:57.000042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2254,"num_write_kb":13663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'414","reported_seq":539,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.785058+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-22T01:10:50.785058+0000","last_peered":"2024-04-22T01:10:50.785058+0000","last_clean":"2024-04-22T01:10:50.785058+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-22T01:10:50.785058+0000","last_undegraded":"2024-04-22T01:10:50.785058+0000","last_fullsized":"2024-04-22T01:10:50.785058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26385,"num_write":381,"num_write_kb":92626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'720","reported_seq":796,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.927568+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-22T01:08:57.927568+0000","last_peered":"2024-04-22T01:08:57.927568+0000","last_clean":"2024-04-22T01:08:57.927568+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-22T01:08:57.927568+0000","last_undegraded":"2024-04-22T01:08:57.927568+0000","last_fullsized":"2024-04-22T01:08:57.927568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'386","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.479154+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-22T01:10:50.479154+0000","last_peered":"2024-04-22T01:10:50.479154+0000","last_clean":"2024-04-22T01:10:50.479154+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-22T01:10:50.479154+0000","last_undegraded":"2024-04-22T01:10:50.479154+0000","last_fullsized":"2024-04-22T01:10:50.479154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5166,"num_write":360,"num_write_kb":42321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'60","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:42.567375+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-22T01:10:42.567375+0000","last_peered":"2024-04-22T01:10:42.567375+0000","last_clean":"2024-04-22T01:10:42.567375+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-22T01:10:42.567375+0000","last_undegraded":"2024-04-22T01:10:42.567375+0000","last_fullsized":"2024-04-22T01:10:42.567375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:52.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'397","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.638638+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-22T01:10:50.638638+0000","last_peered":"2024-04-22T01:10:50.638638+0000","last_clean":"2024-04-22T01:10:50.638638+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-22T01:10:50.638638+0000","last_undegraded":"2024-04-22T01:10:50.638638+0000","last_fullsized":"2024-04-22T01:10:50.638638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:27.631111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27517,"num_write":361,"num_write_kb":56016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'51","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:01.350404+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-22T01:08:01.350404+0000","last_peered":"2024-04-22T01:08:01.350404+0000","last_clean":"2024-04-22T01:08:01.350404+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-22T01:08:01.350404+0000","last_undegraded":"2024-04-22T01:08:01.350404+0000","last_fullsized":"2024-04-22T01:08:01.350404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'460","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.776781+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-22T01:10:50.776781+0000","last_peered":"2024-04-22T01:10:50.776781+0000","last_clean":"2024-04-22T01:10:50.776781+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-22T01:10:50.776781+0000","last_undegraded":"2024-04-22T01:10:50.776781+0000","last_fullsized":"2024-04-22T01:10:50.776781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:54.928115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":20178,"num_write":438,"num_write_kb":96694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'919","reported_seq":995,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:40.532907+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-22T01:10:40.532907+0000","last_peered":"2024-04-22T01:10:40.532907+0000","last_clean":"2024-04-22T01:10:40.532907+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-22T01:10:40.532907+0000","last_undegraded":"2024-04-22T01:10:40.532907+0000","last_fullsized":"2024-04-22T01:10:40.532907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'481","reported_seq":612,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.607613+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-22T01:10:50.607613+0000","last_peered":"2024-04-22T01:10:50.607613+0000","last_clean":"2024-04-22T01:10:50.607613+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-22T01:10:50.607613+0000","last_undegraded":"2024-04-22T01:10:50.607613+0000","last_fullsized":"2024-04-22T01:10:50.607613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:15:52.770240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33204,"num_write":448,"num_write_kb":124685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'818","reported_seq":896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:05.182561+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-22T01:10:05.182561+0000","last_peered":"2024-04-22T01:10:05.182561+0000","last_clean":"2024-04-22T01:10:05.182561+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-22T01:10:05.182561+0000","last_undegraded":"2024-04-22T01:10:05.182561+0000","last_fullsized":"2024-04-22T01:10:05.182561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'350","reported_seq":461,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.488114+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-22T01:10:50.488114+0000","last_peered":"2024-04-22T01:10:50.488114+0000","last_clean":"2024-04-22T01:10:50.488114+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-22T01:10:50.488114+0000","last_undegraded":"2024-04-22T01:10:50.488114+0000","last_fullsized":"2024-04-22T01:10:50.488114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12827,"num_write":324,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'820","reported_seq":899,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:39.664467+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-22T01:08:39.664467+0000","last_peered":"2024-04-22T01:08:39.664467+0000","last_clean":"2024-04-22T01:08:39.664467+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-22T01:08:39.664467+0000","last_undegraded":"2024-04-22T01:08:39.664467+0000","last_fullsized":"2024-04-22T01:08:39.664467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'428","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790681+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-22T01:10:50.790681+0000","last_peered":"2024-04-22T01:10:50.790681+0000","last_clean":"2024-04-22T01:10:50.790681+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-22T01:10:50.790681+0000","last_undegraded":"2024-04-22T01:10:50.790681+0000","last_fullsized":"2024-04-22T01:10:50.790681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:05:57.044384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36323,"num_write":394,"num_write_kb":104531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'352","reported_seq":431,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:58.737044+0000","last_change":"2024-04-21T22:53:37.253316+0000","last_active":"2024-04-22T01:08:58.737044+0000","last_peered":"2024-04-22T01:08:58.737044+0000","last_clean":"2024-04-22T01:08:58.737044+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-22T01:08:58.737044+0000","last_undegraded":"2024-04-22T01:08:58.737044+0000","last_fullsized":"2024-04-22T01:08:58.737044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:45:21.383363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'429","reported_seq":547,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.789412+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-22T01:10:50.789412+0000","last_peered":"2024-04-22T01:10:50.789412+0000","last_clean":"2024-04-22T01:10:50.789412+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-22T01:10:50.789412+0000","last_undegraded":"2024-04-22T01:10:50.789412+0000","last_fullsized":"2024-04-22T01:10:50.789412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:37.550160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22478,"num_write":396,"num_write_kb":50602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'340","reported_seq":419,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:30.741959+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-22T01:10:30.741959+0000","last_peered":"2024-04-22T01:10:30.741959+0000","last_clean":"2024-04-22T01:10:30.741959+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-22T01:10:30.741959+0000","last_undegraded":"2024-04-22T01:10:30.741959+0000","last_fullsized":"2024-04-22T01:10:30.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'412","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.640083+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-22T01:10:50.640083+0000","last_peered":"2024-04-22T01:10:50.640083+0000","last_clean":"2024-04-22T01:10:50.640083+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-22T01:10:50.640083+0000","last_undegraded":"2024-04-22T01:10:50.640083+0000","last_fullsized":"2024-04-22T01:10:50.640083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:03.405030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12764,"num_write":388,"num_write_kb":59120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'161","reported_seq":296,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:07:35.524302+0000","last_change":"2024-04-21T22:52:58.454152+0000","last_active":"2024-04-22T01:07:35.524302+0000","last_peered":"2024-04-22T01:07:35.524302+0000","last_clean":"2024-04-22T01:07:35.524302+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-22T01:07:35.524302+0000","last_undegraded":"2024-04-22T01:07:35.524302+0000","last_fullsized":"2024-04-22T01:07:35.524302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:52:55.145387+0000","last_clean_scrub_stamp":"2024-04-21T22:52:55.145387+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:11:10.808812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'373","reported_seq":456,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:21.928762+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-22T01:10:21.928762+0000","last_peered":"2024-04-22T01:10:21.928762+0000","last_clean":"2024-04-22T01:10:21.928762+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-22T01:10:21.928762+0000","last_undegraded":"2024-04-22T01:10:21.928762+0000","last_fullsized":"2024-04-22T01:10:21.928762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:29.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'363","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672534+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-22T01:10:50.672534+0000","last_peered":"2024-04-22T01:10:50.672534+0000","last_clean":"2024-04-22T01:10:50.672534+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-22T01:10:50.672534+0000","last_undegraded":"2024-04-22T01:10:50.672534+0000","last_fullsized":"2024-04-22T01:10:50.672534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26229,"num_write":331,"num_write_kb":46345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'1075","reported_seq":1161,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:05.048176+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-22T01:10:05.048176+0000","last_peered":"2024-04-22T01:10:05.048176+0000","last_clean":"2024-04-22T01:10:05.048176+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-22T01:10:05.048176+0000","last_undegraded":"2024-04-22T01:10:05.048176+0000","last_fullsized":"2024-04-22T01:10:05.048176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'414","reported_seq":606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.504820+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-22T01:10:50.504820+0000","last_peered":"2024-04-22T01:10:50.504820+0000","last_clean":"2024-04-22T01:10:50.504820+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-22T01:10:50.504820+0000","last_undegraded":"2024-04-22T01:10:50.504820+0000","last_fullsized":"2024-04-22T01:10:50.504820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":57177,"num_write":383,"num_write_kb":104760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'4405","reported_seq":8837,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:45.464245+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-22T01:10:45.464245+0000","last_peered":"2024-04-22T01:10:45.464245+0000","last_clean":"2024-04-22T01:10:45.464245+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-22T01:10:45.464245+0000","last_undegraded":"2024-04-22T01:10:45.464245+0000","last_fullsized":"2024-04-22T01:10:45.464245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":4349,"num_write_kb":4731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671021+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-22T01:10:50.671021+0000","last_peered":"2024-04-22T01:10:50.671021+0000","last_clean":"2024-04-22T01:10:50.671021+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-22T01:10:50.671021+0000","last_undegraded":"2024-04-22T01:10:50.671021+0000","last_fullsized":"2024-04-22T01:10:50.671021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:23.439754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21533,"num_write":374,"num_write_kb":54814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1080","reported_seq":1163,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:07:00.563875+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-22T01:07:00.563875+0000","last_peered":"2024-04-22T01:07:00.563875+0000","last_clean":"2024-04-22T01:07:00.563875+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-22T01:07:00.563875+0000","last_undegraded":"2024-04-22T01:07:00.563875+0000","last_fullsized":"2024-04-22T01:07:00.563875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:57.271872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":8663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'379","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.780461+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-22T01:10:50.780461+0000","last_peered":"2024-04-22T01:10:50.780461+0000","last_clean":"2024-04-22T01:10:50.780461+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-22T01:10:50.780461+0000","last_undegraded":"2024-04-22T01:10:50.780461+0000","last_fullsized":"2024-04-22T01:10:50.780461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7866,"num_write":347,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'361","reported_seq":444,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:03.128688+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-22T01:09:03.128688+0000","last_peered":"2024-04-22T01:09:03.128688+0000","last_clean":"2024-04-22T01:09:03.128688+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-22T01:09:03.128688+0000","last_undegraded":"2024-04-22T01:09:03.128688+0000","last_fullsized":"2024-04-22T01:09:03.128688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'447","reported_seq":580,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.458124+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-22T01:10:50.458124+0000","last_peered":"2024-04-22T01:10:50.458124+0000","last_clean":"2024-04-22T01:10:50.458124+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-22T01:10:50.458124+0000","last_undegraded":"2024-04-22T01:10:50.458124+0000","last_fullsized":"2024-04-22T01:10:50.458124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:53:30.269409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21571,"num_write":411,"num_write_kb":92495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'995","reported_seq":1078,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:50.447575+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-22T01:09:50.447575+0000","last_peered":"2024-04-22T01:09:50.447575+0000","last_clean":"2024-04-22T01:09:50.447575+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-22T01:09:50.447575+0000","last_undegraded":"2024-04-22T01:09:50.447575+0000","last_fullsized":"2024-04-22T01:09:50.447575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:56.447185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'396","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.475188+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-22T01:10:50.475188+0000","last_peered":"2024-04-22T01:10:50.475188+0000","last_clean":"2024-04-22T01:10:50.475188+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-22T01:10:50.475188+0000","last_undegraded":"2024-04-22T01:10:50.475188+0000","last_fullsized":"2024-04-22T01:10:50.475188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32877,"num_write":358,"num_write_kb":75502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'6444","reported_seq":6525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.883708+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-22T01:10:44.883708+0000","last_peered":"2024-04-22T01:10:44.883708+0000","last_clean":"2024-04-22T01:10:44.883708+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-22T01:10:44.883708+0000","last_undegraded":"2024-04-22T01:10:44.883708+0000","last_fullsized":"2024-04-22T01:10:44.883708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6444,"log_dups_size":0,"ondisk_log_size":6444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17429,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'369","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672077+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-22T01:10:50.672077+0000","last_peered":"2024-04-22T01:10:50.672077+0000","last_clean":"2024-04-22T01:10:50.672077+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-22T01:10:50.672077+0000","last_undegraded":"2024-04-22T01:10:50.672077+0000","last_fullsized":"2024-04-22T01:10:50.672077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39028,"num_write":349,"num_write_kb":80130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'453","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:10.451303+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-22T01:10:10.451303+0000","last_peered":"2024-04-22T01:10:10.451303+0000","last_clean":"2024-04-22T01:10:10.451303+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-22T01:10:10.451303+0000","last_undegraded":"2024-04-22T01:10:10.451303+0000","last_fullsized":"2024-04-22T01:10:10.451303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:51:08.766324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":607,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669157+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-22T01:10:50.669157+0000","last_peered":"2024-04-22T01:10:50.669157+0000","last_clean":"2024-04-22T01:10:50.669157+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-22T01:10:50.669157+0000","last_undegraded":"2024-04-22T01:10:50.669157+0000","last_fullsized":"2024-04-22T01:10:50.669157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43751,"num_write":424,"num_write_kb":64176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'391","reported_seq":472,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:53.166520+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-22T01:09:53.166520+0000","last_peered":"2024-04-22T01:09:53.166520+0000","last_clean":"2024-04-22T01:09:53.166520+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-22T01:09:53.166520+0000","last_undegraded":"2024-04-22T01:09:53.166520+0000","last_fullsized":"2024-04-22T01:09:53.166520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":559,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.590229+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-22T01:10:50.590229+0000","last_peered":"2024-04-22T01:10:50.590229+0000","last_clean":"2024-04-22T01:10:50.590229+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-22T01:10:50.590229+0000","last_undegraded":"2024-04-22T01:10:50.590229+0000","last_fullsized":"2024-04-22T01:10:50.590229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:56.921223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21201,"num_write":420,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'469","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.661579+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-22T01:08:57.661579+0000","last_peered":"2024-04-22T01:08:57.661579+0000","last_clean":"2024-04-22T01:08:57.661579+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-22T01:08:57.661579+0000","last_undegraded":"2024-04-22T01:08:57.661579+0000","last_fullsized":"2024-04-22T01:08:57.661579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'409","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672574+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-22T01:10:50.672574+0000","last_peered":"2024-04-22T01:10:50.672574+0000","last_clean":"2024-04-22T01:10:50.672574+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-22T01:10:50.672574+0000","last_undegraded":"2024-04-22T01:10:50.672574+0000","last_fullsized":"2024-04-22T01:10:50.672574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6132,"num_write":377,"num_write_kb":79520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1237","reported_seq":1318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:54.289194+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-22T01:08:54.289194+0000","last_peered":"2024-04-22T01:08:54.289194+0000","last_clean":"2024-04-22T01:08:54.289194+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-22T01:08:54.289194+0000","last_undegraded":"2024-04-22T01:08:54.289194+0000","last_fullsized":"2024-04-22T01:08:54.289194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.524423+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-22T01:10:50.524423+0000","last_peered":"2024-04-22T01:10:50.524423+0000","last_clean":"2024-04-22T01:10:50.524423+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-22T01:10:50.524423+0000","last_undegraded":"2024-04-22T01:10:50.524423+0000","last_fullsized":"2024-04-22T01:10:50.524423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16119,"num_write":379,"num_write_kb":38543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1279","reported_seq":1358,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:21.528970+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-22T01:09:21.528970+0000","last_peered":"2024-04-22T01:09:21.528970+0000","last_clean":"2024-04-22T01:09:21.528970+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-22T01:09:21.528970+0000","last_undegraded":"2024-04-22T01:09:21.528970+0000","last_fullsized":"2024-04-22T01:09:21.528970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":12886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'432","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.639233+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-22T01:10:50.639233+0000","last_peered":"2024-04-22T01:10:50.639233+0000","last_clean":"2024-04-22T01:10:50.639233+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-22T01:10:50.639233+0000","last_undegraded":"2024-04-22T01:10:50.639233+0000","last_fullsized":"2024-04-22T01:10:50.639233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:24:31.689158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23225,"num_write":401,"num_write_kb":108270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'409","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.623563+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-22T01:10:50.623563+0000","last_peered":"2024-04-22T01:10:50.623563+0000","last_clean":"2024-04-22T01:10:50.623563+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-22T01:10:50.623563+0000","last_undegraded":"2024-04-22T01:10:50.623563+0000","last_fullsized":"2024-04-22T01:10:50.623563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:05.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22627,"num_write":363,"num_write_kb":69341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'792","reported_seq":864,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:51.433653+0000","last_change":"2024-04-21T22:53:37.189530+0000","last_active":"2024-04-22T01:09:51.433653+0000","last_peered":"2024-04-22T01:09:51.433653+0000","last_clean":"2024-04-22T01:09:51.433653+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-22T01:09:51.433653+0000","last_undegraded":"2024-04-22T01:09:51.433653+0000","last_fullsized":"2024-04-22T01:09:51.433653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:16.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'375","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790069+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-22T01:10:50.790069+0000","last_peered":"2024-04-22T01:10:50.790069+0000","last_clean":"2024-04-22T01:10:50.790069+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-22T01:10:50.790069+0000","last_undegraded":"2024-04-22T01:10:50.790069+0000","last_fullsized":"2024-04-22T01:10:50.790069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:09.153753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17046,"num_write":339,"num_write_kb":42889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2007","reported_seq":2079,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:20.993085+0000","last_change":"2024-04-21T22:53:37.187992+0000","last_active":"2024-04-22T01:10:20.993085+0000","last_peered":"2024-04-22T01:10:20.993085+0000","last_clean":"2024-04-22T01:10:20.993085+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-22T01:10:20.993085+0000","last_undegraded":"2024-04-22T01:10:20.993085+0000","last_fullsized":"2024-04-22T01:10:20.993085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2007,"log_dups_size":0,"ondisk_log_size":2007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:24.429729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":17305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'380","reported_seq":520,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.670029+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-22T01:10:50.670029+0000","last_peered":"2024-04-22T01:10:50.670029+0000","last_clean":"2024-04-22T01:10:50.670029+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-22T01:10:50.670029+0000","last_undegraded":"2024-04-22T01:10:50.670029+0000","last_fullsized":"2024-04-22T01:10:50.670029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:59:51.600148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35342,"num_write":358,"num_write_kb":67635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'688","reported_seq":774,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:56.438374+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-22T01:08:56.438374+0000","last_peered":"2024-04-22T01:08:56.438374+0000","last_clean":"2024-04-22T01:08:56.438374+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-22T01:08:56.438374+0000","last_undegraded":"2024-04-22T01:08:56.438374+0000","last_fullsized":"2024-04-22T01:08:56.438374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:31:56.768493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'405","reported_seq":553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.667505+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-22T01:10:50.667505+0000","last_peered":"2024-04-22T01:10:50.667505+0000","last_clean":"2024-04-22T01:10:50.667505+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-22T01:10:50.667505+0000","last_undegraded":"2024-04-22T01:10:50.667505+0000","last_fullsized":"2024-04-22T01:10:50.667505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:49.627279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37645,"num_write":381,"num_write_kb":68489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'718","reported_seq":801,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:43.880788+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-22T01:09:43.880788+0000","last_peered":"2024-04-22T01:09:43.880788+0000","last_clean":"2024-04-22T01:09:43.880788+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-22T01:09:43.880788+0000","last_undegraded":"2024-04-22T01:09:43.880788+0000","last_fullsized":"2024-04-22T01:09:43.880788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":676,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":1454219,"num_write":24465,"num_write_kb":4289319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213130007,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":48352,"num_write_kb":232418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228024320,"data_stored":426260014,"data_compressed":52327842,"data_compressed_allocated":69902336,"data_compressed_original":268197888,"omap_allocated":0,"internal_metadata":0},"log_size":39153,"ondisk_log_size":39153,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62916,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424511100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71724,"kb_used_data":18340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":18780160,"data_stored":33648040,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511100,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151488,"kb_used_data":43960,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94220352,"statfs":{"total":96636764160,"available":96481640448,"internally_reserved":0,"allocated":45015040,"data_stored":88174574,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424511100,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84940,"kb_used_data":17668,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286900,"statfs":{"total":96636764160,"available":96549785600,"internally_reserved":0,"allocated":18092032,"data_stored":33648712,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424511101,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93264,"kb_used_data":25992,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278576,"statfs":{"total":96636764160,"available":96541261824,"internally_reserved":0,"allocated":26615808,"data_stored":48772550,"data_compressed":5793004,"data_compressed_allocated":7802880,"data_compressed_original":30134272,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424511100,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137712,"kb_used_data":30184,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94234128,"statfs":{"total":96636764160,"available":96495747072,"internally_reserved":0,"allocated":30908416,"data_stored":54620904,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511099,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148336,"kb_used_data":44968,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94223504,"statfs":{"total":96636764160,"available":96484868096,"internally_reserved":0,"allocated":46047232,"data_stored":81736600,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543806,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128480,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94243360,"statfs":{"total":96636764160,"available":96505200640,"internally_reserved":0,"allocated":17195008,"data_stored":35110341,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543805,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130280,"kb_used_data":26912,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94241560,"statfs":{"total":96636764160,"available":96503357440,"internally_reserved":0,"allocated":27557888,"data_stored":52477893,"data_compressed":6455074,"data_compressed_allocated":8462336,"data_compressed_original":33558528,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45789184,"data_stored":81642992,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26296320,"data_stored":48088574,"data_compressed":5761546,"data_compressed_allocated":7761920,"data_compressed_original":29560832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17833984,"data_stored":33555104,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44756992,"data_stored":88080966,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30650368,"data_stored":54527296,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":51793917,"data_compressed":6423616,"data_compressed_allocated":8421376,"data_compressed_original":32985088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18522112,"data_stored":33554432,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16936960,"data_stored":35016733,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T01:10:59.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T01:10:59.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.172+0000 7fc84dd2f640 1 Processor -- start 2024-04-22T01:10:59.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.172+0000 7fc84dd2f640 1 -- start start 2024-04-22T01:10:59.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.172+0000 7fc84dd2f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc848152560 0x7fc8480c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.172+0000 7fc84dd2f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc848072460 0x7fc848158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc84dd2f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8480c6110 con 0x7fc848152180 2024-04-22T01:10:59.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc84dd2f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc8481592e0 con 0x7fc848152560 2024-04-22T01:10:59.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc84dd2f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc8480716c0 con 0x7fc848072460 2024-04-22T01:10:59.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc8477fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc848152180 0x7fc84806fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60520/0 (socket says 172.21.15.110:60520) 2024-04-22T01:10:59.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc8477fe640 1 -- 172.21.15.110:0/1574086308 learned_addr learned my addr 172.21.15.110:0/1574086308 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:10:59.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc846ffd640 1 --2- 172.21.15.110:0/1574086308 >> v2:172.21.15.154:3300/0 conn(0x7fc848152560 0x7fc8480c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:59.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc847fff640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc848072460 0x7fc848158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:59.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596177687 0 0) 0x7fc8480c6110 con 0x7fc848152180 2024-04-22T01:10:59.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.176+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc830003530 con 0x7fc848152180 2024-04-22T01:10:59.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 985056533 0 0) 0x7fc830003530 con 0x7fc848152180 2024-04-22T01:10:59.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc848072460 msgr2=0x7fc848158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc848072460 0x7fc848158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 >> v2:172.21.15.154:3300/0 conn(0x7fc848152560 msgr2=0x7fc8480c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 --2- 172.21.15.110:0/1574086308 >> v2:172.21.15.154:3300/0 conn(0x7fc848152560 0x7fc8480c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8480c63d0 con 0x7fc848152180 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7fc838001680 con 0x7fc848152180 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 >> v1:172.21.15.110:6789/0 conn(0x7fc848152180 legacy=0x7fc84806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc848072460 0x7fc8300039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc830003f90 0x7fc830004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc8481592e0 con 0x7fc830004d50 2024-04-22T01:10:59.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8480716c0 con 0x7fc830003f90 2024-04-22T01:10:59.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.180+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc83000ba50 con 0x7fc848072460 2024-04-22T01:10:59.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.184+0000 7fc847fff640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:59.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.188+0000 7fc847fff640 1 -- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc848072460 msgr2=0x7fc8300039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:59.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.188+0000 7fc847fff640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc848072460 0x7fc8300039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.188+0000 7fc847fff640 1 -- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc830003f90 msgr2=0x7fc830004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:10:59.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.188+0000 7fc847fff640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc830003f90 0x7fc830004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.188+0000 7fc847fff640 1 -- 172.21.15.110:0/1574086308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc830003530 con 0x7fc830004d50 2024-04-22T01:10:59.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.192+0000 7fc847fff640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8300051d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc840009fc0 tx=0x7fc84001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453c00f3b7d62e80 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:59.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8400b2070 con 0x7fc830004d50 2024-04-22T01:10:59.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400a5cd0 con 0x7fc830004d50 2024-04-22T01:10:59.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc8467fc640 1 -- 172.21.15.110:0/1574086308 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840009c10 con 0x7fc830004d50 2024-04-22T01:10:59.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc84dd2f640 1 -- 172.21.15.110:0/1574086308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 msgr2=0x7fc8300051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:59.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc84dd2f640 1 --2- 172.21.15.110:0/1574086308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8300051d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc840009fc0 tx=0x7fc84001ccc0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc847fff640 1 -- 172.21.15.110:0/1574086308 reap_dead start 2024-04-22T01:10:59.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc84dd2f640 1 -- 172.21.15.110:0/1574086308 shutdown_connections 2024-04-22T01:10:59.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc84dd2f640 1 -- 172.21.15.110:0/1574086308 >> 172.21.15.110:0/1574086308 conn(0x7fc8480cb710 msgr2=0x7fc8480cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:59.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc84dd2f640 1 -- 172.21.15.110:0/1574086308 shutdown_connections 2024-04-22T01:10:59.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.196+0000 7fc84dd2f640 1 -- 172.21.15.110:0/1574086308 wait complete. 2024-04-22T01:10:59.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 Processor -- start 2024-04-22T01:10:59.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 -- start start 2024-04-22T01:10:59.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8481433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8481561e0 0x7fc848150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc848156620 0x7fc84814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc848071c60 con 0x7fc830004d50 2024-04-22T01:10:59.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc848071980 con 0x7fc848156620 2024-04-22T01:10:59.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc84dd2f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc848071f40 con 0x7fc8481561e0 2024-04-22T01:10:59.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc8477fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8481433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:59.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc8477fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8481433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34368/0 (socket says 172.21.15.110:34368) 2024-04-22T01:10:59.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc8477fe640 1 -- 172.21.15.110:0/2975335119 learned_addr learned my addr 172.21.15.110:0/2975335119 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:10:59.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc846ffd640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8481561e0 0x7fc848150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:59.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.200+0000 7fc847fff640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc848156620 0x7fc84814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:59.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.204+0000 7fc8477fe640 1 -- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8481561e0 msgr2=0x7fc848150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:59.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.204+0000 7fc8477fe640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8481561e0 0x7fc848150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.204+0000 7fc8477fe640 1 -- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc848156620 msgr2=0x7fc84814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:59.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.204+0000 7fc8477fe640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc848156620 0x7fc84814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.204+0000 7fc8477fe640 1 -- 172.21.15.110:0/2975335119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc848151750 con 0x7fc830004d50 2024-04-22T01:10:59.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.208+0000 7fc8477fe640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8481433b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c7d0 tx=0x7fc83800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:59.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.212+0000 7fc82ffff640 1 -- 172.21.15.110:0/2975335119 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838018070 con 0x7fc830004d50 2024-04-22T01:10:59.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.212+0000 7fc82ffff640 1 -- 172.21.15.110:0/2975335119 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8380074e0 con 0x7fc830004d50 2024-04-22T01:10:59.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.212+0000 7fc82ffff640 1 -- 172.21.15.110:0/2975335119 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838004a30 con 0x7fc830004d50 2024-04-22T01:10:59.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.212+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8481ed860 con 0x7fc830004d50 2024-04-22T01:10:59.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.212+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8481ede20 con 0x7fc830004d50 2024-04-22T01:10:59.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.212+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84804f510 con 0x7fc830004d50 2024-04-22T01:10:59.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.232+0000 7fc82ffff640 1 -- 172.21.15.110:0/2975335119 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc83801b070 con 0x7fc830004d50 2024-04-22T01:10:59.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.232+0000 7fc82ffff640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc834067940 0x7fc834069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:10:59.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.232+0000 7fc846ffd640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc834067940 0x7fc834069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:10:59.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.232+0000 7fc846ffd640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc834067940 0x7fc834069e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0093f0 tx=0x7fc83c0094c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:10:59.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.236+0000 7fc82ffff640 1 -- 172.21.15.110:0/2975335119 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc838053d10 con 0x7fc830004d50 2024-04-22T01:10:59.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.516+0000 7fc82ffff640 1 -- 172.21.15.110:0/2975335119 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fc838022020 con 0x7fc830004d50 2024-04-22T01:10:59.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.688+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8480cbd70 con 0x7fc830004d50 2024-04-22T01:10:59.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.836+0000 7fc82ffff640 1 -- 172.21.15.110:0/2975335119 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16682 (secure 0 0 0) 0x7fc838055c70 con 0x7fc830004d50 2024-04-22T01:10:59.837 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:10:59.837 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:54:44.154650+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T01:10:59.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc834067940 msgr2=0x7fc834069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:59.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc834067940 0x7fc834069e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0093f0 tx=0x7fc83c0094c0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 msgr2=0x7fc8481433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8481433b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c7d0 tx=0x7fc83800cc90 comp rx=0 tx=0).stop 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 shutdown_connections 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc834067940 0x7fc834069e00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc848156620 0x7fc84814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8481561e0 0x7fc848150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 --2- 172.21.15.110:0/2975335119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc830004d50 0x7fc8481433b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 >> 172.21.15.110:0/2975335119 conn(0x7fc8480cb710 msgr2=0x7fc8480ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 shutdown_connections 2024-04-22T01:10:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:10:59.840+0000 7fc84dd2f640 1 -- 172.21.15.110:0/2975335119 wait complete. 2024-04-22T01:11:00.864 INFO:tasks.ceph:Scrubbing osd.0 2024-04-22T01:11:00.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:01.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.000+0000 7fc5f14fa640 1 Processor -- start 2024-04-22T01:11:01.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.000+0000 7fc5f14fa640 1 -- start start 2024-04-22T01:11:01.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.000+0000 7fc5f14fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc5ec150b90 0x7fc5ec0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.000+0000 7fc5f14fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5ec0c6650 0x7fc5ec160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.000+0000 7fc5f14fa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5ec0c7950 con 0x7fc5ec0c7da0 2024-04-22T01:11:01.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.000+0000 7fc5f14fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc5ec15abf0 con 0x7fc5ec150b90 2024-04-22T01:11:01.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.000+0000 7fc5f14fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ec0c59d0 con 0x7fc5ec0c6650 2024-04-22T01:11:01.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.004+0000 7fc5eaffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc5ec150b90 0x7fc5ec0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.004+0000 7fc5ea7fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc5ec0c7da0 0x7fc5ec06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60524/0 (socket says 172.21.15.110:60524) 2024-04-22T01:11:01.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.004+0000 7fc5ea7fc640 1 -- 172.21.15.110:0/873442469 learned_addr learned my addr 172.21.15.110:0/873442469 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:01.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.008+0000 7fc5eaffd640 1 -- 172.21.15.110:0/873442469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5ec0c6650 msgr2=0x7fc5ec160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.008+0000 7fc5eaffd640 1 --2- 172.21.15.110:0/873442469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5ec0c6650 0x7fc5ec160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.008+0000 7fc5eaffd640 1 -- 172.21.15.110:0/873442469 >> v1:172.21.15.110:6789/0 conn(0x7fc5ec0c7da0 legacy=0x7fc5ec06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.008+0000 7fc5eaffd640 1 -- 172.21.15.110:0/873442469 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec159e30 con 0x7fc5ec150b90 2024-04-22T01:11:01.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.012+0000 7fc5eaffd640 1 --2- 172.21.15.110:0/873442469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec0c6110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009d90 tx=0x7fc5dc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1f3ad41c23a76 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:01.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5e9ffb640 1 -- 172.21.15.110:0/873442469 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0b4070 con 0x7fc5ec150b90 2024-04-22T01:11:01.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5e9ffb640 1 -- 172.21.15.110:0/873442469 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc0af600 con 0x7fc5ec150b90 2024-04-22T01:11:01.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5e9ffb640 1 -- 172.21.15.110:0/873442469 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0af9d0 con 0x7fc5ec150b90 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 -- 172.21.15.110:0/873442469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 msgr2=0x7fc5ec0c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 --2- 172.21.15.110:0/873442469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec0c6110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009d90 tx=0x7fc5dc01f150 comp rx=0 tx=0).stop 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 -- 172.21.15.110:0/873442469 shutdown_connections 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 --2- 172.21.15.110:0/873442469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5ec0c6650 0x7fc5ec160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 --2- 172.21.15.110:0/873442469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec0c6110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 -- 172.21.15.110:0/873442469 >> 172.21.15.110:0/873442469 conn(0x7fc5ec06b1e0 msgr2=0x7fc5ec06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 -- 172.21.15.110:0/873442469 shutdown_connections 2024-04-22T01:11:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 -- 172.21.15.110:0/873442469 wait complete. 2024-04-22T01:11:01.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 Processor -- start 2024-04-22T01:11:01.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.020+0000 7fc5f14fa640 1 -- start start 2024-04-22T01:11:01.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5f14fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5ec0c6650 0x7fc5ec0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5f14fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5ec0c7da0 0x7fc5ec072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5f14fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec1454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5f14fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec15a6d0 con 0x7fc5ec150b90 2024-04-22T01:11:01.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5f14fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec15a3f0 con 0x7fc5ec0c7da0 2024-04-22T01:11:01.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5f14fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ec06f5f0 con 0x7fc5ec0c6650 2024-04-22T01:11:01.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5eb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec1454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5eb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec1454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34384/0 (socket says 172.21.15.110:34384) 2024-04-22T01:11:01.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.024+0000 7fc5eb7fe640 1 -- 172.21.15.110:0/1447271682 learned_addr learned my addr 172.21.15.110:0/1447271682 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.028+0000 7fc5eb7fe640 1 -- 172.21.15.110:0/1447271682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5ec0c6650 msgr2=0x7fc5ec0cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.028+0000 7fc5eb7fe640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5ec0c6650 0x7fc5ec0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.028+0000 7fc5eb7fe640 1 -- 172.21.15.110:0/1447271682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5ec0c7da0 msgr2=0x7fc5ec072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.028+0000 7fc5eb7fe640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5ec0c7da0 0x7fc5ec072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.028+0000 7fc5eb7fe640 1 -- 172.21.15.110:0/1447271682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec0cc040 con 0x7fc5ec150b90 2024-04-22T01:11:01.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.028+0000 7fc5eb7fe640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec1454e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400b430 tx=0x7fc5e400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:01.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.032+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4015020 con 0x7fc5ec150b90 2024-04-22T01:11:01.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.032+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e4011830 con 0x7fc5ec150b90 2024-04-22T01:11:01.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.032+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4011c20 con 0x7fc5ec150b90 2024-04-22T01:11:01.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.032+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ec0cc2b0 con 0x7fc5ec150b90 2024-04-22T01:11:01.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.032+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ec1433a0 con 0x7fc5ec150b90 2024-04-22T01:11:01.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.036+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5ec0c28a0 con 0x7fc5ec150b90 2024-04-22T01:11:01.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.056+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc5e4018020 con 0x7fc5ec150b90 2024-04-22T01:11:01.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.056+0000 7fc5d37fe640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc5d8067940 0x7fc5d8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.056+0000 7fc5eaffd640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc5d8067940 0x7fc5d8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.056+0000 7fc5eaffd640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc5d8067940 0x7fc5d8069e00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0b1000 tx=0x7fc5dc004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:01.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.060+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc5e40547c0 con 0x7fc5ec150b90 2024-04-22T01:11:01.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.060+0000 7fc5d37fe640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fc5d806fb40 0x7fc5d8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.060+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 --> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5e4006830 con 0x7fc5d806fb40 2024-04-22T01:11:01.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.060+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc5e40529c0 con 0x7fc5ec150b90 2024-04-22T01:11:01.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.060+0000 7fc5ea7fc640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fc5d806fb40 0x7fc5d8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.060+0000 7fc5ea7fc640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fc5d806fb40 0x7fc5d8071f60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:01.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.060+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== osd.0 v2:172.21.15.110:6826/2616906515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5e4006830 con 0x7fc5d806fb40 2024-04-22T01:11:01.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 --> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc5ec04f5f0 con 0x7fc5d806fb40 2024-04-22T01:11:01.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5d37fe640 1 -- 172.21.15.110:0/1447271682 <== osd.0 v2:172.21.15.110:6826/2616906515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc5ec04f5f0 con 0x7fc5d806fb40 2024-04-22T01:11:01.075 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:01.075 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:01.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fc5d806fb40 msgr2=0x7fc5d8071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6826/2616906515,v1:172.21.15.110:6827/2616906515] conn(0x7fc5d806fb40 0x7fc5d8071f60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc5d8067940 msgr2=0x7fc5d8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fc5d8067940 0x7fc5d8069e00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0b1000 tx=0x7fc5dc004ac0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 msgr2=0x7fc5ec1454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 --2- 172.21.15.110:0/1447271682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5ec150b90 0x7fc5ec1454e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400b430 tx=0x7fc5e400b8f0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5eb7fe640 1 -- 172.21.15.110:0/1447271682 reap_dead start 2024-04-22T01:11:01.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 shutdown_connections 2024-04-22T01:11:01.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 >> 172.21.15.110:0/1447271682 conn(0x7fc5ec06b1e0 msgr2=0x7fc5ec14fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:01.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 shutdown_connections 2024-04-22T01:11:01.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.076+0000 7fc5f14fa640 1 -- 172.21.15.110:0/1447271682 wait complete. 2024-04-22T01:11:01.092 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-22T01:11:01.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54f1005640 1 Processor -- start 2024-04-22T01:11:01.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54f1005640 1 -- start start 2024-04-22T01:11:01.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54f1005640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec152560 0x7f54ec0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54f1005640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54ec072460 0x7f54ec158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54f1005640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec0c6110 con 0x7f54ec152180 2024-04-22T01:11:01.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54f1005640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f54ec1592e0 con 0x7f54ec072460 2024-04-22T01:11:01.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54f1005640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec0716c0 con 0x7f54ec152560 2024-04-22T01:11:01.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54ead9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f54ec152180 0x7f54ec06fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60526/0 (socket says 172.21.15.110:60526) 2024-04-22T01:11:01.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54ead9d640 1 -- 172.21.15.110:0/2935750782 learned_addr learned my addr 172.21.15.110:0/2935750782 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:01.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2935750782 >> v2:172.21.15.154:3300/0 conn(0x7f54ec072460 0x7f54ec158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.212+0000 7f54e259c640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec152560 0x7f54ec0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593019789 0 0) 0x7f54ec0c6110 con 0x7f54ec152180 2024-04-22T01:11:01.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d8003530 con 0x7f54ec152180 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1267834429 0 0) 0x7f54d8003530 con 0x7f54ec152180 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec152560 msgr2=0x7f54ec0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec152560 0x7f54ec0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 >> v2:172.21.15.154:3300/0 conn(0x7f54ec072460 msgr2=0x7f54ec158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 --2- 172.21.15.110:0/2935750782 >> v2:172.21.15.154:3300/0 conn(0x7f54ec072460 0x7f54ec158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec0c63d0 con 0x7f54ec152180 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.216+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f54dc001680 con 0x7f54ec152180 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 >> v1:172.21.15.110:6789/0 conn(0x7f54ec152180 legacy=0x7f54ec06fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54ea59c640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec152560 0x7f54d80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54ea59c640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8003f90 0x7f54d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54ea59c640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54d8004d50 0x7f54d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1592e0 con 0x7f54d8004d50 2024-04-22T01:11:01.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec0716c0 con 0x7f54d8003f90 2024-04-22T01:11:01.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f54d800ba50 con 0x7f54ec152560 2024-04-22T01:11:01.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.220+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54d8004d50 0x7f54d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.224+0000 7f54eb59e640 1 -- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec152560 msgr2=0x7f54d80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.224+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec152560 0x7f54d80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.224+0000 7f54eb59e640 1 -- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8003f90 msgr2=0x7f54d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.224+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8003f90 0x7f54d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.224+0000 7f54eb59e640 1 -- 172.21.15.110:0/2935750782 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d8003530 con 0x7f54d8004d50 2024-04-22T01:11:01.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.228+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54d8004d50 0x7f54d80051d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009fc0 tx=0x7f54e401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ba17e73009d66c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:01.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e40b2070 con 0x7f54d8004d50 2024-04-22T01:11:01.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e40a5cd0 con 0x7f54d8004d50 2024-04-22T01:11:01.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54ea59c640 1 -- 172.21.15.110:0/2935750782 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4009c10 con 0x7f54d8004d50 2024-04-22T01:11:01.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- 172.21.15.110:0/2935750782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54d8004d50 msgr2=0x7f54d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 --2- 172.21.15.110:0/2935750782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54d8004d50 0x7f54d80051d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009fc0 tx=0x7f54e401ccc0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54eb59e640 1 -- 172.21.15.110:0/2935750782 reap_dead start 2024-04-22T01:11:01.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- 172.21.15.110:0/2935750782 shutdown_connections 2024-04-22T01:11:01.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- 172.21.15.110:0/2935750782 >> 172.21.15.110:0/2935750782 conn(0x7f54ec0cb710 msgr2=0x7f54ec0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:01.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- 172.21.15.110:0/2935750782 shutdown_connections 2024-04-22T01:11:01.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- 172.21.15.110:0/2935750782 wait complete. 2024-04-22T01:11:01.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 Processor -- start 2024-04-22T01:11:01.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- start start 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8004d50 0x7f54ec1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec15b930 0x7f54ec15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec154f80 0x7f54ec15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec071c60 con 0x7f54ec154f80 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec071980 con 0x7f54d8004d50 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.232+0000 7f54f1005640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec071f40 con 0x7f54ec15b930 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec154f80 0x7f54ec15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec154f80 0x7f54ec15a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34402/0 (socket says 172.21.15.110:34402) 2024-04-22T01:11:01.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 -- 172.21.15.110:0/2541226753 learned_addr learned my addr 172.21.15.110:0/2541226753 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:01.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54e259c640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec15b930 0x7f54ec15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54ead9d640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8004d50 0x7f54ec1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 -- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec15b930 msgr2=0x7f54ec15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec15b930 0x7f54ec15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 -- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8004d50 msgr2=0x7f54ec1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8004d50 0x7f54ec1546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.236+0000 7f54eb59e640 1 -- 172.21.15.110:0/2541226753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec15c5c0 con 0x7f54ec154f80 2024-04-22T01:11:01.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.240+0000 7f54eb59e640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec154f80 0x7f54ec15a670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54e40987f0 tx=0x7f54e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:01.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.244+0000 7f54e3fff640 1 -- 172.21.15.110:0/2541226753 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e40b2040 con 0x7f54ec154f80 2024-04-22T01:11:01.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.244+0000 7f54e3fff640 1 -- 172.21.15.110:0/2541226753 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e40a5ad0 con 0x7f54ec154f80 2024-04-22T01:11:01.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.244+0000 7f54e3fff640 1 -- 172.21.15.110:0/2541226753 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4009c10 con 0x7f54ec154f80 2024-04-22T01:11:01.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.244+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec068600 con 0x7f54ec154f80 2024-04-22T01:11:01.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.244+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec155590 con 0x7f54ec154f80 2024-04-22T01:11:01.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.244+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ec0c7040 con 0x7f54ec154f80 2024-04-22T01:11:01.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.532+0000 7f54e3fff640 1 -- 172.21.15.110:0/2541226753 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54e40039a0 con 0x7f54ec154f80 2024-04-22T01:11:01.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.532+0000 7f54e3fff640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f54cc067940 0x7f54cc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.532+0000 7f54ead9d640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f54cc067940 0x7f54cc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.536+0000 7f54ead9d640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f54cc067940 0x7f54cc069e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f54dc001060 tx=0x7f54dc001ab0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:01.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.572+0000 7f54e3fff640 1 -- 172.21.15.110:0/2541226753 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f54e40ef3a0 con 0x7f54ec154f80 2024-04-22T01:11:01.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.572+0000 7f54e3fff640 1 -- 172.21.15.110:0/2541226753 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f54e40c8080 con 0x7f54ec154f80 2024-04-22T01:11:01.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.752+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f54ec1ede60 con 0x7f54cc067940 2024-04-22T01:11:01.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.752+0000 7f54e3fff640 1 -- 172.21.15.110:0/2541226753 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f54dc00f9a0 con 0x7f54cc067940 2024-04-22T01:11:01.753 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 0 to deep-scrub 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f54cc067940 msgr2=0x7f54cc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f54cc067940 0x7f54cc069e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f54dc001060 tx=0x7f54dc001ab0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec154f80 msgr2=0x7f54ec15a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec154f80 0x7f54ec15a670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54e40987f0 tx=0x7f54e4009750 comp rx=0 tx=0).stop 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 shutdown_connections 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f54cc067940 0x7f54cc069e00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec154f80 0x7f54ec15a670 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ec15b930 0x7f54ec15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 --2- 172.21.15.110:0/2541226753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54d8004d50 0x7f54ec1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 >> 172.21.15.110:0/2541226753 conn(0x7f54ec0cb710 msgr2=0x7f54ec0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:01.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 shutdown_connections 2024-04-22T01:11:01.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.756+0000 7f54f1005640 1 -- 172.21.15.110:0/2541226753 wait complete. 2024-04-22T01:11:01.772 INFO:tasks.ceph:Scrubbing osd.1 2024-04-22T01:11:01.772 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:01.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.896+0000 7f0b50eb2640 1 Processor -- start 2024-04-22T01:11:01.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.896+0000 7f0b50eb2640 1 -- start start 2024-04-22T01:11:01.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.896+0000 7f0b50eb2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b4c159530 0x7f0b4c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.896+0000 7f0b50eb2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c0c2a50 con 0x7f0b4c15b630 2024-04-22T01:11:01.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.896+0000 7f0b50eb2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c0ce890 con 0x7f0b4c1522d0 2024-04-22T01:11:01.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.896+0000 7f0b50eb2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4c15bf10 con 0x7f0b4c159530 2024-04-22T01:11:01.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.972+0000 7f0b4ad9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0b4c15b630 0x7f0b4c0713a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60538/0 (socket says 172.21.15.110:60538) 2024-04-22T01:11:01.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.972+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/1605360979 learned_addr learned my addr 172.21.15.110:0/1605360979 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:01.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.976+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781626253 0 0) 0x7f0b4c0c2a50 con 0x7f0b4c15b630 2024-04-22T01:11:01.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.976+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b38003530 con 0x7f0b4c15b630 2024-04-22T01:11:01.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.980+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4114034241 0 0) 0x7f0b38003530 con 0x7f0b4c15b630 2024-04-22T01:11:01.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 >> v2:172.21.15.154:3300/0 conn(0x7f0b4c159530 msgr2=0x7f0b4c158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 --2- 172.21.15.110:0/1605360979 >> v2:172.21.15.154:3300/0 conn(0x7f0b4c159530 0x7f0b4c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 >> v1:172.21.15.154:6789/0 conn(0x7f0b4c1522d0 legacy=0x7f0b4c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c15c1f0 con 0x7f0b4c15b630 2024-04-22T01:11:01.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f0b44001a00 con 0x7f0b4c15b630 2024-04-22T01:11:01.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 >> v1:172.21.15.110:6789/0 conn(0x7f0b4c15b630 legacy=0x7f0b4c0713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:01.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38003a10 0x7f0b38003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38004810 0x7f0b38004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380052f0 0x7f0b3800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:01.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c15bf10 con 0x7f0b380052f0 2024-04-22T01:11:01.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3800c230 con 0x7f0b38004810 2024-04-22T01:11:01.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.984+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3800c430 con 0x7f0b38003a10 2024-04-22T01:11:01.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.988+0000 7f0b49d9b640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38004810 0x7f0b38004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.988+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380052f0 0x7f0b3800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:01.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.992+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/1605360979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38003a10 msgr2=0x7f0b38003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.992+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38003a10 0x7f0b38003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.992+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/1605360979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38004810 msgr2=0x7f0b38004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:01.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.992+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38004810 0x7f0b38004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:01.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:01.996+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/1605360979 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b38003530 con 0x7f0b380052f0 2024-04-22T01:11:01.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.000+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/1605360979 reap_dead start 2024-04-22T01:11:02.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.004+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380052f0 0x7f0b3800b9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400a760 tx=0x7f0b4401d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58970e3667f160b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:02.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400a3b0 con 0x7f0b380052f0 2024-04-22T01:11:02.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b440ac640 con 0x7f0b380052f0 2024-04-22T01:11:02.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b4959a640 1 -- 172.21.15.110:0/1605360979 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440aca30 con 0x7f0b380052f0 2024-04-22T01:11:02.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b50eb2640 1 -- 172.21.15.110:0/1605360979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380052f0 msgr2=0x7f0b3800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b50eb2640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380052f0 0x7f0b3800b9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400a760 tx=0x7f0b4401d280 comp rx=0 tx=0).stop 2024-04-22T01:11:02.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b50eb2640 1 -- 172.21.15.110:0/1605360979 shutdown_connections 2024-04-22T01:11:02.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b50eb2640 1 --2- 172.21.15.110:0/1605360979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380052f0 0x7f0b3800b9d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b50eb2640 1 -- 172.21.15.110:0/1605360979 >> 172.21.15.110:0/1605360979 conn(0x7f0b4c06b7e0 msgr2=0x7f0b4c06f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:02.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b50eb2640 1 -- 172.21.15.110:0/1605360979 shutdown_connections 2024-04-22T01:11:02.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.016+0000 7f0b50eb2640 1 -- 172.21.15.110:0/1605360979 wait complete. 2024-04-22T01:11:02.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 Processor -- start 2024-04-22T01:11:02.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 -- start start 2024-04-22T01:11:02.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b380052f0 0x7f0b4c150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b4c150fc0 0x7f0b4c1e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b4c1513e0 0x7f0b4c1e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c1526b0 con 0x7f0b4c1513e0 2024-04-22T01:11:02.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c15c4d0 con 0x7f0b380052f0 2024-04-22T01:11:02.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.020+0000 7f0b50eb2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c152830 con 0x7f0b4c150fc0 2024-04-22T01:11:02.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.024+0000 7f0b4a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b380052f0 0x7f0b4c150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.024+0000 7f0b49d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b4c150fc0 0x7f0b4c1e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.024+0000 7f0b49d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b4c150fc0 0x7f0b4c1e5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:38986/0 (socket says 172.21.15.110:38986) 2024-04-22T01:11:02.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.024+0000 7f0b49d9b640 1 -- 172.21.15.110:0/3097850691 learned_addr learned my addr 172.21.15.110:0/3097850691 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:02.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.028+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b4c1513e0 0x7f0b4c1e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.032+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/3097850691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b4c150fc0 msgr2=0x7f0b4c1e5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.032+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b4c150fc0 0x7f0b4c1e5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.032+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/3097850691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b380052f0 msgr2=0x7f0b4c150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.032+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b380052f0 0x7f0b4c150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.032+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/3097850691 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c0c69a0 con 0x7f0b4c1513e0 2024-04-22T01:11:02.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.036+0000 7f0b4ad9d640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b4c1513e0 0x7f0b4c1e5fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ce2b0 tx=0x7f0b38005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.040+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004d70 con 0x7f0b4c1513e0 2024-04-22T01:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.040+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b440019d0 con 0x7f0b4c1513e0 2024-04-22T01:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.040+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c0c71b0 con 0x7f0b4c1513e0 2024-04-22T01:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.040+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440aca10 con 0x7f0b4c1513e0 2024-04-22T01:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.040+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c150d40 con 0x7f0b4c1513e0 2024-04-22T01:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.040+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b4c0685b0 con 0x7f0b4c1513e0 2024-04-22T01:11:02.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b440ac4e0 con 0x7f0b4c1513e0 2024-04-22T01:11:02.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b42ffd640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0b2c067910 0x7f0b2c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b4a59c640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0b2c067910 0x7f0b2c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b4a59c640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0b2c067910 0x7f0b2c069dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0b34007fd0 tx=0x7f0b34009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0b440eeb00 con 0x7f0b4c1513e0 2024-04-22T01:11:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b42ffd640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7f0b2c06fb70 0x7f0b2c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 --> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b44008e50 con 0x7f0b2c06fb70 2024-04-22T01:11:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.064+0000 7f0b49d9b640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7f0b2c06fb70 0x7f0b2c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.068+0000 7f0b49d9b640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7f0b2c06fb70 0x7f0b2c071f90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:02.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.068+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== osd.1 v2:172.21.15.110:6810/3951369001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b44008e50 con 0x7f0b2c06fb70 2024-04-22T01:11:02.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.072+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0b440ecd00 con 0x7f0b4c1513e0 2024-04-22T01:11:02.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.080+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 --> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0b4c0ce760 con 0x7f0b2c06fb70 2024-04-22T01:11:02.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b42ffd640 1 -- 172.21.15.110:0/3097850691 <== osd.1 v2:172.21.15.110:6810/3951369001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0b4c0ce760 con 0x7f0b2c06fb70 2024-04-22T01:11:02.082 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:02.082 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:02.082 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:02.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7f0b2c06fb70 msgr2=0x7f0b2c071f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6810/3951369001,v1:172.21.15.110:6811/3951369001] conn(0x7f0b2c06fb70 0x7f0b2c071f90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0b2c067910 msgr2=0x7f0b2c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f0b2c067910 0x7f0b2c069dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0b34007fd0 tx=0x7f0b34009040 comp rx=0 tx=0).stop 2024-04-22T01:11:02.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b4c1513e0 msgr2=0x7f0b4c1e5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 --2- 172.21.15.110:0/3097850691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b4c1513e0 0x7f0b4c1e5fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ce2b0 tx=0x7f0b38005840 comp rx=0 tx=0).stop 2024-04-22T01:11:02.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b4ad9d640 1 -- 172.21.15.110:0/3097850691 reap_dead start 2024-04-22T01:11:02.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 shutdown_connections 2024-04-22T01:11:02.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 >> 172.21.15.110:0/3097850691 conn(0x7f0b4c06b7e0 msgr2=0x7f0b4c0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:02.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 shutdown_connections 2024-04-22T01:11:02.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.084+0000 7f0b50eb2640 1 -- 172.21.15.110:0/3097850691 wait complete. 2024-04-22T01:11:02.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-22T01:11:02.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1c913640 1 Processor -- start 2024-04-22T01:11:02.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1c913640 1 -- start start 2024-04-22T01:11:02.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1c913640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e18151200 0x7f3e180c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1c913640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e181515e0 0x7f3e181578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1c913640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e18071770 con 0x7f3e18071980 2024-04-22T01:11:02.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1c913640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3e18157420 con 0x7f3e18151200 2024-04-22T01:11:02.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1c913640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3e18072b50 con 0x7f3e181515e0 2024-04-22T01:11:02.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e1659c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e18151200 0x7f3e180c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e16d9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3e18071980 0x7f3e180c81a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60544/0 (socket says 172.21.15.110:60544) 2024-04-22T01:11:02.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e16d9d640 1 -- 172.21.15.110:0/4092964213 learned_addr learned my addr 172.21.15.110:0/4092964213 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:02.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.232+0000 7f3e15d9b640 1 --2- 172.21.15.110:0/4092964213 >> v2:172.21.15.154:3300/0 conn(0x7f3e181515e0 0x7f3e181578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.236+0000 7f3e1659c640 1 -- 172.21.15.110:0/4092964213 >> v2:172.21.15.154:3300/0 conn(0x7f3e181515e0 msgr2=0x7f3e181578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:02.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.236+0000 7f3e1659c640 1 --2- 172.21.15.110:0/4092964213 >> v2:172.21.15.154:3300/0 conn(0x7f3e181515e0 0x7f3e181578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.236+0000 7f3e1659c640 1 -- 172.21.15.110:0/4092964213 >> v1:172.21.15.110:6789/0 conn(0x7f3e18071980 legacy=0x7f3e180c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.236+0000 7f3e1659c640 1 -- 172.21.15.110:0/4092964213 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e180c7f40 con 0x7f3e18151200 2024-04-22T01:11:02.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.244+0000 7f3e1659c640 1 --2- 172.21.15.110:0/4092964213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18151200 0x7f3e180c7a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e180c8ca0 tx=0x7f3e0801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6448589602400c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1559a640 1 -- 172.21.15.110:0/4092964213 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080b1070 con 0x7f3e18151200 2024-04-22T01:11:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1559a640 1 -- 172.21.15.110:0/4092964213 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080ac5f0 con 0x7f3e18151200 2024-04-22T01:11:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1559a640 1 -- 172.21.15.110:0/4092964213 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080ac9c0 con 0x7f3e18151200 2024-04-22T01:11:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 -- 172.21.15.110:0/4092964213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18151200 msgr2=0x7f3e180c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 --2- 172.21.15.110:0/4092964213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18151200 0x7f3e180c7a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e180c8ca0 tx=0x7f3e0801c480 comp rx=0 tx=0).stop 2024-04-22T01:11:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 -- 172.21.15.110:0/4092964213 shutdown_connections 2024-04-22T01:11:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 --2- 172.21.15.110:0/4092964213 >> v2:172.21.15.154:3300/0 conn(0x7f3e181515e0 0x7f3e181578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 --2- 172.21.15.110:0/4092964213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18151200 0x7f3e180c7a00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 -- 172.21.15.110:0/4092964213 >> 172.21.15.110:0/4092964213 conn(0x7f3e180cb710 msgr2=0x7f3e180cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:02.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 -- 172.21.15.110:0/4092964213 shutdown_connections 2024-04-22T01:11:02.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 -- 172.21.15.110:0/4092964213 wait complete. 2024-04-22T01:11:02.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 Processor -- start 2024-04-22T01:11:02.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.248+0000 7f3e1c913640 1 -- start start 2024-04-22T01:11:02.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1c913640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18071980 0x7f3e180ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1c913640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e18151200 0x7f3e1813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1c913640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e181515e0 0x7f3e1813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1c913640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3e180c8a30 con 0x7f3e18071980 2024-04-22T01:11:02.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1c913640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e180c88b0 con 0x7f3e181515e0 2024-04-22T01:11:02.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1c913640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3e18164390 con 0x7f3e18151200 2024-04-22T01:11:02.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18071980 0x7f3e180ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18071980 0x7f3e180ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34446/0 (socket says 172.21.15.110:34446) 2024-04-22T01:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e1659c640 1 -- 172.21.15.110:0/1732848486 learned_addr learned my addr 172.21.15.110:0/1732848486 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e16d9d640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e181515e0 0x7f3e1813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.252+0000 7f3e15d9b640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e18151200 0x7f3e1813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.256+0000 7f3e1659c640 1 -- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e18151200 msgr2=0x7f3e1813fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.256+0000 7f3e1659c640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e18151200 0x7f3e1813fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.256+0000 7f3e1659c640 1 -- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e181515e0 msgr2=0x7f3e1813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.256+0000 7f3e1659c640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e181515e0 0x7f3e1813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.256+0000 7f3e1659c640 1 -- 172.21.15.110:0/1732848486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e181f49b0 con 0x7f3e18071980 2024-04-22T01:11:02.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.256+0000 7f3e1659c640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18071980 0x7f3e180ca420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e0801ab30 tx=0x7f3e08019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:02.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.260+0000 7f3e06ffd640 1 -- 172.21.15.110:0/1732848486 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080b1040 con 0x7f3e18071980 2024-04-22T01:11:02.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.260+0000 7f3e06ffd640 1 -- 172.21.15.110:0/1732848486 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080ba070 con 0x7f3e18071980 2024-04-22T01:11:02.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.260+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e181f4c90 con 0x7f3e18071980 2024-04-22T01:11:02.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.260+0000 7f3e06ffd640 1 -- 172.21.15.110:0/1732848486 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080b5650 con 0x7f3e18071980 2024-04-22T01:11:02.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.260+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e181f5250 con 0x7f3e18071980 2024-04-22T01:11:02.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.264+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1804f510 con 0x7f3e18071980 2024-04-22T01:11:02.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.284+0000 7f3e06ffd640 1 -- 172.21.15.110:0/1732848486 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e080b57f0 con 0x7f3e18071980 2024-04-22T01:11:02.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.284+0000 7f3e06ffd640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3df8067910 0x7f3df8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.284+0000 7f3e15d9b640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3df8067910 0x7f3df8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:02.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.284+0000 7f3e15d9b640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3df8067910 0x7f3df8069dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3e181445a0 tx=0x7f3e0c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:02.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.284+0000 7f3e06ffd640 1 -- 172.21.15.110:0/1732848486 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3e080ee9b0 con 0x7f3e18071980 2024-04-22T01:11:02.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.648+0000 7f3e06ffd640 1 -- 172.21.15.110:0/1732848486 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f3e080c4020 con 0x7f3e18071980 2024-04-22T01:11:02.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.820+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3e180c8430 con 0x7f3df8067910 2024-04-22T01:11:02.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.820+0000 7f3e06ffd640 1 -- 172.21.15.110:0/1732848486 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3e180c8430 con 0x7f3df8067910 2024-04-22T01:11:02.821 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 1 to deep-scrub 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3df8067910 msgr2=0x7f3df8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3df8067910 0x7f3df8069dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3e181445a0 tx=0x7f3e0c009190 comp rx=0 tx=0).stop 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18071980 msgr2=0x7f3e180ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18071980 0x7f3e180ca420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e0801ab30 tx=0x7f3e08019220 comp rx=0 tx=0).stop 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 shutdown_connections 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3df8067910 0x7f3df8069dd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e181515e0 0x7f3e1813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e18151200 0x7f3e1813fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 --2- 172.21.15.110:0/1732848486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e18071980 0x7f3e180ca420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 >> 172.21.15.110:0/1732848486 conn(0x7f3e180cb710 msgr2=0x7f3e180c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 shutdown_connections 2024-04-22T01:11:02.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.824+0000 7f3e1c913640 1 -- 172.21.15.110:0/1732848486 wait complete. 2024-04-22T01:11:02.841 INFO:tasks.ceph:Scrubbing osd.2 2024-04-22T01:11:02.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:02.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.968+0000 7f6cc556b640 1 Processor -- start 2024-04-22T01:11:02.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.968+0000 7f6cc556b640 1 -- start start 2024-04-22T01:11:02.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.968+0000 7f6cc556b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6cc00c7a10 0x7f6cc0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.968+0000 7f6cc556b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc00c3570 0x7f6cc015a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:02.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.968+0000 7f6cc556b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc006c870 con 0x7f6cc0150ba0 2024-04-22T01:11:02.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.968+0000 7f6cc556b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc00c7580 con 0x7f6cc00c7a10 2024-04-22T01:11:02.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:02.968+0000 7f6cc556b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc00c6c50 con 0x7f6cc00c3570 2024-04-22T01:11:03.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.068+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc00c3570 0x7f6cc015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.068+0000 7f6cbeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6cc0150ba0 0x7f6cc00c5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:57788/0 (socket says 172.21.15.110:57788) 2024-04-22T01:11:03.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.068+0000 7f6cbeffd640 1 -- 172.21.15.110:0/4137061866 learned_addr learned my addr 172.21.15.110:0/4137061866 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.072+0000 7f6cb7fff640 1 --2- 172.21.15.110:0/4137061866 >> v2:172.21.15.154:3300/0 conn(0x7f6cc00c7a10 0x7f6cc0159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.080+0000 7f6cb7fff640 1 -- 172.21.15.110:0/4137061866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc00c3570 msgr2=0x7f6cc015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:03.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.080+0000 7f6cb7fff640 1 --2- 172.21.15.110:0/4137061866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc00c3570 0x7f6cc015a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.080+0000 7f6cb7fff640 1 -- 172.21.15.110:0/4137061866 >> v1:172.21.15.154:6789/0 conn(0x7f6cc0150ba0 legacy=0x7f6cc00c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.080+0000 7f6cb7fff640 1 -- 172.21.15.110:0/4137061866 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc00c6f30 con 0x7f6cc00c7a10 2024-04-22T01:11:03.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.092+0000 7f6cb7fff640 1 --2- 172.21.15.110:0/4137061866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 0x7f6cc0159f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80097c0 tx=0x7f6ca801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bac56aab02bf310 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:03.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.108+0000 7f6cbe7fc640 1 -- 172.21.15.110:0/4137061866 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80b5070 con 0x7f6cc00c7a10 2024-04-22T01:11:03.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.108+0000 7f6cbe7fc640 1 -- 172.21.15.110:0/4137061866 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca80a8990 con 0x7f6cc00c7a10 2024-04-22T01:11:03.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.108+0000 7f6cbe7fc640 1 -- 172.21.15.110:0/4137061866 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80a8d60 con 0x7f6cc00c7a10 2024-04-22T01:11:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 -- 172.21.15.110:0/4137061866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 msgr2=0x7f6cc0159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 --2- 172.21.15.110:0/4137061866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 0x7f6cc0159f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80097c0 tx=0x7f6ca801ec90 comp rx=0 tx=0).stop 2024-04-22T01:11:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 -- 172.21.15.110:0/4137061866 shutdown_connections 2024-04-22T01:11:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 --2- 172.21.15.110:0/4137061866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc00c3570 0x7f6cc015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 --2- 172.21.15.110:0/4137061866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 0x7f6cc0159f20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 -- 172.21.15.110:0/4137061866 >> 172.21.15.110:0/4137061866 conn(0x7f6cc00cc070 msgr2=0x7f6cc00cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 -- 172.21.15.110:0/4137061866 shutdown_connections 2024-04-22T01:11:03.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 -- 172.21.15.110:0/4137061866 wait complete. 2024-04-22T01:11:03.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 Processor -- start 2024-04-22T01:11:03.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.112+0000 7f6cc556b640 1 -- start start 2024-04-22T01:11:03.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.116+0000 7f6cc556b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc00c3570 0x7f6cc00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.116+0000 7f6cc556b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 0x7f6cc014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.116+0000 7f6cc556b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0150ba0 0x7f6cc013a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.116+0000 7f6cc556b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc006c620 con 0x7f6cc00c3570 2024-04-22T01:11:03.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.116+0000 7f6cc556b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc006c4a0 con 0x7f6cc00c7a10 2024-04-22T01:11:03.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.116+0000 7f6cc556b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc00ccb60 con 0x7f6cc0150ba0 2024-04-22T01:11:03.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.116+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0150ba0 0x7f6cc013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.128+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 0x7f6cc014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.128+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 0x7f6cc014b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:50054/0 (socket says 172.21.15.110:50054) 2024-04-22T01:11:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.128+0000 7f6cb7fff640 1 -- 172.21.15.110:0/4206591825 learned_addr learned my addr 172.21.15.110:0/4206591825 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:03.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.164+0000 7f6cbeffd640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc00c3570 0x7f6cc00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.176+0000 7f6cbeffd640 1 -- 172.21.15.110:0/4206591825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0150ba0 msgr2=0x7f6cc013a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.176+0000 7f6cbeffd640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0150ba0 0x7f6cc013a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.176+0000 7f6cbeffd640 1 -- 172.21.15.110:0/4206591825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 msgr2=0x7f6cc014b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.176+0000 7f6cbeffd640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc00c7a10 0x7f6cc014b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.176+0000 7f6cbeffd640 1 -- 172.21.15.110:0/4206591825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc0159700 con 0x7f6cc00c3570 2024-04-22T01:11:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.180+0000 7f6cbeffd640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc00c3570 0x7f6cc00cada0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c3c0 tx=0x7f6cb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.188+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0017070 con 0x7f6cc00c3570 2024-04-22T01:11:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.188+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0005cf0 con 0x7f6cc00c3570 2024-04-22T01:11:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.188+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00072f0 con 0x7f6cc00c3570 2024-04-22T01:11:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.188+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc01599e0 con 0x7f6cc00c3570 2024-04-22T01:11:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.188+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc0140700 con 0x7f6cc00c3570 2024-04-22T01:11:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.192+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cc014c9f0 con 0x7f6cc00c3570 2024-04-22T01:11:03.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.244+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cb001a070 con 0x7f6cc00c3570 2024-04-22T01:11:03.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.244+0000 7f6cb77fe640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ca0067910 0x7f6ca0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.244+0000 7f6cb7fff640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ca0067910 0x7f6ca0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.248+0000 7f6cb7fff640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ca0067910 0x7f6ca0069dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80097c0 tx=0x7f6ca80aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:03.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.252+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6cb0053b60 con 0x7f6cc00c3570 2024-04-22T01:11:03.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.252+0000 7f6cb77fe640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f6ca006fb10 0x7f6ca0071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.252+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 --> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ca0072600 con 0x7f6ca006fb10 2024-04-22T01:11:03.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.252+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cb0051d60 con 0x7f6cc00c3570 2024-04-22T01:11:03.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.252+0000 7f6cbf7fe640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f6ca006fb10 0x7f6ca0071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.252+0000 7f6cbf7fe640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f6ca006fb10 0x7f6ca0071f30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:03.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.256+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== osd.2 v2:172.21.15.110:6802/2146442210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ca0072600 con 0x7f6ca006fb10 2024-04-22T01:11:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 --> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6cc00c6080 con 0x7f6ca006fb10 2024-04-22T01:11:03.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cb77fe640 1 -- 172.21.15.110:0/4206591825 <== osd.2 v2:172.21.15.110:6802/2146442210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6cc00c6080 con 0x7f6ca006fb10 2024-04-22T01:11:03.275 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:03.275 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:03.275 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f6ca006fb10 msgr2=0x7f6ca0071f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6802/2146442210,v1:172.21.15.110:6803/2146442210] conn(0x7f6ca006fb10 0x7f6ca0071f30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ca0067910 msgr2=0x7f6ca0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6ca0067910 0x7f6ca0069dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80097c0 tx=0x7f6ca80aa070 comp rx=0 tx=0).stop 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc00c3570 msgr2=0x7f6cc00cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 --2- 172.21.15.110:0/4206591825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc00c3570 0x7f6cc00cada0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c3c0 tx=0x7f6cb000c880 comp rx=0 tx=0).stop 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cbf7fe640 1 -- 172.21.15.110:0/4206591825 reap_dead start 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 shutdown_connections 2024-04-22T01:11:03.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 >> 172.21.15.110:0/4206591825 conn(0x7f6cc00cc070 msgr2=0x7f6cc00cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:03.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 shutdown_connections 2024-04-22T01:11:03.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.276+0000 7f6cc556b640 1 -- 172.21.15.110:0/4206591825 wait complete. 2024-04-22T01:11:03.296 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-22T01:11:03.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a56b6f640 1 Processor -- start 2024-04-22T01:11:03.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a56b6f640 1 -- start start 2024-04-22T01:11:03.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a56b6f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a50152180 0x7f6a500c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a56b6f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6a50152560 0x7f6a50158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a56b6f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a500c6110 con 0x7f6a50072460 2024-04-22T01:11:03.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a56b6f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f6a501592e0 con 0x7f6a50152560 2024-04-22T01:11:03.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a56b6f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6a500716c0 con 0x7f6a50152180 2024-04-22T01:11:03.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a4ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6a50152560 0x7f6a50158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a4ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6a50152560 0x7f6a50158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34460/0 (socket says 172.21.15.110:34460) 2024-04-22T01:11:03.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a4ffff640 1 -- 172.21.15.110:0/3563785469 learned_addr learned my addr 172.21.15.110:0/3563785469 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:03.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.436+0000 7f6a5490b640 1 --2- 172.21.15.110:0/3563785469 >> v2:172.21.15.154:3300/0 conn(0x7f6a50152180 0x7f6a500c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.440+0000 7f6a4ffff640 1 -- 172.21.15.110:0/3563785469 >> v2:172.21.15.154:3300/0 conn(0x7f6a50152180 msgr2=0x7f6a500c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:03.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.440+0000 7f6a4ffff640 1 --2- 172.21.15.110:0/3563785469 >> v2:172.21.15.154:3300/0 conn(0x7f6a50152180 0x7f6a500c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.440+0000 7f6a4ffff640 1 -- 172.21.15.110:0/3563785469 >> v1:172.21.15.154:6789/0 conn(0x7f6a50072460 legacy=0x7f6a5006fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:03.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.440+0000 7f6a4ffff640 1 -- 172.21.15.110:0/3563785469 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a500c63d0 con 0x7f6a50152560 2024-04-22T01:11:03.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.444+0000 7f6a4ffff640 1 --2- 172.21.15.110:0/3563785469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50158da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a50070270 tx=0x7f6a3c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe2d136e8a05351 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:03.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a4f7fe640 1 -- 172.21.15.110:0/3563785469 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0b5070 con 0x7f6a50152560 2024-04-22T01:11:03.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a4f7fe640 1 -- 172.21.15.110:0/3563785469 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0a89d0 con 0x7f6a50152560 2024-04-22T01:11:03.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a4f7fe640 1 -- 172.21.15.110:0/3563785469 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0a8da0 con 0x7f6a50152560 2024-04-22T01:11:03.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 -- 172.21.15.110:0/3563785469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 msgr2=0x7f6a50158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/3563785469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50158da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a50070270 tx=0x7f6a3c01ecd0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 -- 172.21.15.110:0/3563785469 shutdown_connections 2024-04-22T01:11:03.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/3563785469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50158da0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/3563785469 >> v2:172.21.15.154:3300/0 conn(0x7f6a50152180 0x7f6a500c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 -- 172.21.15.110:0/3563785469 >> 172.21.15.110:0/3563785469 conn(0x7f6a500cb710 msgr2=0x7f6a500cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:03.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 -- 172.21.15.110:0/3563785469 shutdown_connections 2024-04-22T01:11:03.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 -- 172.21.15.110:0/3563785469 wait complete. 2024-04-22T01:11:03.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 Processor -- start 2024-04-22T01:11:03.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.448+0000 7f6a56b6f640 1 -- start start 2024-04-22T01:11:03.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a56b6f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a50072460 0x7f6a50154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a56b6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50152180 0x7f6a50155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a56b6f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a56b6f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50071c60 con 0x7f6a50152560 2024-04-22T01:11:03.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a56b6f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50071980 con 0x7f6a50152180 2024-04-22T01:11:03.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a56b6f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6a50071f40 con 0x7f6a50072460 2024-04-22T01:11:03.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a5510c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a5510c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34466/0 (socket says 172.21.15.110:34466) 2024-04-22T01:11:03.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a5510c640 1 -- 172.21.15.110:0/437319519 learned_addr learned my addr 172.21.15.110:0/437319519 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:03.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a4ffff640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50152180 0x7f6a50155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.452+0000 7f6a5490b640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a50072460 0x7f6a50154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.456+0000 7f6a5510c640 1 -- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a50072460 msgr2=0x7f6a50154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.456+0000 7f6a5510c640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a50072460 0x7f6a50154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.456+0000 7f6a5510c640 1 -- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50152180 msgr2=0x7f6a50155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.456+0000 7f6a5510c640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50152180 0x7f6a50155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.456+0000 7f6a5510c640 1 -- 172.21.15.110:0/437319519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a50153da0 con 0x7f6a50152560 2024-04-22T01:11:03.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.456+0000 7f6a5510c640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50152bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c7b0 tx=0x7f6a4800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:03.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.460+0000 7f6a4d7fa640 1 -- 172.21.15.110:0/437319519 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48016020 con 0x7f6a50152560 2024-04-22T01:11:03.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.460+0000 7f6a4d7fa640 1 -- 172.21.15.110:0/437319519 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4800a9f0 con 0x7f6a50152560 2024-04-22T01:11:03.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.460+0000 7f6a4d7fa640 1 -- 172.21.15.110:0/437319519 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800ade0 con 0x7f6a50152560 2024-04-22T01:11:03.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.460+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a500c49d0 con 0x7f6a50152560 2024-04-22T01:11:03.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.460+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501577f0 con 0x7f6a50152560 2024-04-22T01:11:03.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.460+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a5004f510 con 0x7f6a50152560 2024-04-22T01:11:03.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.752+0000 7f6a4d7fa640 1 -- 172.21.15.110:0/437319519 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a48019020 con 0x7f6a50152560 2024-04-22T01:11:03.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.752+0000 7f6a4d7fa640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6a34067910 0x7f6a34069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:03.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.752+0000 7f6a5490b640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6a34067910 0x7f6a34069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:03.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.752+0000 7f6a5490b640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6a34067910 0x7f6a34069dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a44007a60 tx=0x7f6a44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:03.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.784+0000 7f6a4d7fa640 1 -- 172.21.15.110:0/437319519 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6a480544c0 con 0x7f6a50152560 2024-04-22T01:11:03.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.784+0000 7f6a4d7fa640 1 -- 172.21.15.110:0/437319519 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f6a48020030 con 0x7f6a50152560 2024-04-22T01:11:03.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.948+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f6a500c4c70 con 0x7f6a34067910 2024-04-22T01:11:03.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a4d7fa640 1 -- 172.21.15.110:0/437319519 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a500c4c70 con 0x7f6a34067910 2024-04-22T01:11:03.950 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 2 to deep-scrub 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6a34067910 msgr2=0x7f6a34069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6a34067910 0x7f6a34069dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a44007a60 tx=0x7f6a44008040 comp rx=0 tx=0).stop 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 msgr2=0x7f6a50152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50152bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c7b0 tx=0x7f6a4800cc70 comp rx=0 tx=0).stop 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 shutdown_connections 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f6a34067910 0x7f6a34069dd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a50152560 0x7f6a50152bf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50152180 0x7f6a50155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 --2- 172.21.15.110:0/437319519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a50072460 0x7f6a50154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 >> 172.21.15.110:0/437319519 conn(0x7f6a500cb710 msgr2=0x7f6a500c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:03.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 shutdown_connections 2024-04-22T01:11:03.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:03.952+0000 7f6a56b6f640 1 -- 172.21.15.110:0/437319519 wait complete. 2024-04-22T01:11:03.970 INFO:tasks.ceph:Scrubbing osd.3 2024-04-22T01:11:03.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:04.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e2ab94640 1 Processor -- start 2024-04-22T01:11:04.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e2ab94640 1 -- start start 2024-04-22T01:11:04.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e2ab94640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8e24152040 0x7f8e241588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e2ab94640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e240c8e00 0x7f8e240c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e2ab94640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e240c7870 con 0x7f8e240c73a0 2024-04-22T01:11:04.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e2ab94640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8e24158420 con 0x7f8e24152040 2024-04-22T01:11:04.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e2ab94640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8e24152420 con 0x7f8e240c8e00 2024-04-22T01:11:04.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e28930640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8e24152040 0x7f8e241588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e28930640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8e24152040 0x7f8e241588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34474/0 (socket says 172.21.15.110:34474) 2024-04-22T01:11:04.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.096+0000 7f8e28930640 1 -- 172.21.15.110:0/1979096064 learned_addr learned my addr 172.21.15.110:0/1979096064 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:04.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.100+0000 7f8e28930640 1 -- 172.21.15.110:0/1979096064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e240c8e00 msgr2=0x7f8e240c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:04.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.100+0000 7f8e28930640 1 --2- 172.21.15.110:0/1979096064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e240c8e00 0x7f8e240c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.100+0000 7f8e28930640 1 -- 172.21.15.110:0/1979096064 >> v1:172.21.15.154:6789/0 conn(0x7f8e240c73a0 legacy=0x7f8e2415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:04.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.100+0000 7f8e28930640 1 -- 172.21.15.110:0/1979096064 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240c7b30 con 0x7f8e24152040 2024-04-22T01:11:04.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.104+0000 7f8e28930640 1 --2- 172.21.15.110:0/1979096064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e24152040 0x7f8e241588b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e241585a0 tx=0x7f8e1c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0791b985c2ba88 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e237fe640 1 -- 172.21.15.110:0/1979096064 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0b4070 con 0x7f8e24152040 2024-04-22T01:11:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e237fe640 1 -- 172.21.15.110:0/1979096064 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0af400 con 0x7f8e24152040 2024-04-22T01:11:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e237fe640 1 -- 172.21.15.110:0/1979096064 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0af7d0 con 0x7f8e24152040 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 -- 172.21.15.110:0/1979096064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e24152040 msgr2=0x7f8e241588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 --2- 172.21.15.110:0/1979096064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e24152040 0x7f8e241588b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e241585a0 tx=0x7f8e1c01f1c0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 -- 172.21.15.110:0/1979096064 shutdown_connections 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 --2- 172.21.15.110:0/1979096064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e240c8e00 0x7f8e240c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 --2- 172.21.15.110:0/1979096064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e24152040 0x7f8e241588b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 -- 172.21.15.110:0/1979096064 >> 172.21.15.110:0/1979096064 conn(0x7f8e240cc9a0 msgr2=0x7f8e240ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 -- 172.21.15.110:0/1979096064 shutdown_connections 2024-04-22T01:11:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 -- 172.21.15.110:0/1979096064 wait complete. 2024-04-22T01:11:04.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 Processor -- start 2024-04-22T01:11:04.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.108+0000 7f8e2ab94640 1 -- start start 2024-04-22T01:11:04.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e2ab94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e240c73a0 0x7f8e240ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e2ab94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240c8e00 0x7f8e240c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e2ab94640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e24152040 0x7f8e241e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e2ab94640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240c80f0 con 0x7f8e240c73a0 2024-04-22T01:11:04.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e2ab94640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e241580f0 con 0x7f8e240c8e00 2024-04-22T01:11:04.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e2ab94640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8e240727f0 con 0x7f8e24152040 2024-04-22T01:11:04.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e29131640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e24152040 0x7f8e241e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e23fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240c8e00 0x7f8e240c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e29131640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e24152040 0x7f8e241e2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:39040/0 (socket says 172.21.15.110:39040) 2024-04-22T01:11:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e29131640 1 -- 172.21.15.110:0/283116357 learned_addr learned my addr 172.21.15.110:0/283116357 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:04.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.112+0000 7f8e28930640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e240c73a0 0x7f8e240ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.120+0000 7f8e29131640 1 -- 172.21.15.110:0/283116357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240c8e00 msgr2=0x7f8e240c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.120+0000 7f8e29131640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240c8e00 0x7f8e240c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.120+0000 7f8e29131640 1 -- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e240c73a0 msgr2=0x7f8e240ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.120+0000 7f8e29131640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e240c73a0 0x7f8e240ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.120+0000 7f8e29131640 1 -- 172.21.15.110:0/283116357 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e241e2030 con 0x7f8e24152040 2024-04-22T01:11:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.128+0000 7f8e29131640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e24152040 0x7f8e241e2e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400c440 tx=0x7f8e1400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:04.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.256+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14017070 con 0x7f8e24152040 2024-04-22T01:11:04.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.256+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e14003600 con 0x7f8e24152040 2024-04-22T01:11:04.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.256+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e140039f0 con 0x7f8e24152040 2024-04-22T01:11:04.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.256+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e241e2310 con 0x7f8e24152040 2024-04-22T01:11:04.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.256+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e241e3cf0 con 0x7f8e24152040 2024-04-22T01:11:04.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.256+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e241e1de0 con 0x7f8e24152040 2024-04-22T01:11:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.304+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e1401a070 con 0x7f8e24152040 2024-04-22T01:11:04.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.304+0000 7f8e217fa640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e04067910 0x7f8e04069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.304+0000 7f8e28930640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e04067910 0x7f8e04069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.304+0000 7f8e28930640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e04067910 0x7f8e04069dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0b1000 tx=0x7f8e1c0aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:04.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.308+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8e14053c10 con 0x7f8e24152040 2024-04-22T01:11:04.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.308+0000 7f8e217fa640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7f8e0406fb70 0x7f8e04071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.308+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 --> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e04072660 con 0x7f8e0406fb70 2024-04-22T01:11:04.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.308+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8e14051e10 con 0x7f8e24152040 2024-04-22T01:11:04.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.308+0000 7f8e23fff640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7f8e0406fb70 0x7f8e04071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.308+0000 7f8e23fff640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7f8e0406fb70 0x7f8e04071f90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:04.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.312+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== osd.3 v2:172.21.15.110:6818/888134246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e04072660 con 0x7f8e0406fb70 2024-04-22T01:11:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 --> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8e2404f5f0 con 0x7f8e0406fb70 2024-04-22T01:11:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e217fa640 1 -- 172.21.15.110:0/283116357 <== osd.3 v2:172.21.15.110:6818/888134246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8e2404f5f0 con 0x7f8e0406fb70 2024-04-22T01:11:04.328 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:04.328 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:04.328 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7f8e0406fb70 msgr2=0x7f8e04071f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6818/888134246,v1:172.21.15.110:6819/888134246] conn(0x7f8e0406fb70 0x7f8e04071f90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e04067910 msgr2=0x7f8e04069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f8e04067910 0x7f8e04069dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0b1000 tx=0x7f8e1c0aa000 comp rx=0 tx=0).stop 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e24152040 msgr2=0x7f8e241e2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 --2- 172.21.15.110:0/283116357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e24152040 0x7f8e241e2e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400c440 tx=0x7f8e1400c900 comp rx=0 tx=0).stop 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e29131640 1 -- 172.21.15.110:0/283116357 reap_dead start 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 shutdown_connections 2024-04-22T01:11:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 >> 172.21.15.110:0/283116357 conn(0x7f8e240cc9a0 msgr2=0x7f8e24156f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 shutdown_connections 2024-04-22T01:11:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.328+0000 7f8e2ab94640 1 -- 172.21.15.110:0/283116357 wait complete. 2024-04-22T01:11:04.350 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-22T01:11:04.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f48742fb640 1 Processor -- start 2024-04-22T01:11:04.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f48742fb640 1 -- start start 2024-04-22T01:11:04.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f48742fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f48742fb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f486c072460 0x7f486c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f48742fb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486c0c6110 con 0x7f486c152560 2024-04-22T01:11:04.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f48742fb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f486c1592e0 con 0x7f486c072460 2024-04-22T01:11:04.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f48742fb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f486c0716c0 con 0x7f486c152180 2024-04-22T01:11:04.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f4872898640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f486c072460 0x7f486c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f4872898640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f486c072460 0x7f486c158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34498/0 (socket says 172.21.15.110:34498) 2024-04-22T01:11:04.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f4872898640 1 -- 172.21.15.110:0/3100427423 learned_addr learned my addr 172.21.15.110:0/3100427423 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:04.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.484+0000 7f4872097640 1 --2- 172.21.15.110:0/3100427423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.488+0000 7f4872898640 1 -- 172.21.15.110:0/3100427423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 msgr2=0x7f486c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.488+0000 7f4872898640 1 --2- 172.21.15.110:0/3100427423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.488+0000 7f4872898640 1 -- 172.21.15.110:0/3100427423 >> v1:172.21.15.154:6789/0 conn(0x7f486c152560 legacy=0x7f486c06fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.488+0000 7f4872898640 1 -- 172.21.15.110:0/3100427423 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486c0c63d0 con 0x7f486c072460 2024-04-22T01:11:04.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.492+0000 7f4872898640 1 --2- 172.21.15.110:0/3100427423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c072460 0x7f486c158da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4864009e50 tx=0x7f486401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a64af34e6e59ed server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:04.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f4871095640 1 -- 172.21.15.110:0/3100427423 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640a5900 con 0x7f486c072460 2024-04-22T01:11:04.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f4871095640 1 -- 172.21.15.110:0/3100427423 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48640a5aa0 con 0x7f486c072460 2024-04-22T01:11:04.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f4871095640 1 -- 172.21.15.110:0/3100427423 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640ad3f0 con 0x7f486c072460 2024-04-22T01:11:04.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 -- 172.21.15.110:0/3100427423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c072460 msgr2=0x7f486c158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 --2- 172.21.15.110:0/3100427423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c072460 0x7f486c158da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4864009e50 tx=0x7f486401ca30 comp rx=0 tx=0).stop 2024-04-22T01:11:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 -- 172.21.15.110:0/3100427423 shutdown_connections 2024-04-22T01:11:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 --2- 172.21.15.110:0/3100427423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c072460 0x7f486c158da0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 --2- 172.21.15.110:0/3100427423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 -- 172.21.15.110:0/3100427423 >> 172.21.15.110:0/3100427423 conn(0x7f486c0cb710 msgr2=0x7f486c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 -- 172.21.15.110:0/3100427423 shutdown_connections 2024-04-22T01:11:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.496+0000 7f48742fb640 1 -- 172.21.15.110:0/3100427423 wait complete. 2024-04-22T01:11:04.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 Processor -- start 2024-04-22T01:11:04.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 -- start start 2024-04-22T01:11:04.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f486c072460 0x7f486c143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c152560 0x7f486c147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f486c164c90 con 0x7f486c152560 2024-04-22T01:11:04.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f486c071f40 con 0x7f486c072460 2024-04-22T01:11:04.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f48742fb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f486c164e10 con 0x7f486c152180 2024-04-22T01:11:04.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f4872097640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f486c072460 0x7f486c143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f4871896640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f4872097640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f486c072460 0x7f486c143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:50090/0 (socket says 172.21.15.110:50090) 2024-04-22T01:11:04.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.500+0000 7f4872097640 1 -- 172.21.15.110:0/3503438337 learned_addr learned my addr 172.21.15.110:0/3503438337 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:04.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.512+0000 7f4871896640 1 -- 172.21.15.110:0/3503438337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f486c072460 msgr2=0x7f486c143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.512+0000 7f4871896640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f486c072460 0x7f486c143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.512+0000 7f4871896640 1 -- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c152560 msgr2=0x7f486c147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:04.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.512+0000 7f4871896640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c152560 0x7f486c147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:04.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.512+0000 7f4871896640 1 -- 172.21.15.110:0/3503438337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486c14de70 con 0x7f486c152180 2024-04-22T01:11:04.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.520+0000 7f4871896640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c14d1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f485c000f70 tx=0x7f485c00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:04.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.528+0000 7f4862ffd640 1 -- 172.21.15.110:0/3503438337 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c017070 con 0x7f486c152180 2024-04-22T01:11:04.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.528+0000 7f4862ffd640 1 -- 172.21.15.110:0/3503438337 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485c0052d0 con 0x7f486c152180 2024-04-22T01:11:04.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.528+0000 7f4862ffd640 1 -- 172.21.15.110:0/3503438337 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c0054c0 con 0x7f486c152180 2024-04-22T01:11:04.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.528+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486c14edb0 con 0x7f486c152180 2024-04-22T01:11:04.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.528+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f486c14da40 con 0x7f486c152180 2024-04-22T01:11:04.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.528+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f486c04f510 con 0x7f486c152180 2024-04-22T01:11:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.876+0000 7f4862ffd640 1 -- 172.21.15.110:0/3503438337 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f485c01a070 con 0x7f486c152180 2024-04-22T01:11:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.880+0000 7f4862ffd640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4850067940 0x7f4850069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:04.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.880+0000 7f4872097640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4850067940 0x7f4850069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:04.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.880+0000 7f4872097640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4850067940 0x7f4850069e00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4868009b80 tx=0x7f4868009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:04.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.884+0000 7f4862ffd640 1 -- 172.21.15.110:0/3503438337 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f485c0538c0 con 0x7f486c152180 2024-04-22T01:11:04.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:04.904+0000 7f4862ffd640 1 -- 172.21.15.110:0/3503438337 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f485c021020 con 0x7f486c152180 2024-04-22T01:11:05.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.084+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f486c14e290 con 0x7f4850067940 2024-04-22T01:11:05.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f4862ffd640 1 -- 172.21.15.110:0/3503438337 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f486c14e290 con 0x7f4850067940 2024-04-22T01:11:05.086 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 3 to deep-scrub 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4850067940 msgr2=0x7f4850069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4850067940 0x7f4850069e00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4868009b80 tx=0x7f4868009190 comp rx=0 tx=0).stop 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 msgr2=0x7f486c14d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c14d1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f485c000f70 tx=0x7f485c00c890 comp rx=0 tx=0).stop 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 shutdown_connections 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4850067940 0x7f4850069e00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f486c152560 0x7f486c147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f486c152180 0x7f486c14d1c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 --2- 172.21.15.110:0/3503438337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f486c072460 0x7f486c143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 >> 172.21.15.110:0/3503438337 conn(0x7f486c0cb710 msgr2=0x7f486c0ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:05.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 shutdown_connections 2024-04-22T01:11:05.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.088+0000 7f48742fb640 1 -- 172.21.15.110:0/3503438337 wait complete. 2024-04-22T01:11:05.107 INFO:tasks.ceph:Scrubbing osd.4 2024-04-22T01:11:05.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a2111b640 1 Processor -- start 2024-04-22T01:11:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a2111b640 1 -- start start 2024-04-22T01:11:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a2111b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a1c154950 0x7f2a1c0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a2111b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a1c0cd210 0x7f2a1c0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a2111b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1c0cc250 con 0x7f2a1c154570 2024-04-22T01:11:05.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a2111b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1c0cc510 con 0x7f2a1c0cd210 2024-04-22T01:11:05.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a2111b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1c0cc7f0 con 0x7f2a1c154950 2024-04-22T01:11:05.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a1b59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a1c0cd210 0x7f2a1c0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a1b59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a1c0cd210 0x7f2a1c0cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34524/0 (socket says 172.21.15.110:34524) 2024-04-22T01:11:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.240+0000 7f2a1b59e640 1 -- 172.21.15.110:0/1035466828 learned_addr learned my addr 172.21.15.110:0/1035466828 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:05.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.244+0000 7f2a1b59e640 1 -- 172.21.15.110:0/1035466828 >> v2:172.21.15.154:3300/0 conn(0x7f2a1c154950 msgr2=0x7f2a1c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:05.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.244+0000 7f2a1b59e640 1 --2- 172.21.15.110:0/1035466828 >> v2:172.21.15.154:3300/0 conn(0x7f2a1c154950 0x7f2a1c0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.244+0000 7f2a1b59e640 1 -- 172.21.15.110:0/1035466828 >> v1:172.21.15.154:6789/0 conn(0x7f2a1c154570 legacy=0x7f2a1c0ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:05.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.244+0000 7f2a1b59e640 1 -- 172.21.15.110:0/1035466828 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c0ccad0 con 0x7f2a1c0cd210 2024-04-22T01:11:05.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.248+0000 7f2a1b59e640 1 --2- 172.21.15.110:0/1035466828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c0cd210 0x7f2a1c0cf2d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c073660 tx=0x7f2a0c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19146ba8b329454 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:05.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a19d9b640 1 -- 172.21.15.110:0/1035466828 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b5070 con 0x7f2a1c0cd210 2024-04-22T01:11:05.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a19d9b640 1 -- 172.21.15.110:0/1035466828 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0a89d0 con 0x7f2a1c0cd210 2024-04-22T01:11:05.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a19d9b640 1 -- 172.21.15.110:0/1035466828 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0a8da0 con 0x7f2a1c0cd210 2024-04-22T01:11:05.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 -- 172.21.15.110:0/1035466828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c0cd210 msgr2=0x7f2a1c0cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 --2- 172.21.15.110:0/1035466828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c0cd210 0x7f2a1c0cf2d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c073660 tx=0x7f2a0c01ecd0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 -- 172.21.15.110:0/1035466828 shutdown_connections 2024-04-22T01:11:05.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 --2- 172.21.15.110:0/1035466828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c0cd210 0x7f2a1c0cf2d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 --2- 172.21.15.110:0/1035466828 >> v2:172.21.15.154:3300/0 conn(0x7f2a1c154950 0x7f2a1c0ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 -- 172.21.15.110:0/1035466828 >> 172.21.15.110:0/1035466828 conn(0x7f2a1c0b1680 msgr2=0x7f2a1c0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:05.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 -- 172.21.15.110:0/1035466828 shutdown_connections 2024-04-22T01:11:05.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 -- 172.21.15.110:0/1035466828 wait complete. 2024-04-22T01:11:05.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.252+0000 7f2a2111b640 1 Processor -- start 2024-04-22T01:11:05.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a2111b640 1 -- start start 2024-04-22T01:11:05.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a2111b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a1c0cd210 0x7f2a1c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a2111b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c154570 0x7f2a1c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a2111b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a1c154950 0x7f2a1c0b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a2111b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c15a830 con 0x7f2a1c154570 2024-04-22T01:11:05.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a2111b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c06e150 con 0x7f2a1c154950 2024-04-22T01:11:05.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a2111b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c15a9b0 con 0x7f2a1c0cd210 2024-04-22T01:11:05.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a1a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c154570 0x7f2a1c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a1a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c154570 0x7f2a1c154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34526/0 (socket says 172.21.15.110:34526) 2024-04-22T01:11:05.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.256+0000 7f2a1a59c640 1 -- 172.21.15.110:0/1320132382 learned_addr learned my addr 172.21.15.110:0/1320132382 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:05.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.260+0000 7f2a1a59c640 1 -- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a1c0cd210 msgr2=0x7f2a1c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.260+0000 7f2a1a59c640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a1c0cd210 0x7f2a1c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.260+0000 7f2a1a59c640 1 -- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a1c154950 msgr2=0x7f2a1c0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.260+0000 7f2a1a59c640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a1c154950 0x7f2a1c0b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.260+0000 7f2a1a59c640 1 -- 172.21.15.110:0/1320132382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c1561f0 con 0x7f2a1c154570 2024-04-22T01:11:05.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.260+0000 7f2a1a59c640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c154570 0x7f2a1c154d50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b440 tx=0x7f2a1000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:05.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.268+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011830 con 0x7f2a1c154570 2024-04-22T01:11:05.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.268+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a10016070 con 0x7f2a1c154570 2024-04-22T01:11:05.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.268+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011c30 con 0x7f2a1c154570 2024-04-22T01:11:05.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.268+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1c1f14a0 con 0x7f2a1c154570 2024-04-22T01:11:05.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.268+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1c1f06e0 con 0x7f2a1c154570 2024-04-22T01:11:05.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.268+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a1c0685b0 con 0x7f2a1c154570 2024-04-22T01:11:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.288+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a1001b460 con 0x7f2a1c154570 2024-04-22T01:11:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.288+0000 7f2a037fe640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2a08067910 0x7f2a08069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.288+0000 7f2a1ad9d640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2a08067910 0x7f2a08069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.288+0000 7f2a1ad9d640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2a08067910 0x7f2a08069dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2a14001c90 tx=0x7f2a14007d20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.292+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2a100547e0 con 0x7f2a1c154570 2024-04-22T01:11:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.292+0000 7f2a037fe640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f2a0806fb70 0x7f2a08071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.292+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 --> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a1001ce50 con 0x7f2a0806fb70 2024-04-22T01:11:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.292+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2a100529e0 con 0x7f2a1c154570 2024-04-22T01:11:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.292+0000 7f2a1b59e640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f2a0806fb70 0x7f2a08071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.292+0000 7f2a1b59e640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f2a0806fb70 0x7f2a08071f90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:05.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.296+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== osd.4 v2:172.21.15.154:6824/2160786358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a1001ce50 con 0x7f2a0806fb70 2024-04-22T01:11:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 --> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2a1c15b0f0 con 0x7f2a0806fb70 2024-04-22T01:11:05.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a037fe640 1 -- 172.21.15.110:0/1320132382 <== osd.4 v2:172.21.15.154:6824/2160786358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2a1c15b0f0 con 0x7f2a0806fb70 2024-04-22T01:11:05.308 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:05.308 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f2a0806fb70 msgr2=0x7f2a08071f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.154:6824/2160786358,v1:172.21.15.154:6825/2160786358] conn(0x7f2a0806fb70 0x7f2a08071f90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2a08067910 msgr2=0x7f2a08069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2a08067910 0x7f2a08069dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2a14001c90 tx=0x7f2a14007d20 comp rx=0 tx=0).stop 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c154570 msgr2=0x7f2a1c154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 --2- 172.21.15.110:0/1320132382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a1c154570 0x7f2a1c154d50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b440 tx=0x7f2a1000b900 comp rx=0 tx=0).stop 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a1b59e640 1 -- 172.21.15.110:0/1320132382 reap_dead start 2024-04-22T01:11:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 shutdown_connections 2024-04-22T01:11:05.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 >> 172.21.15.110:0/1320132382 conn(0x7f2a1c0b1680 msgr2=0x7f2a1c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:05.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 shutdown_connections 2024-04-22T01:11:05.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.308+0000 7f2a2111b640 1 -- 172.21.15.110:0/1320132382 wait complete. 2024-04-22T01:11:05.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-22T01:11:05.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 Processor -- start 2024-04-22T01:11:05.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 -- start start 2024-04-22T01:11:05.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 0x7fe7280c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7280c2d00 0x7fe728158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe72815bf00 0x7fe72806f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe7280c8820 con 0x7fe7280c2d00 2024-04-22T01:11:05.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe72815ba70 con 0x7fe72815bf00 2024-04-22T01:11:05.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.456+0000 7fe72e009640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe7280c8a70 con 0x7fe728152460 2024-04-22T01:11:05.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.460+0000 7fe726ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7280c2d00 0x7fe728158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.460+0000 7fe727fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe72815bf00 0x7fe72806f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.460+0000 7fe726ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7280c2d00 0x7fe728158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34542/0 (socket says 172.21.15.110:34542) 2024-04-22T01:11:05.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.460+0000 7fe726ffd640 1 -- 172.21.15.110:0/2146505741 learned_addr learned my addr 172.21.15.110:0/2146505741 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.464+0000 7fe726ffd640 1 -- 172.21.15.110:0/2146505741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 msgr2=0x7fe7280c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.464+0000 7fe726ffd640 1 --2- 172.21.15.110:0/2146505741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 0x7fe7280c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.464+0000 7fe726ffd640 1 -- 172.21.15.110:0/2146505741 >> v2:172.21.15.154:3300/0 conn(0x7fe72815bf00 msgr2=0x7fe72806f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.464+0000 7fe726ffd640 1 --2- 172.21.15.110:0/2146505741 >> v2:172.21.15.154:3300/0 conn(0x7fe72815bf00 0x7fe72806f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.464+0000 7fe726ffd640 1 -- 172.21.15.110:0/2146505741 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7280c8d50 con 0x7fe7280c2d00 2024-04-22T01:11:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.464+0000 7fe726ffd640 1 --2- 172.21.15.110:0/2146505741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280c2d00 0x7fe728158a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe7280cb840 tx=0x7fe71801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6923549d7884c21e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe7267fc640 1 -- 172.21.15.110:0/2146505741 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180b5070 con 0x7fe7280c2d00 2024-04-22T01:11:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe7267fc640 1 -- 172.21.15.110:0/2146505741 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7180a89d0 con 0x7fe7280c2d00 2024-04-22T01:11:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe7267fc640 1 -- 172.21.15.110:0/2146505741 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180a8da0 con 0x7fe7280c2d00 2024-04-22T01:11:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 -- 172.21.15.110:0/2146505741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280c2d00 msgr2=0x7fe728158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 --2- 172.21.15.110:0/2146505741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280c2d00 0x7fe728158a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe7280cb840 tx=0x7fe71801ed10 comp rx=0 tx=0).stop 2024-04-22T01:11:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 -- 172.21.15.110:0/2146505741 shutdown_connections 2024-04-22T01:11:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 --2- 172.21.15.110:0/2146505741 >> v2:172.21.15.154:3300/0 conn(0x7fe72815bf00 0x7fe72806f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 --2- 172.21.15.110:0/2146505741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280c2d00 0x7fe728158a70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 --2- 172.21.15.110:0/2146505741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 0x7fe7280c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 -- 172.21.15.110:0/2146505741 >> 172.21.15.110:0/2146505741 conn(0x7fe728062670 msgr2=0x7fe728071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:05.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 -- 172.21.15.110:0/2146505741 shutdown_connections 2024-04-22T01:11:05.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.472+0000 7fe72e009640 1 -- 172.21.15.110:0/2146505741 wait complete. 2024-04-22T01:11:05.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 Processor -- start 2024-04-22T01:11:05.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 -- start start 2024-04-22T01:11:05.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 0x7fe7281f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe72815bf00 0x7fe7281ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7280c7b80 0x7fe7280b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe72815c510 con 0x7fe72815bf00 2024-04-22T01:11:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe72815c390 con 0x7fe7280c7b80 2024-04-22T01:11:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe72e009640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe72806fef0 con 0x7fe728152460 2024-04-22T01:11:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe72815bf00 0x7fe7281ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe72815bf00 0x7fe7281ee650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34558/0 (socket says 172.21.15.110:34558) 2024-04-22T01:11:05.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe726ffd640 1 -- 172.21.15.110:0/3672486958 learned_addr learned my addr 172.21.15.110:0/3672486958 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:05.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.476+0000 7fe727fff640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7280c7b80 0x7fe7280b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.480+0000 7fe726ffd640 1 -- 172.21.15.110:0/3672486958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 msgr2=0x7fe7281f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.480+0000 7fe726ffd640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 0x7fe7281f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.480+0000 7fe726ffd640 1 -- 172.21.15.110:0/3672486958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7280c7b80 msgr2=0x7fe7280b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.480+0000 7fe726ffd640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7280c7b80 0x7fe7280b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.480+0000 7fe726ffd640 1 -- 172.21.15.110:0/3672486958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7281f20b0 con 0x7fe72815bf00 2024-04-22T01:11:05.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.480+0000 7fe726ffd640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe72815bf00 0x7fe7281ee650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe71801f5b0 tx=0x7fe71801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:05.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.488+0000 7fe71ffff640 1 -- 172.21.15.110:0/3672486958 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180b5040 con 0x7fe72815bf00 2024-04-22T01:11:05.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.488+0000 7fe71ffff640 1 -- 172.21.15.110:0/3672486958 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7180be070 con 0x7fe72815bf00 2024-04-22T01:11:05.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.488+0000 7fe71ffff640 1 -- 172.21.15.110:0/3672486958 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180b09a0 con 0x7fe72815bf00 2024-04-22T01:11:05.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.488+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7281562b0 con 0x7fe72815bf00 2024-04-22T01:11:05.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.488+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe728156550 con 0x7fe72815bf00 2024-04-22T01:11:05.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.488+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72804f510 con 0x7fe72815bf00 2024-04-22T01:11:05.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.776+0000 7fe71ffff640 1 -- 172.21.15.110:0/3672486958 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7180b0b40 con 0x7fe72815bf00 2024-04-22T01:11:05.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.776+0000 7fe71ffff640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe708067910 0x7fe708069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:05.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.776+0000 7fe7277fe640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe708067910 0x7fe708069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:05.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.776+0000 7fe7277fe640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe708067910 0x7fe708069dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe710009730 tx=0x7fe710006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:05.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.816+0000 7fe71ffff640 1 -- 172.21.15.110:0/3672486958 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe7180f2040 con 0x7fe72815bf00 2024-04-22T01:11:05.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.816+0000 7fe71ffff640 1 -- 172.21.15.110:0/3672486958 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fe718018870 con 0x7fe72815bf00 2024-04-22T01:11:05.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.980+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe7280b3c40 con 0x7fe708067910 2024-04-22T01:11:05.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.980+0000 7fe71ffff640 1 -- 172.21.15.110:0/3672486958 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe7280b3c40 con 0x7fe708067910 2024-04-22T01:11:05.981 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 4 to deep-scrub 2024-04-22T01:11:05.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe708067910 msgr2=0x7fe708069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe708067910 0x7fe708069dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe710009730 tx=0x7fe710006ca0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe72815bf00 msgr2=0x7fe7281ee650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe72815bf00 0x7fe7281ee650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe71801f5b0 tx=0x7fe71801bab0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 shutdown_connections 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe708067910 0x7fe708069dd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7280c7b80 0x7fe7280b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe72815bf00 0x7fe7281ee650 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 --2- 172.21.15.110:0/3672486958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728152460 0x7fe7281f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 >> 172.21.15.110:0/3672486958 conn(0x7fe728062670 msgr2=0x7fe7280cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 shutdown_connections 2024-04-22T01:11:05.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:05.984+0000 7fe72e009640 1 -- 172.21.15.110:0/3672486958 wait complete. 2024-04-22T01:11:06.002 INFO:tasks.ceph:Scrubbing osd.5 2024-04-22T01:11:06.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:06.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 Processor -- start 2024-04-22T01:11:06.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 -- start start 2024-04-22T01:11:06.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c88f0 0x7f38280c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38280c8cd0 0x7f382815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3828154250 0x7f3828154670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f38280c9490 con 0x7f38280c8cd0 2024-04-22T01:11:06.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f382815b370 con 0x7f3828154250 2024-04-22T01:11:06.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f382dd67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f38280c4810 con 0x7f38280c88f0 2024-04-22T01:11:06.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f3826ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38280c8cd0 0x7f382815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f3826ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38280c8cd0 0x7f382815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34568/0 (socket says 172.21.15.110:34568) 2024-04-22T01:11:06.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f3826ffd640 1 -- 172.21.15.110:0/572931744 learned_addr learned my addr 172.21.15.110:0/572931744 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:06.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f38277fe640 1 --2- 172.21.15.110:0/572931744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c88f0 0x7f38280c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.128+0000 7f3827fff640 1 --2- 172.21.15.110:0/572931744 >> v2:172.21.15.154:3300/0 conn(0x7f3828154250 0x7f3828154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.132+0000 7f3826ffd640 1 -- 172.21.15.110:0/572931744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c88f0 msgr2=0x7f38280c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:06.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.132+0000 7f3826ffd640 1 --2- 172.21.15.110:0/572931744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c88f0 0x7f38280c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.132+0000 7f3826ffd640 1 -- 172.21.15.110:0/572931744 >> v2:172.21.15.154:3300/0 conn(0x7f3828154250 msgr2=0x7f3828154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:06.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.132+0000 7f3826ffd640 1 --2- 172.21.15.110:0/572931744 >> v2:172.21.15.154:3300/0 conn(0x7f3828154250 0x7f3828154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.132+0000 7f3826ffd640 1 -- 172.21.15.110:0/572931744 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38280c3c90 con 0x7f38280c8cd0 2024-04-22T01:11:06.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.136+0000 7f3826ffd640 1 --2- 172.21.15.110:0/572931744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38280c8cd0 0x7f382815ae30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f38280cb1e0 tx=0x7f381001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf141bae861058d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:06.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f38267fc640 1 -- 172.21.15.110:0/572931744 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38100b0070 con 0x7f38280c8cd0 2024-04-22T01:11:06.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f38267fc640 1 -- 172.21.15.110:0/572931744 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100ab600 con 0x7f38280c8cd0 2024-04-22T01:11:06.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f38267fc640 1 -- 172.21.15.110:0/572931744 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38100ab9d0 con 0x7f38280c8cd0 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 -- 172.21.15.110:0/572931744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38280c8cd0 msgr2=0x7f382815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 --2- 172.21.15.110:0/572931744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38280c8cd0 0x7f382815ae30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f38280cb1e0 tx=0x7f381001c520 comp rx=0 tx=0).stop 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 -- 172.21.15.110:0/572931744 shutdown_connections 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 --2- 172.21.15.110:0/572931744 >> v2:172.21.15.154:3300/0 conn(0x7f3828154250 0x7f3828154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 --2- 172.21.15.110:0/572931744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38280c8cd0 0x7f382815ae30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 --2- 172.21.15.110:0/572931744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c88f0 0x7f38280c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 -- 172.21.15.110:0/572931744 >> 172.21.15.110:0/572931744 conn(0x7f3828071430 msgr2=0x7f3828071840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:06.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 -- 172.21.15.110:0/572931744 shutdown_connections 2024-04-22T01:11:06.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.140+0000 7f382dd67640 1 -- 172.21.15.110:0/572931744 wait complete. 2024-04-22T01:11:06.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 Processor -- start 2024-04-22T01:11:06.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 -- start start 2024-04-22T01:11:06.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38280c88f0 0x7f382806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c8cd0 0x7f3828146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3828154250 0x7f3828146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f38280c9f30 con 0x7f3828154250 2024-04-22T01:11:06.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38280c3910 con 0x7f38280c88f0 2024-04-22T01:11:06.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f382dd67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f38280ca0b0 con 0x7f38280c8cd0 2024-04-22T01:11:06.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f3827fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3828154250 0x7f3828146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f3827fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3828154250 0x7f3828146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34576/0 (socket says 172.21.15.110:34576) 2024-04-22T01:11:06.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f3827fff640 1 -- 172.21.15.110:0/3193845847 learned_addr learned my addr 172.21.15.110:0/3193845847 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:06.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f3826ffd640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c8cd0 0x7f3828146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.144+0000 7f38277fe640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38280c88f0 0x7f382806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.148+0000 7f3827fff640 1 -- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c8cd0 msgr2=0x7f3828146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.148+0000 7f3827fff640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38280c8cd0 0x7f3828146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.148+0000 7f3827fff640 1 -- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38280c88f0 msgr2=0x7f382806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.148+0000 7f3827fff640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38280c88f0 0x7f382806f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.148+0000 7f3827fff640 1 -- 172.21.15.110:0/3193845847 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3828157450 con 0x7f3828154250 2024-04-22T01:11:06.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.152+0000 7f3827fff640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3828154250 0x7f3828146760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3820007e60 tx=0x7f382000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:06.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.156+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820014420 con 0x7f3828154250 2024-04-22T01:11:06.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.156+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820019070 con 0x7f3828154250 2024-04-22T01:11:06.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.156+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820014820 con 0x7f3828154250 2024-04-22T01:11:06.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.156+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38281f73a0 con 0x7f3828154250 2024-04-22T01:11:06.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.156+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38281f70e0 con 0x7f3828154250 2024-04-22T01:11:06.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.156+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38281553f0 con 0x7f3828154250 2024-04-22T01:11:06.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.176+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38200149c0 con 0x7f3828154250 2024-04-22T01:11:06.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.176+0000 7f381ffff640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3808067940 0x7f3808069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.176+0000 7f38277fe640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3808067940 0x7f3808069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.180+0000 7f38277fe640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3808067940 0x7f3808069e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f38180045f0 tx=0x7f3818008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:06.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.184+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f38200557a0 con 0x7f3828154250 2024-04-22T01:11:06.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.184+0000 7f381ffff640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f380806fb40 0x7f3808071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.184+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 --> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f382000df30 con 0x7f380806fb40 2024-04-22T01:11:06.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.184+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38200539a0 con 0x7f3828154250 2024-04-22T01:11:06.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.184+0000 7f3826ffd640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f380806fb40 0x7f3808071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.184+0000 7f3826ffd640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f380806fb40 0x7f3808071f60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:06.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.188+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== osd.5 v2:172.21.15.154:6803/828597106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f382000df30 con 0x7f380806fb40 2024-04-22T01:11:06.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 --> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f382804f5f0 con 0x7f380806fb40 2024-04-22T01:11:06.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f381ffff640 1 -- 172.21.15.110:0/3193845847 <== osd.5 v2:172.21.15.154:6803/828597106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f382804f5f0 con 0x7f380806fb40 2024-04-22T01:11:06.201 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:06.201 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:06.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f380806fb40 msgr2=0x7f3808071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f382dd67640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.154:6803/828597106,v1:172.21.15.154:6805/828597106] conn(0x7f380806fb40 0x7f3808071f60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3808067940 msgr2=0x7f3808069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f382dd67640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3808067940 0x7f3808069e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f38180045f0 tx=0x7f3818008040 comp rx=0 tx=0).stop 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3828154250 msgr2=0x7f3828146760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f382dd67640 1 --2- 172.21.15.110:0/3193845847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3828154250 0x7f3828146760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3820007e60 tx=0x7f382000e4b0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.200+0000 7f3827fff640 1 -- 172.21.15.110:0/3193845847 reap_dead start 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.204+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 shutdown_connections 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.204+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 >> 172.21.15.110:0/3193845847 conn(0x7f3828071430 msgr2=0x7f3828071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.204+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 shutdown_connections 2024-04-22T01:11:06.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.204+0000 7f382dd67640 1 -- 172.21.15.110:0/3193845847 wait complete. 2024-04-22T01:11:06.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-22T01:11:06.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.344+0000 7fa97cadf640 1 Processor -- start 2024-04-22T01:11:06.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.344+0000 7fa97cadf640 1 -- start start 2024-04-22T01:11:06.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.344+0000 7fa97cadf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978061ff0 0x7fa97806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.344+0000 7fa97cadf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa97806f390 0x7fa9780c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.344+0000 7fa97cadf640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa978154930 con 0x7fa978154550 2024-04-22T01:11:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.344+0000 7fa97cadf640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa9780c8020 con 0x7fa97806f390 2024-04-22T01:11:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.344+0000 7fa97cadf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9780c89f0 con 0x7fa978061ff0 2024-04-22T01:11:06.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa97659c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa978154550 0x7fa97806de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60550/0 (socket says 172.21.15.110:60550) 2024-04-22T01:11:06.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa97659c640 1 -- 172.21.15.110:0/2466912955 learned_addr learned my addr 172.21.15.110:0/2466912955 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:06.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa976d9d640 1 --2- 172.21.15.110:0/2466912955 >> v2:172.21.15.110:3300/0 conn(0x7fa97806f390 0x7fa9780c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa975d9b640 1 --2- 172.21.15.110:0/2466912955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978061ff0 0x7fa97806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa976d9d640 1 -- 172.21.15.110:0/2466912955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978061ff0 msgr2=0x7fa97806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa976d9d640 1 --2- 172.21.15.110:0/2466912955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978061ff0 0x7fa97806b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa976d9d640 1 -- 172.21.15.110:0/2466912955 >> v1:172.21.15.110:6789/0 conn(0x7fa978154550 legacy=0x7fa97806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.348+0000 7fa976d9d640 1 -- 172.21.15.110:0/2466912955 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97815ae30 con 0x7fa97806f390 2024-04-22T01:11:06.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.356+0000 7fa976d9d640 1 --2- 172.21.15.110:0/2466912955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806f390 0x7fa9780c84b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa970009d90 tx=0x7fa97001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a0f1f01e571781 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:06.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97559a640 1 -- 172.21.15.110:0/2466912955 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9700b4070 con 0x7fa97806f390 2024-04-22T01:11:06.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97559a640 1 -- 172.21.15.110:0/2466912955 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9700af600 con 0x7fa97806f390 2024-04-22T01:11:06.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97559a640 1 -- 172.21.15.110:0/2466912955 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9700af9d0 con 0x7fa97806f390 2024-04-22T01:11:06.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 -- 172.21.15.110:0/2466912955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806f390 msgr2=0x7fa9780c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 --2- 172.21.15.110:0/2466912955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806f390 0x7fa9780c84b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa970009d90 tx=0x7fa97001f150 comp rx=0 tx=0).stop 2024-04-22T01:11:06.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 -- 172.21.15.110:0/2466912955 shutdown_connections 2024-04-22T01:11:06.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 --2- 172.21.15.110:0/2466912955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806f390 0x7fa9780c84b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 --2- 172.21.15.110:0/2466912955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978061ff0 0x7fa97806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 -- 172.21.15.110:0/2466912955 >> 172.21.15.110:0/2466912955 conn(0x7fa9780cc250 msgr2=0x7fa9780cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:06.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 -- 172.21.15.110:0/2466912955 shutdown_connections 2024-04-22T01:11:06.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 -- 172.21.15.110:0/2466912955 wait complete. 2024-04-22T01:11:06.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 Processor -- start 2024-04-22T01:11:06.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.368+0000 7fa97cadf640 1 -- start start 2024-04-22T01:11:06.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa97cadf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa978061ff0 0x7fa9780c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa97cadf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa97806f390 0x7fa978149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa97cadf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978154550 0x7fa9781f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa97cadf640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa9780c79d0 con 0x7fa978061ff0 2024-04-22T01:11:06.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa97cadf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9780c76f0 con 0x7fa97806f390 2024-04-22T01:11:06.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa97cadf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9780c7cb0 con 0x7fa978154550 2024-04-22T01:11:06.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa975d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa97806f390 0x7fa978149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa976d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978154550 0x7fa9781f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa975d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa97806f390 0x7fa978149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:50156/0 (socket says 172.21.15.110:50156) 2024-04-22T01:11:06.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.372+0000 7fa975d9b640 1 -- 172.21.15.110:0/3460459445 learned_addr learned my addr 172.21.15.110:0/3460459445 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:06.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.380+0000 7fa97659c640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa978061ff0 0x7fa9780c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.380+0000 7fa976d9d640 1 -- 172.21.15.110:0/3460459445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa97806f390 msgr2=0x7fa978149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.380+0000 7fa976d9d640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa97806f390 0x7fa978149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.380+0000 7fa976d9d640 1 -- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa978061ff0 msgr2=0x7fa9780c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:06.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.380+0000 7fa976d9d640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa978061ff0 0x7fa9780c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:06.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.380+0000 7fa976d9d640 1 -- 172.21.15.110:0/3460459445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa978148f10 con 0x7fa978154550 2024-04-22T01:11:06.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.388+0000 7fa976d9d640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978154550 0x7fa9781f3d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9700af000 tx=0x7fa97001bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:06.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.508+0000 7fa96effd640 1 -- 172.21.15.110:0/3460459445 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9700be030 con 0x7fa978154550 2024-04-22T01:11:06.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.508+0000 7fa96effd640 1 -- 172.21.15.110:0/3460459445 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9700c3410 con 0x7fa978154550 2024-04-22T01:11:06.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.508+0000 7fa96effd640 1 -- 172.21.15.110:0/3460459445 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9700b4040 con 0x7fa978154550 2024-04-22T01:11:06.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.508+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa978149180 con 0x7fa978154550 2024-04-22T01:11:06.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.512+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa978149740 con 0x7fa978154550 2024-04-22T01:11:06.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.512+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa978149980 con 0x7fa978154550 2024-04-22T01:11:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.852+0000 7fa96effd640 1 -- 172.21.15.110:0/3460459445 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa9700c1030 con 0x7fa978154550 2024-04-22T01:11:06.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.852+0000 7fa96effd640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fa95c0678c0 0x7fa95c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:06.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.852+0000 7fa97659c640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fa95c0678c0 0x7fa95c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:06.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.852+0000 7fa97659c640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fa95c0678c0 0x7fa95c069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa968000f70 tx=0x7fa968009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:06.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.860+0000 7fa96effd640 1 -- 172.21.15.110:0/3460459445 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa970002020 con 0x7fa978154550 2024-04-22T01:11:06.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:06.888+0000 7fa96effd640 1 -- 172.21.15.110:0/3460459445 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fa978149980 con 0x7fa978154550 2024-04-22T01:11:07.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fa97804f510 con 0x7fa95c0678c0 2024-04-22T01:11:07.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa96effd640 1 -- 172.21.15.110:0/3460459445 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa97804f510 con 0x7fa95c0678c0 2024-04-22T01:11:07.079 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 5 to deep-scrub 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fa95c0678c0 msgr2=0x7fa95c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fa95c0678c0 0x7fa95c069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa968000f70 tx=0x7fa968009040 comp rx=0 tx=0).stop 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978154550 msgr2=0x7fa9781f3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978154550 0x7fa9781f3d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9700af000 tx=0x7fa97001bef0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 shutdown_connections 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fa95c0678c0 0x7fa95c069d80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa978154550 0x7fa9781f3d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa97806f390 0x7fa978149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 --2- 172.21.15.110:0/3460459445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa978061ff0 0x7fa9780c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 >> 172.21.15.110:0/3460459445 conn(0x7fa9780cc250 msgr2=0x7fa9780c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:07.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 shutdown_connections 2024-04-22T01:11:07.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.080+0000 7fa97cadf640 1 -- 172.21.15.110:0/3460459445 wait complete. 2024-04-22T01:11:07.098 INFO:tasks.ceph:Scrubbing osd.6 2024-04-22T01:11:07.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:07.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.228+0000 7fe9d6c2e640 1 Processor -- start 2024-04-22T01:11:07.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.228+0000 7fe9d6c2e640 1 -- start start 2024-04-22T01:11:07.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.228+0000 7fe9d6c2e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9d0152040 0x7fe9d01588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.228+0000 7fe9d6c2e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9d00c73a0 0x7fe9d0162920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.228+0000 7fe9d6c2e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d00c7870 con 0x7fe9d00c8e00 2024-04-22T01:11:07.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.228+0000 7fe9d6c2e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d0158420 con 0x7fe9d00c73a0 2024-04-22T01:11:07.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.228+0000 7fe9d6c2e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d0152420 con 0x7fe9d0152040 2024-04-22T01:11:07.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d51cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9d00c73a0 0x7fe9d0162920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d51cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9d00c73a0 0x7fe9d0162920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34610/0 (socket says 172.21.15.110:34610) 2024-04-22T01:11:07.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d51cb640 1 -- 172.21.15.110:0/496829478 learned_addr learned my addr 172.21.15.110:0/496829478 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:07.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d49ca640 1 --2- 172.21.15.110:0/496829478 >> v2:172.21.15.154:3300/0 conn(0x7fe9d0152040 0x7fe9d01588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d51cb640 1 -- 172.21.15.110:0/496829478 >> v2:172.21.15.154:3300/0 conn(0x7fe9d0152040 msgr2=0x7fe9d01588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:07.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d51cb640 1 --2- 172.21.15.110:0/496829478 >> v2:172.21.15.154:3300/0 conn(0x7fe9d0152040 0x7fe9d01588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d51cb640 1 -- 172.21.15.110:0/496829478 >> v1:172.21.15.154:6789/0 conn(0x7fe9d00c8e00 legacy=0x7fe9d00c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:07.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.232+0000 7fe9d51cb640 1 -- 172.21.15.110:0/496829478 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d00c7b30 con 0x7fe9d00c73a0 2024-04-22T01:11:07.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.236+0000 7fe9d51cb640 1 --2- 172.21.15.110:0/496829478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00c73a0 0x7fe9d0162920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0072200 tx=0x7fe9c801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44df8b0c4cfe06d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:07.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9cf7fe640 1 -- 172.21.15.110:0/496829478 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80b4070 con 0x7fe9d00c73a0 2024-04-22T01:11:07.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9cf7fe640 1 -- 172.21.15.110:0/496829478 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c80af400 con 0x7fe9d00c73a0 2024-04-22T01:11:07.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9cf7fe640 1 -- 172.21.15.110:0/496829478 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80af7d0 con 0x7fe9d00c73a0 2024-04-22T01:11:07.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/496829478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00c73a0 msgr2=0x7fe9d0162920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 --2- 172.21.15.110:0/496829478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00c73a0 0x7fe9d0162920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0072200 tx=0x7fe9c801f1a0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/496829478 shutdown_connections 2024-04-22T01:11:07.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 --2- 172.21.15.110:0/496829478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00c73a0 0x7fe9d0162920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 --2- 172.21.15.110:0/496829478 >> v2:172.21.15.154:3300/0 conn(0x7fe9d0152040 0x7fe9d01588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/496829478 >> 172.21.15.110:0/496829478 conn(0x7fe9d00cc9a0 msgr2=0x7fe9d00ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:07.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/496829478 shutdown_connections 2024-04-22T01:11:07.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/496829478 wait complete. 2024-04-22T01:11:07.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 Processor -- start 2024-04-22T01:11:07.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- start start 2024-04-22T01:11:07.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9d00c73a0 0x7fe9d0155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d00c8e00 0x7fe9d0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d0152040 0x7fe9d00c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d00c80f0 con 0x7fe9d0152040 2024-04-22T01:11:07.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d01580b0 con 0x7fe9d00c8e00 2024-04-22T01:11:07.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d6c2e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d00727f0 con 0x7fe9d00c73a0 2024-04-22T01:11:07.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.244+0000 7fe9d51cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d0152040 0x7fe9d00c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.248+0000 7fe9d51cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d0152040 0x7fe9d00c1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34616/0 (socket says 172.21.15.110:34616) 2024-04-22T01:11:07.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.248+0000 7fe9d51cb640 1 -- 172.21.15.110:0/476109288 learned_addr learned my addr 172.21.15.110:0/476109288 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:07.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.248+0000 7fe9cffff640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d00c8e00 0x7fe9d0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.248+0000 7fe9d49ca640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9d00c73a0 0x7fe9d0155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.252+0000 7fe9d51cb640 1 -- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9d00c73a0 msgr2=0x7fe9d0155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.252+0000 7fe9d51cb640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9d00c73a0 0x7fe9d0155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.252+0000 7fe9d51cb640 1 -- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d00c8e00 msgr2=0x7fe9d0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.252+0000 7fe9d51cb640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d00c8e00 0x7fe9d0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.252+0000 7fe9d51cb640 1 -- 172.21.15.110:0/476109288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d01f3260 con 0x7fe9d0152040 2024-04-22T01:11:07.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.252+0000 7fe9d51cb640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d0152040 0x7fe9d00c1860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe9c801d850 tx=0x7fe9c801bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:07.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.256+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80b4040 con 0x7fe9d0152040 2024-04-22T01:11:07.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.256+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c80bf070 con 0x7fe9d0152040 2024-04-22T01:11:07.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.256+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d01f3540 con 0x7fe9d0152040 2024-04-22T01:11:07.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.256+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80b9410 con 0x7fe9d0152040 2024-04-22T01:11:07.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.256+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d01f3b00 con 0x7fe9d0152040 2024-04-22T01:11:07.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.260+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9d004f5f0 con 0x7fe9d0152040 2024-04-22T01:11:07.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.280+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9c80b95b0 con 0x7fe9d0152040 2024-04-22T01:11:07.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.280+0000 7fe9cd7fa640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe9b4067940 0x7fe9b4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.280+0000 7fe9d49ca640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe9b4067940 0x7fe9b4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.280+0000 7fe9d49ca640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe9b4067940 0x7fe9b4069e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4007a60 tx=0x7fe9c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:07.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.284+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe9c8002020 con 0x7fe9d0152040 2024-04-22T01:11:07.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.284+0000 7fe9cd7fa640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7fe9b406fb40 0x7fe9b4071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.284+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 --> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9c800ae60 con 0x7fe9b406fb40 2024-04-22T01:11:07.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.284+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe9c80f0d40 con 0x7fe9d0152040 2024-04-22T01:11:07.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.284+0000 7fe9cffff640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7fe9b406fb40 0x7fe9b4071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.284+0000 7fe9cffff640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7fe9b406fb40 0x7fe9b4071f60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:07.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.288+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== osd.6 v2:172.21.15.154:6800/847095598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9c800ae60 con 0x7fe9b406fb40 2024-04-22T01:11:07.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 --> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe9d00c4b20 con 0x7fe9b406fb40 2024-04-22T01:11:07.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9cd7fa640 1 -- 172.21.15.110:0/476109288 <== osd.6 v2:172.21.15.154:6800/847095598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe9d00c4b20 con 0x7fe9b406fb40 2024-04-22T01:11:07.301 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:07.301 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:07.301 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7fe9b406fb40 msgr2=0x7fe9b4071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.154:6800/847095598,v1:172.21.15.154:6801/847095598] conn(0x7fe9b406fb40 0x7fe9b4071f60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe9b4067940 msgr2=0x7fe9b4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fe9b4067940 0x7fe9b4069e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4007a60 tx=0x7fe9c4008040 comp rx=0 tx=0).stop 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d0152040 msgr2=0x7fe9d00c1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 --2- 172.21.15.110:0/476109288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d0152040 0x7fe9d00c1860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe9c801d850 tx=0x7fe9c801bf40 comp rx=0 tx=0).stop 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d51cb640 1 -- 172.21.15.110:0/476109288 reap_dead start 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 shutdown_connections 2024-04-22T01:11:07.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 >> 172.21.15.110:0/476109288 conn(0x7fe9d00cc9a0 msgr2=0x7fe9d0156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:07.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 shutdown_connections 2024-04-22T01:11:07.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.300+0000 7fe9d6c2e640 1 -- 172.21.15.110:0/476109288 wait complete. 2024-04-22T01:11:07.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-22T01:11:07.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.444+0000 7f36a1358640 1 Processor -- start 2024-04-22T01:11:07.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.444+0000 7f36a1358640 1 -- start start 2024-04-22T01:11:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.444+0000 7f36a1358640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f369c154550 0x7f369c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.444+0000 7f36a1358640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369c154930 con 0x7f369c06f390 2024-04-22T01:11:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.444+0000 7f36a1358640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369c15ae30 con 0x7f369c061ff0 2024-04-22T01:11:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.444+0000 7f36a1358640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f369c0c8020 con 0x7f369c154550 2024-04-22T01:11:07.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.448+0000 7f369b7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f369c06f390 0x7f369c164bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60556/0 (socket says 172.21.15.110:60556) 2024-04-22T01:11:07.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.448+0000 7f369b7fe640 1 -- 172.21.15.110:0/2478064012 learned_addr learned my addr 172.21.15.110:0/2478064012 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:07.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.468+0000 7f369affd640 1 --2- 172.21.15.110:0/2478064012 >> v2:172.21.15.154:3300/0 conn(0x7f369c154550 0x7f369c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.476+0000 7f369affd640 1 -- 172.21.15.110:0/2478064012 >> v1:172.21.15.154:6789/0 conn(0x7f369c061ff0 legacy=0x7f369c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:07.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.476+0000 7f369affd640 1 -- 172.21.15.110:0/2478064012 >> v1:172.21.15.110:6789/0 conn(0x7f369c06f390 legacy=0x7f369c164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.476+0000 7f369affd640 1 -- 172.21.15.110:0/2478064012 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c15b110 con 0x7f369c154550 2024-04-22T01:11:07.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.576+0000 7f369affd640 1 --2- 172.21.15.110:0/2478064012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c154550 0x7f369c06b1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36840097c0 tx=0x7f368401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=960e532634b32218 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:07.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.608+0000 7f369a7fc640 1 -- 172.21.15.110:0/2478064012 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36840b5070 con 0x7f369c154550 2024-04-22T01:11:07.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.608+0000 7f369a7fc640 1 -- 172.21.15.110:0/2478064012 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36840a8950 con 0x7f369c154550 2024-04-22T01:11:07.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.608+0000 7f369a7fc640 1 -- 172.21.15.110:0/2478064012 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36840a8d20 con 0x7f369c154550 2024-04-22T01:11:07.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 -- 172.21.15.110:0/2478064012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c154550 msgr2=0x7f369c06b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 --2- 172.21.15.110:0/2478064012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c154550 0x7f369c06b1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36840097c0 tx=0x7f368401ec50 comp rx=0 tx=0).stop 2024-04-22T01:11:07.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 -- 172.21.15.110:0/2478064012 shutdown_connections 2024-04-22T01:11:07.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 --2- 172.21.15.110:0/2478064012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c154550 0x7f369c06b1e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 -- 172.21.15.110:0/2478064012 >> 172.21.15.110:0/2478064012 conn(0x7f369c0cc250 msgr2=0x7f369c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:07.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 -- 172.21.15.110:0/2478064012 shutdown_connections 2024-04-22T01:11:07.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 -- 172.21.15.110:0/2478064012 wait complete. 2024-04-22T01:11:07.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 Processor -- start 2024-04-22T01:11:07.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.612+0000 7f36a1358640 1 -- start start 2024-04-22T01:11:07.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f36a1358640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c061ff0 0x7f369c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f36a1358640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c06f390 0x7f369c1eab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f36a1358640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369c154550 0x7f369c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f36a1358640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0c7cb0 con 0x7f369c154550 2024-04-22T01:11:07.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f36a1358640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0c79d0 con 0x7f369c06f390 2024-04-22T01:11:07.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f36a1358640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f369c06e580 con 0x7f369c061ff0 2024-04-22T01:11:07.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f3693fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c06f390 0x7f369c1eab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f3693fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c06f390 0x7f369c1eab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:50186/0 (socket says 172.21.15.110:50186) 2024-04-22T01:11:07.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.616+0000 7f3693fff640 1 -- 172.21.15.110:0/4166892928 learned_addr learned my addr 172.21.15.110:0/4166892928 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:07.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.628+0000 7f369affd640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c061ff0 0x7f369c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.628+0000 7f3693fff640 1 -- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c061ff0 msgr2=0x7f369c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.628+0000 7f3693fff640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c061ff0 0x7f369c15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.628+0000 7f3693fff640 1 -- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369c154550 msgr2=0x7f369c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.628+0000 7f3693fff640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369c154550 0x7f369c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.628+0000 7f3693fff640 1 -- 172.21.15.110:0/4166892928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c1f19e0 con 0x7f369c06f390 2024-04-22T01:11:07.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.632+0000 7f3693fff640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c06f390 0x7f369c1eab60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c4b0 tx=0x7f368c00c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:07.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.648+0000 7f36937fe640 1 -- 172.21.15.110:0/4166892928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c012830 con 0x7f369c06f390 2024-04-22T01:11:07.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.648+0000 7f36937fe640 1 -- 172.21.15.110:0/4166892928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368c017070 con 0x7f369c06f390 2024-04-22T01:11:07.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.648+0000 7f36937fe640 1 -- 172.21.15.110:0/4166892928 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c012c30 con 0x7f369c06f390 2024-04-22T01:11:07.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.648+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c15c0f0 con 0x7f369c06f390 2024-04-22T01:11:07.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.648+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c1f0f00 con 0x7f369c06f390 2024-04-22T01:11:07.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.648+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c15e670 con 0x7f369c06f390 2024-04-22T01:11:07.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.704+0000 7f36937fe640 1 -- 172.21.15.110:0/4166892928 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f368c01c460 con 0x7f369c06f390 2024-04-22T01:11:07.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.704+0000 7f36937fe640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f367c0678c0 0x7f367c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:07.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.704+0000 7f369affd640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f367c0678c0 0x7f367c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:07.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.704+0000 7f369affd640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f367c0678c0 0x7f367c069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f36840b2000 tx=0x7f3684008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:07.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:07.996+0000 7f36937fe640 1 -- 172.21.15.110:0/4166892928 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f368c054a60 con 0x7f369c06f390 2024-04-22T01:11:08.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.024+0000 7f36937fe640 1 -- 172.21.15.110:0/4166892928 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f368c0570c0 con 0x7f369c06f390 2024-04-22T01:11:08.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f369c04f510 con 0x7f367c0678c0 2024-04-22T01:11:08.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36937fe640 1 -- 172.21.15.110:0/4166892928 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f369c04f510 con 0x7f367c0678c0 2024-04-22T01:11:08.207 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 6 to deep-scrub 2024-04-22T01:11:08.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f367c0678c0 msgr2=0x7f367c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f367c0678c0 0x7f367c069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f36840b2000 tx=0x7f3684008040 comp rx=0 tx=0).stop 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c06f390 msgr2=0x7f369c1eab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c06f390 0x7f369c1eab60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c4b0 tx=0x7f368c00c970 comp rx=0 tx=0).stop 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 shutdown_connections 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f367c0678c0 0x7f367c069d80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f369c154550 0x7f369c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c06f390 0x7f369c1eab60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 --2- 172.21.15.110:0/4166892928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c061ff0 0x7f369c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 >> 172.21.15.110:0/4166892928 conn(0x7f369c0cc250 msgr2=0x7f369c15a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:08.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 shutdown_connections 2024-04-22T01:11:08.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.208+0000 7f36a1358640 1 -- 172.21.15.110:0/4166892928 wait complete. 2024-04-22T01:11:08.227 INFO:tasks.ceph:Scrubbing osd.7 2024-04-22T01:11:08.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-22T01:11:08.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f01920a4640 1 Processor -- start 2024-04-22T01:11:08.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f01920a4640 1 -- start start 2024-04-22T01:11:08.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f01920a4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f018c1546c0 0x7f018c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f01920a4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c15e6d0 con 0x7f018c1542e0 2024-04-22T01:11:08.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f01920a4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c15de30 con 0x7f018c15aac0 2024-04-22T01:11:08.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f01920a4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f018c15e110 con 0x7f018c1546c0 2024-04-22T01:11:08.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f018b7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f018c1542e0 0x7f018c073160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60568/0 (socket says 172.21.15.110:60568) 2024-04-22T01:11:08.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.356+0000 7f018b7fe640 1 -- 172.21.15.110:0/93409792 learned_addr learned my addr 172.21.15.110:0/93409792 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:08.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.360+0000 7f018affd640 1 --2- 172.21.15.110:0/93409792 >> v2:172.21.15.110:3300/0 conn(0x7f018c1546c0 0x7f018c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.360+0000 7f018a7fc640 1 -- 172.21.15.110:0/93409792 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762846000 0 0) 0x7f018c15e6d0 con 0x7f018c1542e0 2024-04-22T01:11:08.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.360+0000 7f018a7fc640 1 -- 172.21.15.110:0/93409792 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0174003530 con 0x7f018c1542e0 2024-04-22T01:11:08.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.364+0000 7f018a7fc640 1 -- 172.21.15.110:0/93409792 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695370751 0 0) 0x7f018c15de30 con 0x7f018c15aac0 2024-04-22T01:11:08.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.364+0000 7f018a7fc640 1 -- 172.21.15.110:0/93409792 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f018c15e6d0 con 0x7f018c15aac0 2024-04-22T01:11:08.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.364+0000 7f018affd640 1 -- 172.21.15.110:0/93409792 >> v1:172.21.15.154:6789/0 conn(0x7f018c15aac0 legacy=0x7f018c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.364+0000 7f018affd640 1 -- 172.21.15.110:0/93409792 >> v1:172.21.15.110:6789/0 conn(0x7f018c1542e0 legacy=0x7f018c073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.364+0000 7f018affd640 1 -- 172.21.15.110:0/93409792 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c15e3f0 con 0x7f018c1546c0 2024-04-22T01:11:08.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.368+0000 7f018affd640 1 --2- 172.21.15.110:0/93409792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1546c0 0x7f018c15d7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f017c0097c0 tx=0x7f017c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3094bf162a6512 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:08.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f018a7fc640 1 -- 172.21.15.110:0/93409792 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0b5070 con 0x7f018c1546c0 2024-04-22T01:11:08.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f018a7fc640 1 -- 172.21.15.110:0/93409792 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c0a8990 con 0x7f018c1546c0 2024-04-22T01:11:08.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f018a7fc640 1 -- 172.21.15.110:0/93409792 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0a8d60 con 0x7f018c1546c0 2024-04-22T01:11:08.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- 172.21.15.110:0/93409792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1546c0 msgr2=0x7f018c15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 --2- 172.21.15.110:0/93409792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1546c0 0x7f018c15d7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f017c0097c0 tx=0x7f017c01ec90 comp rx=0 tx=0).stop 2024-04-22T01:11:08.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- 172.21.15.110:0/93409792 shutdown_connections 2024-04-22T01:11:08.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 --2- 172.21.15.110:0/93409792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1546c0 0x7f018c15d7a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- 172.21.15.110:0/93409792 >> 172.21.15.110:0/93409792 conn(0x7f018c0cc9a0 msgr2=0x7f018c0ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:08.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- 172.21.15.110:0/93409792 shutdown_connections 2024-04-22T01:11:08.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- 172.21.15.110:0/93409792 wait complete. 2024-04-22T01:11:08.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 Processor -- start 2024-04-22T01:11:08.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- start start 2024-04-22T01:11:08.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1542e0 0x7f018c1f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018c1546c0 0x7f018c148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f018c15aac0 0x7f018c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0c7b10 con 0x7f018c1542e0 2024-04-22T01:11:08.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f018c15a5a0 con 0x7f018c1546c0 2024-04-22T01:11:08.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f01920a4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f018c071000 con 0x7f018c15aac0 2024-04-22T01:11:08.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.376+0000 7f018b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1542e0 0x7f018c1f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.380+0000 7f018b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1542e0 0x7f018c1f4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34662/0 (socket says 172.21.15.110:34662) 2024-04-22T01:11:08.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.380+0000 7f018b7fe640 1 -- 172.21.15.110:0/911129679 learned_addr learned my addr 172.21.15.110:0/911129679 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:08.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.380+0000 7f018affd640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018c1546c0 0x7f018c148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.380+0000 7f018bfff640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f018c15aac0 0x7f018c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.384+0000 7f018b7fe640 1 -- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f018c15aac0 msgr2=0x7f018c15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.384+0000 7f018b7fe640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f018c15aac0 0x7f018c15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.384+0000 7f018b7fe640 1 -- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018c1546c0 msgr2=0x7f018c148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.384+0000 7f018b7fe640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018c1546c0 0x7f018c148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.384+0000 7f018b7fe640 1 -- 172.21.15.110:0/911129679 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c1f0380 con 0x7f018c1542e0 2024-04-22T01:11:08.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.384+0000 7f018b7fe640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1542e0 0x7f018c1f4300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f018000c460 tx=0x7f018000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.388+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180017070 con 0x7f018c1542e0 2024-04-22T01:11:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.388+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0180005db0 con 0x7f018c1542e0 2024-04-22T01:11:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.388+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01800072f0 con 0x7f018c1542e0 2024-04-22T01:11:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.388+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c1f0650 con 0x7f018c1542e0 2024-04-22T01:11:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.388+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c1f0c10 con 0x7f018c1542e0 2024-04-22T01:11:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.388+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f018c073640 con 0x7f018c1542e0 2024-04-22T01:11:08.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.408+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f018001a070 con 0x7f018c1542e0 2024-04-22T01:11:08.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.408+0000 7f0173fff640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f01780678f0 0x7f0178069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.408+0000 7f018affd640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f01780678f0 0x7f0178069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.408+0000 7f018affd640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f01780678f0 0x7f0178069db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f017c0b2000 tx=0x7f017c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:08.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.412+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0180053cc0 con 0x7f018c1542e0 2024-04-22T01:11:08.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.412+0000 7f0173fff640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7f017806faf0 0x7f0178071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.412+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 --> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f018001ee50 con 0x7f017806faf0 2024-04-22T01:11:08.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.412+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0180051ec0 con 0x7f018c1542e0 2024-04-22T01:11:08.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.412+0000 7f018bfff640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7f017806faf0 0x7f0178071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.412+0000 7f018bfff640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7f017806faf0 0x7f0178071f10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:08.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.416+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== osd.7 v2:172.21.15.154:6816/2454373145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f018001ee50 con 0x7f017806faf0 2024-04-22T01:11:08.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 --> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f018c04f5f0 con 0x7f017806faf0 2024-04-22T01:11:08.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f0173fff640 1 -- 172.21.15.110:0/911129679 <== osd.7 v2:172.21.15.154:6816/2454373145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f018c04f5f0 con 0x7f017806faf0 2024-04-22T01:11:08.431 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-22T01:11:08.431 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T01:11:08.431 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-22T01:11:08.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7f017806faf0 msgr2=0x7f0178071f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.154:6816/2454373145,v1:172.21.15.154:6817/2454373145] conn(0x7f017806faf0 0x7f0178071f10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f01780678f0 msgr2=0x7f0178069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f01780678f0 0x7f0178069db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f017c0b2000 tx=0x7f017c0aa070 comp rx=0 tx=0).stop 2024-04-22T01:11:08.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1542e0 msgr2=0x7f018c1f4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 --2- 172.21.15.110:0/911129679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f018c1542e0 0x7f018c1f4300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f018000c460 tx=0x7f018000c920 comp rx=0 tx=0).stop 2024-04-22T01:11:08.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f018bfff640 1 -- 172.21.15.110:0/911129679 reap_dead start 2024-04-22T01:11:08.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 shutdown_connections 2024-04-22T01:11:08.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 >> 172.21.15.110:0/911129679 conn(0x7f018c0cc9a0 msgr2=0x7f018c0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:08.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 shutdown_connections 2024-04-22T01:11:08.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.432+0000 7f01920a4640 1 -- 172.21.15.110:0/911129679 wait complete. 2024-04-22T01:11:08.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-22T01:11:08.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f7855711640 1 Processor -- start 2024-04-22T01:11:08.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f7855711640 1 -- start start 2024-04-22T01:11:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f7855711640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78500c98d0 0x7f78500c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f7855711640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7850154980 0x7f785015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f7855711640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78500c8410 con 0x7f78500c9cb0 2024-04-22T01:11:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f7855711640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f78500c81e0 con 0x7f7850154980 2024-04-22T01:11:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f7855711640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f78500c86b0 con 0x7f78500c98d0 2024-04-22T01:11:08.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f784f7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7850154980 0x7f785015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f784e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78500c9cb0 0x7f7850154270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:57852/0 (socket says 172.21.15.110:57852) 2024-04-22T01:11:08.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.564+0000 7f784e7fc640 1 -- 172.21.15.110:0/2148354188 learned_addr learned my addr 172.21.15.110:0/2148354188 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:08.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.568+0000 7f784f7fe640 1 -- 172.21.15.110:0/2148354188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78500c98d0 msgr2=0x7f78500c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:08.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.568+0000 7f784f7fe640 1 --2- 172.21.15.110:0/2148354188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78500c98d0 0x7f78500c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.568+0000 7f784f7fe640 1 -- 172.21.15.110:0/2148354188 >> v1:172.21.15.154:6789/0 conn(0x7f78500c9cb0 legacy=0x7f7850154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.568+0000 7f784f7fe640 1 -- 172.21.15.110:0/2148354188 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7850072d30 con 0x7f7850154980 2024-04-22T01:11:08.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.572+0000 7f784f7fe640 1 --2- 172.21.15.110:0/2148354188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7850154980 0x7f785015a8a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78400097c0 tx=0x7f784001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23c4220bb44727f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:08.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f784dffb640 1 -- 172.21.15.110:0/2148354188 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400b5070 con 0x7f7850154980 2024-04-22T01:11:08.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f784dffb640 1 -- 172.21.15.110:0/2148354188 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78400a8990 con 0x7f7850154980 2024-04-22T01:11:08.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f784dffb640 1 -- 172.21.15.110:0/2148354188 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400a8d60 con 0x7f7850154980 2024-04-22T01:11:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 -- 172.21.15.110:0/2148354188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7850154980 msgr2=0x7f785015a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 --2- 172.21.15.110:0/2148354188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7850154980 0x7f785015a8a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78400097c0 tx=0x7f784001ec90 comp rx=0 tx=0).stop 2024-04-22T01:11:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 -- 172.21.15.110:0/2148354188 shutdown_connections 2024-04-22T01:11:08.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 --2- 172.21.15.110:0/2148354188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7850154980 0x7f785015a8a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 --2- 172.21.15.110:0/2148354188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78500c98d0 0x7f78500c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 -- 172.21.15.110:0/2148354188 >> 172.21.15.110:0/2148354188 conn(0x7f785006ca80 msgr2=0x7f7850070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:08.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 -- 172.21.15.110:0/2148354188 shutdown_connections 2024-04-22T01:11:08.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.576+0000 7f7855711640 1 -- 172.21.15.110:0/2148354188 wait complete. 2024-04-22T01:11:08.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 Processor -- start 2024-04-22T01:11:08.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 -- start start 2024-04-22T01:11:08.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78500c98d0 0x7f78501e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78500c9cb0 0x7f78501efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7850154980 0x7f78501591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f785006efe0 con 0x7f78500c9cb0 2024-04-22T01:11:08.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7850072ae0 con 0x7f78500c98d0 2024-04-22T01:11:08.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f7855711640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f785006f160 con 0x7f7850154980 2024-04-22T01:11:08.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f784e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78500c9cb0 0x7f78501efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f784e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78500c9cb0 0x7f78501efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34674/0 (socket says 172.21.15.110:34674) 2024-04-22T01:11:08.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.580+0000 7f784e7fc640 1 -- 172.21.15.110:0/217175984 learned_addr learned my addr 172.21.15.110:0/217175984 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:08.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.584+0000 7f784effd640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78500c98d0 0x7f78501e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.584+0000 7f784e7fc640 1 -- 172.21.15.110:0/217175984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7850154980 msgr2=0x7f78501591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.584+0000 7f784e7fc640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7850154980 0x7f78501591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.584+0000 7f784e7fc640 1 -- 172.21.15.110:0/217175984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78500c98d0 msgr2=0x7f78501e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:08.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.584+0000 7f784e7fc640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78500c98d0 0x7f78501e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:08.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.584+0000 7f784e7fc640 1 -- 172.21.15.110:0/217175984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78501e56a0 con 0x7f78500c9cb0 2024-04-22T01:11:08.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.588+0000 7f784e7fc640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78500c9cb0 0x7f78501efff0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f783800c420 tx=0x7f783800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:08.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.592+0000 7f78477fe640 1 -- 172.21.15.110:0/217175984 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838017070 con 0x7f78500c9cb0 2024-04-22T01:11:08.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.592+0000 7f78477fe640 1 -- 172.21.15.110:0/217175984 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7838005cf0 con 0x7f78500c9cb0 2024-04-22T01:11:08.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.592+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78501e5980 con 0x7f78500c9cb0 2024-04-22T01:11:08.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.592+0000 7f78477fe640 1 -- 172.21.15.110:0/217175984 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78380072f0 con 0x7f78500c9cb0 2024-04-22T01:11:08.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.592+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78501f39e0 con 0x7f78500c9cb0 2024-04-22T01:11:08.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.592+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785004f510 con 0x7f78500c9cb0 2024-04-22T01:11:08.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.612+0000 7f78477fe640 1 -- 172.21.15.110:0/217175984 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f783801a070 con 0x7f78500c9cb0 2024-04-22T01:11:08.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.616+0000 7f78477fe640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7830067910 0x7f7830069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:08.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.616+0000 7f784effd640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7830067910 0x7f7830069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:08.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.616+0000 7f784effd640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7830067910 0x7f7830069dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7848007dc0 tx=0x7f78480072f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:08.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.620+0000 7f78477fe640 1 -- 172.21.15.110:0/217175984 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f7838053960 con 0x7f78500c9cb0 2024-04-22T01:11:08.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:08.952+0000 7f78477fe640 1 -- 172.21.15.110:0/217175984 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f7838021020 con 0x7f78500c9cb0 2024-04-22T01:11:09.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.120+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f7850073400 con 0x7f7830067910 2024-04-22T01:11:09.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f78477fe640 1 -- 172.21.15.110:0/217175984 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7850073400 con 0x7f7830067910 2024-04-22T01:11:09.122 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 7 to deep-scrub 2024-04-22T01:11:09.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7830067910 msgr2=0x7f7830069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7830067910 0x7f7830069dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7848007dc0 tx=0x7f78480072f0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78500c9cb0 msgr2=0x7f78501efff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78500c9cb0 0x7f78501efff0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f783800c420 tx=0x7f783800c8e0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 shutdown_connections 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f7830067910 0x7f7830069dd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7850154980 0x7f78501591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78500c9cb0 0x7f78501efff0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 --2- 172.21.15.110:0/217175984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78500c98d0 0x7f78501e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 >> 172.21.15.110:0/217175984 conn(0x7f785006ca80 msgr2=0x7f78500c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 shutdown_connections 2024-04-22T01:11:09.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.124+0000 7f7855711640 1 -- 172.21.15.110:0/217175984 wait complete. 2024-04-22T01:11:09.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T01:11:09.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.268+0000 7f93aabf3640 1 Processor -- start 2024-04-22T01:11:09.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.268+0000 7f93aabf3640 1 -- start start 2024-04-22T01:11:09.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93aabf3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93a40c98d0 0x7f93a40c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:09.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93aabf3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93a40c9cb0 0x7f93a4154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:09.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93aabf3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a406ddf0 0x7f93a41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:09.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93aabf3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f93a40c81e0 con 0x7f93a40c9cb0 2024-04-22T01:11:09.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93aabf3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f93a40c86b0 con 0x7f93a40c98d0 2024-04-22T01:11:09.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93aabf3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f93a4072ae0 con 0x7f93a406ddf0 2024-04-22T01:11:09.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93a40c9cb0 0x7f93a4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:09.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93a40c9cb0 0x7f93a4154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46780/0 (socket says 172.21.15.110:46780) 2024-04-22T01:11:09.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 -- 172.21.15.110:0/2708832140 learned_addr learned my addr 172.21.15.110:0/2708832140 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:09.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 -- 172.21.15.110:0/2708832140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a406ddf0 msgr2=0x7f93a41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:09.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 --2- 172.21.15.110:0/2708832140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a406ddf0 0x7f93a41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 -- 172.21.15.110:0/2708832140 >> v2:172.21.15.154:3300/0 conn(0x7f93a40c98d0 msgr2=0x7f93a40c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:09.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 --2- 172.21.15.110:0/2708832140 >> v2:172.21.15.154:3300/0 conn(0x7f93a40c98d0 0x7f93a40c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.272+0000 7f93a3fff640 1 -- 172.21.15.110:0/2708832140 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a40c8410 con 0x7f93a40c9cb0 2024-04-22T01:11:09.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.276+0000 7f93a3fff640 1 --2- 172.21.15.110:0/2708832140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c9cb0 0x7f93a4154270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93a40c7700 tx=0x7f939801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b169e80a7a69433 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93a37fe640 1 -- 172.21.15.110:0/2708832140 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980b5070 con 0x7f93a40c9cb0 2024-04-22T01:11:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93a37fe640 1 -- 172.21.15.110:0/2708832140 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93980a89d0 con 0x7f93a40c9cb0 2024-04-22T01:11:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93a37fe640 1 -- 172.21.15.110:0/2708832140 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980a8da0 con 0x7f93a40c9cb0 2024-04-22T01:11:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93aabf3640 1 -- 172.21.15.110:0/2708832140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c9cb0 msgr2=0x7f93a4154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93aabf3640 1 --2- 172.21.15.110:0/2708832140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c9cb0 0x7f93a4154270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93a40c7700 tx=0x7f939801ed10 comp rx=0 tx=0).stop 2024-04-22T01:11:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93aabf3640 1 -- 172.21.15.110:0/2708832140 shutdown_connections 2024-04-22T01:11:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93aabf3640 1 --2- 172.21.15.110:0/2708832140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a406ddf0 0x7f93a41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93aabf3640 1 --2- 172.21.15.110:0/2708832140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c9cb0 0x7f93a4154270 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.280+0000 7f93aabf3640 1 --2- 172.21.15.110:0/2708832140 >> v2:172.21.15.154:3300/0 conn(0x7f93a40c98d0 0x7f93a40c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 -- 172.21.15.110:0/2708832140 >> 172.21.15.110:0/2708832140 conn(0x7f93a406ca80 msgr2=0x7f93a4070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:09.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 -- 172.21.15.110:0/2708832140 shutdown_connections 2024-04-22T01:11:09.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 -- 172.21.15.110:0/2708832140 wait complete. 2024-04-22T01:11:09.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 Processor -- start 2024-04-22T01:11:09.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 -- start start 2024-04-22T01:11:09.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93a406ddf0 0x7f93a414a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:09.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c98d0 0x7f93a40cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:09.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a40c9cb0 0x7f93a4153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:09.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f93a406efe0 con 0x7f93a40c98d0 2024-04-22T01:11:09.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4073010 con 0x7f93a406ddf0 2024-04-22T01:11:09.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93aabf3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f93a406f160 con 0x7f93a40c9cb0 2024-04-22T01:11:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93a3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c98d0 0x7f93a40cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93a3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c98d0 0x7f93a40cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46788/0 (socket says 172.21.15.110:46788) 2024-04-22T01:11:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.284+0000 7f93a3fff640 1 -- 172.21.15.110:0/3018826676 learned_addr learned my addr 172.21.15.110:0/3018826676 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.288+0000 7f93a3fff640 1 -- 172.21.15.110:0/3018826676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a40c9cb0 msgr2=0x7f93a4153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.288+0000 7f93a3fff640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a40c9cb0 0x7f93a4153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.288+0000 7f93a3fff640 1 -- 172.21.15.110:0/3018826676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93a406ddf0 msgr2=0x7f93a414a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.288+0000 7f93a3fff640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93a406ddf0 0x7f93a414a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.288+0000 7f93a3fff640 1 -- 172.21.15.110:0/3018826676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a414a690 con 0x7f93a40c98d0 2024-04-22T01:11:09.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.292+0000 7f93a3fff640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c98d0 0x7f93a40cb050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f939801f5b0 tx=0x7f939801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.296+0000 7f93a17fa640 1 -- 172.21.15.110:0/3018826676 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980b5040 con 0x7f93a40c98d0 2024-04-22T01:11:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.296+0000 7f93a17fa640 1 -- 172.21.15.110:0/3018826676 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93980c2070 con 0x7f93a40c98d0 2024-04-22T01:11:09.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.296+0000 7f93a17fa640 1 -- 172.21.15.110:0/3018826676 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980b0ae0 con 0x7f93a40c98d0 2024-04-22T01:11:09.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.296+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a40c5fa0 con 0x7f93a40c98d0 2024-04-22T01:11:09.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.296+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a40c4080 con 0x7f93a40c98d0 2024-04-22T01:11:09.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.296+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a404f510 con 0x7f93a40c98d0 2024-04-22T01:11:09.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.560+0000 7f93a17fa640 1 -- 172.21.15.110:0/3018826676 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93980b0c80 con 0x7f93a40c98d0 2024-04-22T01:11:09.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.560+0000 7f93a17fa640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9390067940 0x7f9390069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:09.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.560+0000 7f93a898f640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9390067940 0x7f9390069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:09.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.564+0000 7f93a898f640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9390067940 0x7f9390069e00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9394009730 tx=0x7f9394006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:09.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.572+0000 7f93a17fa640 1 -- 172.21.15.110:0/3018826676 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f93980f29a0 con 0x7f93a40c98d0 2024-04-22T01:11:09.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.572+0000 7f93a17fa640 1 -- 172.21.15.110:0/3018826676 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f9398018870 con 0x7f93a40c98d0 2024-04-22T01:11:09.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.748+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93a4073400 con 0x7f9390067940 2024-04-22T01:11:09.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.764+0000 7f93a17fa640 1 -- 172.21.15.110:0/3018826676 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252109 (secure 0 0 0) 0x7f93a4073400 con 0x7f9390067940 2024-04-22T01:11:09.769 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:11:09.771 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9390067940 msgr2=0x7f9390069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9390067940 0x7f9390069e00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9394009730 tx=0x7f9394006ca0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c98d0 msgr2=0x7f93a40cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c98d0 0x7f93a40cb050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f939801f5b0 tx=0x7f939801bab0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 shutdown_connections 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9390067940 0x7f9390069e00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93a40c9cb0 0x7f93a4153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93a40c98d0 0x7f93a40cb050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 --2- 172.21.15.110:0/3018826676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93a406ddf0 0x7f93a414a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:09.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 >> 172.21.15.110:0/3018826676 conn(0x7f93a406ca80 msgr2=0x7f93a415a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:09.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 shutdown_connections 2024-04-22T01:11:09.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:09.772+0000 7f93aabf3640 1 -- 172.21.15.110:0/3018826676 wait complete. 2024-04-22T01:11:09.790 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":4167,"stamp":"2024-04-22T01:11:08.502910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213720375,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":7236,"num_read_kb":1459077,"num_write":73026,"num_write_kb":4525199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65707,"ondisk_log_size":65707,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":946224,"kb_used_data":224816,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":754028496,"statfs":{"total":773094113280,"available":772125179904,"internally_reserved":0,"allocated":230211584,"data_stored":428189614,"data_compressed":52390758,"data_compressed_allocated":69984256,"data_compressed_original":269344768,"omap_allocated":12749,"internal_metadata":738643507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003875"},"pg_stats":[{"pgid":"3.3f","version":"25'426","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.784481+0000","last_change":"2024-04-21T22:53:38.615584+0000","last_active":"2024-04-22T01:10:50.784481+0000","last_peered":"2024-04-22T01:10:50.784481+0000","last_clean":"2024-04-22T01:10:50.784481+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-22T01:10:50.784481+0000","last_undegraded":"2024-04-22T01:10:50.784481+0000","last_fullsized":"2024-04-22T01:10:50.784481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28398,"num_write":395,"num_write_kb":75936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'442","reported_seq":569,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.085870+0000","last_change":"2024-04-21T22:53:38.595788+0000","last_active":"2024-04-22T01:11:07.085870+0000","last_peered":"2024-04-22T01:11:07.085870+0000","last_clean":"2024-04-22T01:11:07.085870+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-22T01:11:07.085870+0000","last_undegraded":"2024-04-22T01:11:07.085870+0000","last_fullsized":"2024-04-22T01:11:07.085870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20820,"num_write":419,"num_write_kb":84104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'391","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.085896+0000","last_change":"2024-04-21T22:53:38.584129+0000","last_active":"2024-04-22T01:11:07.085896+0000","last_peered":"2024-04-22T01:11:07.085896+0000","last_clean":"2024-04-22T01:11:07.085896+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-22T01:11:07.085896+0000","last_undegraded":"2024-04-22T01:11:07.085896+0000","last_fullsized":"2024-04-22T01:11:07.085896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18719,"num_write":364,"num_write_kb":70997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'353","reported_seq":450,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.465101+0000","last_change":"2024-04-21T22:53:38.496214+0000","last_active":"2024-04-22T01:10:50.465101+0000","last_peered":"2024-04-22T01:10:50.465101+0000","last_clean":"2024-04-22T01:10:50.465101+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-22T01:10:50.465101+0000","last_undegraded":"2024-04-22T01:10:50.465101+0000","last_fullsized":"2024-04-22T01:10:50.465101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":316,"num_write_kb":12972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'420","reported_seq":503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.788169+0000","last_change":"2024-04-21T22:53:38.606388+0000","last_active":"2024-04-22T01:10:50.788169+0000","last_peered":"2024-04-22T01:10:50.788169+0000","last_clean":"2024-04-22T01:10:50.788169+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-22T01:10:50.788169+0000","last_undegraded":"2024-04-22T01:10:50.788169+0000","last_fullsized":"2024-04-22T01:10:50.788169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":394,"num_write_kb":67878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'395","reported_seq":499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.464292+0000","last_change":"2024-04-21T22:53:38.500284+0000","last_active":"2024-04-22T01:10:50.464292+0000","last_peered":"2024-04-22T01:10:50.464292+0000","last_clean":"2024-04-22T01:10:50.464292+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-22T01:10:50.464292+0000","last_undegraded":"2024-04-22T01:10:50.464292+0000","last_fullsized":"2024-04-22T01:10:50.464292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17967,"num_write":373,"num_write_kb":71499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.788147+0000","last_change":"2024-04-21T22:53:38.621321+0000","last_active":"2024-04-22T01:10:50.788147+0000","last_peered":"2024-04-22T01:10:50.788147+0000","last_clean":"2024-04-22T01:10:50.788147+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-22T01:10:50.788147+0000","last_undegraded":"2024-04-22T01:10:50.788147+0000","last_fullsized":"2024-04-22T01:10:50.788147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13670,"num_write":376,"num_write_kb":39263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'387","reported_seq":535,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.085798+0000","last_change":"2024-04-21T22:53:38.597403+0000","last_active":"2024-04-22T01:11:07.085798+0000","last_peered":"2024-04-22T01:11:07.085798+0000","last_clean":"2024-04-22T01:11:07.085798+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-22T01:11:07.085798+0000","last_undegraded":"2024-04-22T01:11:07.085798+0000","last_fullsized":"2024-04-22T01:11:07.085798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":42822,"num_write":351,"num_write_kb":100036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'424","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.951443+0000","last_change":"2024-04-22T01:11:04.951506+0000","last_active":"2024-04-22T01:11:04.951443+0000","last_peered":"2024-04-22T01:11:04.951443+0000","last_clean":"2024-04-22T01:11:04.951443+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-22T01:11:04.951443+0000","last_undegraded":"2024-04-22T01:11:04.951443+0000","last_fullsized":"2024-04-22T01:11:04.951443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'424","last_scrub_stamp":"2024-04-22T01:11:04.951252+0000","last_deep_scrub":"25'424","last_deep_scrub_stamp":"2024-04-22T01:11:04.951252+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.951252+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:01.833955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20454,"num_write":396,"num_write_kb":59842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.788139+0000","last_change":"2024-04-21T22:53:38.607485+0000","last_active":"2024-04-22T01:10:50.788139+0000","last_peered":"2024-04-22T01:10:50.788139+0000","last_clean":"2024-04-22T01:10:50.788139+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-22T01:10:50.788139+0000","last_undegraded":"2024-04-22T01:10:50.788139+0000","last_fullsized":"2024-04-22T01:10:50.788139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5548,"num_write":382,"num_write_kb":76042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'383","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.789190+0000","last_change":"2024-04-21T22:53:38.617226+0000","last_active":"2024-04-22T01:10:50.789190+0000","last_peered":"2024-04-22T01:10:50.789190+0000","last_clean":"2024-04-22T01:10:50.789190+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-22T01:10:50.789190+0000","last_undegraded":"2024-04-22T01:10:50.789190+0000","last_fullsized":"2024-04-22T01:10:50.789190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12739,"num_write":368,"num_write_kb":54575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'362","reported_seq":467,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.792385+0000","last_change":"2024-04-21T22:53:38.621226+0000","last_active":"2024-04-22T01:10:50.792385+0000","last_peered":"2024-04-22T01:10:50.792385+0000","last_clean":"2024-04-22T01:10:50.792385+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-22T01:10:50.792385+0000","last_undegraded":"2024-04-22T01:10:50.792385+0000","last_fullsized":"2024-04-22T01:10:50.792385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9062,"num_write":334,"num_write_kb":50352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'384","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.511489+0000","last_change":"2024-04-21T22:53:38.612502+0000","last_active":"2024-04-22T01:10:50.511489+0000","last_peered":"2024-04-22T01:10:50.511489+0000","last_clean":"2024-04-22T01:10:50.511489+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-22T01:10:50.511489+0000","last_undegraded":"2024-04-22T01:10:50.511489+0000","last_fullsized":"2024-04-22T01:10:50.511489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:56:57.664180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12819,"num_write":349,"num_write_kb":62920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'430","reported_seq":537,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.506564+0000","last_change":"2024-04-21T22:53:38.598145+0000","last_active":"2024-04-22T01:10:50.506564+0000","last_peered":"2024-04-22T01:10:50.506564+0000","last_clean":"2024-04-22T01:10:50.506564+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-22T01:10:50.506564+0000","last_undegraded":"2024-04-22T01:10:50.506564+0000","last_fullsized":"2024-04-22T01:10:50.506564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21265,"num_write":396,"num_write_kb":88387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'436","reported_seq":552,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669798+0000","last_change":"2024-04-21T22:53:38.620201+0000","last_active":"2024-04-22T01:10:50.669798+0000","last_peered":"2024-04-22T01:10:50.669798+0000","last_clean":"2024-04-22T01:10:50.669798+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-22T01:10:50.669798+0000","last_undegraded":"2024-04-22T01:10:50.669798+0000","last_fullsized":"2024-04-22T01:10:50.669798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21940,"num_write":398,"num_write_kb":112507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'433","reported_seq":558,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.643115+0000","last_change":"2024-04-21T22:53:38.498770+0000","last_active":"2024-04-22T01:10:50.643115+0000","last_peered":"2024-04-22T01:10:50.643115+0000","last_clean":"2024-04-22T01:10:50.643115+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-22T01:10:50.643115+0000","last_undegraded":"2024-04-22T01:10:50.643115+0000","last_fullsized":"2024-04-22T01:10:50.643115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26769,"num_write":400,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'401","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.622687+0000","last_change":"2024-04-21T22:54:44.971067+0000","last_active":"2024-04-22T01:10:50.622687+0000","last_peered":"2024-04-22T01:10:50.622687+0000","last_clean":"2024-04-22T01:10:50.622687+0000","last_became_active":"2024-04-21T22:54:44.970288+0000","last_became_peered":"2024-04-21T22:54:44.970288+0000","last_unstale":"2024-04-22T01:10:50.622687+0000","last_undegraded":"2024-04-22T01:10:50.622687+0000","last_fullsized":"2024-04-22T01:10:50.622687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17556,"num_write":374,"num_write_kb":67589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'395","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.523427+0000","last_change":"2024-04-21T22:53:38.499487+0000","last_active":"2024-04-22T01:10:50.523427+0000","last_peered":"2024-04-22T01:10:50.523427+0000","last_clean":"2024-04-22T01:10:50.523427+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-22T01:10:50.523427+0000","last_undegraded":"2024-04-22T01:10:50.523427+0000","last_fullsized":"2024-04-22T01:10:50.523427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:20.523439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22256,"num_write":365,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'432","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.627034+0000","last_change":"2024-04-21T22:53:38.467764+0000","last_active":"2024-04-22T01:10:50.627034+0000","last_peered":"2024-04-22T01:10:50.627034+0000","last_clean":"2024-04-22T01:10:50.627034+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-22T01:10:50.627034+0000","last_undegraded":"2024-04-22T01:10:50.627034+0000","last_fullsized":"2024-04-22T01:10:50.627034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39722,"num_write":402,"num_write_kb":89327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:02.290331+0000","last_change":"2024-04-22T01:11:02.290354+0000","last_active":"2024-04-22T01:11:02.290331+0000","last_peered":"2024-04-22T01:11:02.290331+0000","last_clean":"2024-04-22T01:11:02.290331+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-22T01:11:02.290331+0000","last_undegraded":"2024-04-22T01:11:02.290331+0000","last_fullsized":"2024-04-22T01:11:02.290331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'435","last_scrub_stamp":"2024-04-22T01:11:02.290250+0000","last_deep_scrub":"25'435","last_deep_scrub_stamp":"2024-04-22T01:11:02.290250+0000","last_clean_scrub_stamp":"2024-04-22T01:11:02.290250+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:36:09.152675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4220,"num_write":403,"num_write_kb":46421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'421","reported_seq":524,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675472+0000","last_change":"2024-04-21T22:53:38.501315+0000","last_active":"2024-04-22T01:10:50.675472+0000","last_peered":"2024-04-22T01:10:50.675472+0000","last_clean":"2024-04-22T01:10:50.675472+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-22T01:10:50.675472+0000","last_undegraded":"2024-04-22T01:10:50.675472+0000","last_fullsized":"2024-04-22T01:10:50.675472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:32:25.826371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":8093,"num_write":400,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'410","reported_seq":536,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:55.424177+0000","last_change":"2024-04-21T22:53:38.604111+0000","last_active":"2024-04-22T01:10:55.424177+0000","last_peered":"2024-04-22T01:10:55.424177+0000","last_clean":"2024-04-22T01:10:55.424177+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-22T01:10:55.424177+0000","last_undegraded":"2024-04-22T01:10:55.424177+0000","last_fullsized":"2024-04-22T01:10:55.424177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28547,"num_write":383,"num_write_kb":51065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'415","reported_seq":553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:53.146702+0000","last_change":"2024-04-21T22:53:38.583592+0000","last_active":"2024-04-22T01:10:53.146702+0000","last_peered":"2024-04-22T01:10:53.146702+0000","last_clean":"2024-04-22T01:10:53.146702+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-22T01:10:53.146702+0000","last_undegraded":"2024-04-22T01:10:53.146702+0000","last_fullsized":"2024-04-22T01:10:53.146702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":35420,"num_write":386,"num_write_kb":88354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'418","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:55.459874+0000","last_change":"2024-04-21T22:53:38.587736+0000","last_active":"2024-04-22T01:10:55.459874+0000","last_peered":"2024-04-22T01:10:55.459874+0000","last_clean":"2024-04-22T01:10:55.459874+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-22T01:10:55.459874+0000","last_undegraded":"2024-04-22T01:10:55.459874+0000","last_fullsized":"2024-04-22T01:10:55.459874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6808,"num_write":388,"num_write_kb":34297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'391","reported_seq":478,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669717+0000","last_change":"2024-04-21T22:53:38.587297+0000","last_active":"2024-04-22T01:10:50.669717+0000","last_peered":"2024-04-22T01:10:50.669717+0000","last_clean":"2024-04-22T01:10:50.669717+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-22T01:10:50.669717+0000","last_undegraded":"2024-04-22T01:10:50.669717+0000","last_fullsized":"2024-04-22T01:10:50.669717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4176,"num_write":374,"num_write_kb":46218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'491","reported_seq":622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.487372+0000","last_change":"2024-04-21T22:53:38.506493+0000","last_active":"2024-04-22T01:10:50.487372+0000","last_peered":"2024-04-22T01:10:50.487372+0000","last_clean":"2024-04-22T01:10:50.487372+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-22T01:10:50.487372+0000","last_undegraded":"2024-04-22T01:10:50.487372+0000","last_fullsized":"2024-04-22T01:10:50.487372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29218,"num_write":445,"num_write_kb":101143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'436","reported_seq":576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.476674+0000","last_change":"2024-04-21T22:53:38.598162+0000","last_active":"2024-04-22T01:10:50.476674+0000","last_peered":"2024-04-22T01:10:50.476674+0000","last_clean":"2024-04-22T01:10:50.476674+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-22T01:10:50.476674+0000","last_undegraded":"2024-04-22T01:10:50.476674+0000","last_fullsized":"2024-04-22T01:10:50.476674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.646724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29285,"num_write":407,"num_write_kb":84259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'386","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.510987+0000","last_change":"2024-04-21T22:53:38.623558+0000","last_active":"2024-04-22T01:10:50.510987+0000","last_peered":"2024-04-22T01:10:50.510987+0000","last_clean":"2024-04-22T01:10:50.510987+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-22T01:10:50.510987+0000","last_undegraded":"2024-04-22T01:10:50.510987+0000","last_fullsized":"2024-04-22T01:10:50.510987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28108,"num_write":361,"num_write_kb":80021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'403","reported_seq":547,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669446+0000","last_change":"2024-04-21T22:53:38.584593+0000","last_active":"2024-04-22T01:10:50.669446+0000","last_peered":"2024-04-22T01:10:50.669446+0000","last_clean":"2024-04-22T01:10:50.669446+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-22T01:10:50.669446+0000","last_undegraded":"2024-04-22T01:10:50.669446+0000","last_fullsized":"2024-04-22T01:10:50.669446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31845,"num_write":369,"num_write_kb":46987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'465","reported_seq":605,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.648461+0000","last_change":"2024-04-21T22:53:38.585081+0000","last_active":"2024-04-22T01:10:50.648461+0000","last_peered":"2024-04-22T01:10:50.648461+0000","last_clean":"2024-04-22T01:10:50.648461+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-22T01:10:50.648461+0000","last_undegraded":"2024-04-22T01:10:50.648461+0000","last_fullsized":"2024-04-22T01:10:50.648461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":45092,"num_write":433,"num_write_kb":99910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'465","reported_seq":620,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.524219+0000","last_change":"2024-04-21T22:53:38.580167+0000","last_active":"2024-04-22T01:10:50.524219+0000","last_peered":"2024-04-22T01:10:50.524219+0000","last_clean":"2024-04-22T01:10:50.524219+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-22T01:10:50.524219+0000","last_undegraded":"2024-04-22T01:10:50.524219+0000","last_fullsized":"2024-04-22T01:10:50.524219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:06:13.558260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44084,"num_write":435,"num_write_kb":97059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'430","reported_seq":551,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.470908+0000","last_change":"2024-04-21T22:53:38.594560+0000","last_active":"2024-04-22T01:10:50.470908+0000","last_peered":"2024-04-22T01:10:50.470908+0000","last_clean":"2024-04-22T01:10:50.470908+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-22T01:10:50.470908+0000","last_undegraded":"2024-04-22T01:10:50.470908+0000","last_fullsized":"2024-04-22T01:10:50.470908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14125,"num_write":397,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":547,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790057+0000","last_change":"2024-04-21T22:53:38.583278+0000","last_active":"2024-04-22T01:10:50.790057+0000","last_peered":"2024-04-22T01:10:50.790057+0000","last_clean":"2024-04-22T01:10:50.790057+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-22T01:10:50.790057+0000","last_undegraded":"2024-04-22T01:10:50.790057+0000","last_fullsized":"2024-04-22T01:10:50.790057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31266,"num_write":385,"num_write_kb":75657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'363","reported_seq":437,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.085443+0000","last_change":"2024-04-21T22:53:37.254422+0000","last_active":"2024-04-22T01:11:07.085443+0000","last_peered":"2024-04-22T01:11:07.085443+0000","last_clean":"2024-04-22T01:11:07.085443+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-22T01:11:07.085443+0000","last_undegraded":"2024-04-22T01:11:07.085443+0000","last_fullsized":"2024-04-22T01:11:07.085443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'372","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.675292+0000","last_change":"2024-04-21T22:53:38.602041+0000","last_active":"2024-04-22T01:10:50.675292+0000","last_peered":"2024-04-22T01:10:50.675292+0000","last_clean":"2024-04-22T01:10:50.675292+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-22T01:10:50.675292+0000","last_undegraded":"2024-04-22T01:10:50.675292+0000","last_fullsized":"2024-04-22T01:10:50.675292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:15.519356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19141,"num_write":353,"num_write_kb":42712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'2175","reported_seq":2248,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:09.368304+0000","last_change":"2024-04-21T22:53:37.188655+0000","last_active":"2024-04-22T01:09:09.368304+0000","last_peered":"2024-04-22T01:09:09.368304+0000","last_clean":"2024-04-22T01:09:09.368304+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-22T01:09:09.368304+0000","last_undegraded":"2024-04-22T01:09:09.368304+0000","last_fullsized":"2024-04-22T01:09:09.368304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":2175,"log_dups_size":0,"ondisk_log_size":2175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2118,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'778","reported_seq":852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:45.527664+0000","last_change":"2024-04-21T22:53:37.187621+0000","last_active":"2024-04-22T01:09:45.527664+0000","last_peered":"2024-04-22T01:09:45.527664+0000","last_clean":"2024-04-22T01:09:45.527664+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-22T01:09:45.527664+0000","last_undegraded":"2024-04-22T01:09:45.527664+0000","last_fullsized":"2024-04-22T01:09:45.527664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:39:06.401584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'427","reported_seq":544,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671623+0000","last_change":"2024-04-21T22:53:38.595685+0000","last_active":"2024-04-22T01:10:50.671623+0000","last_peered":"2024-04-22T01:10:50.671623+0000","last_clean":"2024-04-22T01:10:50.671623+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-22T01:10:50.671623+0000","last_undegraded":"2024-04-22T01:10:50.671623+0000","last_fullsized":"2024-04-22T01:10:50.671623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27111,"num_write":394,"num_write_kb":58934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1416","reported_seq":1491,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:42.568510+0000","last_change":"2024-04-21T22:53:37.188454+0000","last_active":"2024-04-22T01:10:42.568510+0000","last_peered":"2024-04-22T01:10:42.568510+0000","last_clean":"2024-04-22T01:10:42.568510+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-22T01:10:42.568510+0000","last_undegraded":"2024-04-22T01:10:42.568510+0000","last_fullsized":"2024-04-22T01:10:42.568510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1416,"log_dups_size":0,"ondisk_log_size":1416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":12962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'395","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.674564+0000","last_change":"2024-04-21T22:53:38.580031+0000","last_active":"2024-04-22T01:10:50.674564+0000","last_peered":"2024-04-22T01:10:50.674564+0000","last_clean":"2024-04-22T01:10:50.674564+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-22T01:10:50.674564+0000","last_undegraded":"2024-04-22T01:10:50.674564+0000","last_fullsized":"2024-04-22T01:10:50.674564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:23:39.077675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":217,"num_write":366,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'56","reported_seq":139,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:03.937410+0000","last_change":"2024-04-22T01:11:03.937470+0000","last_active":"2024-04-22T01:11:03.937410+0000","last_peered":"2024-04-22T01:11:03.937410+0000","last_clean":"2024-04-22T01:11:03.937410+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-22T01:11:03.937410+0000","last_undegraded":"2024-04-22T01:11:03.937410+0000","last_fullsized":"2024-04-22T01:11:03.937410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2024-04-22T01:11:03.937228+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2024-04-22T01:11:03.937228+0000","last_clean_scrub_stamp":"2024-04-22T01:11:03.937228+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:13.642617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'451","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.489465+0000","last_change":"2024-04-21T22:53:38.502483+0000","last_active":"2024-04-22T01:10:50.489465+0000","last_peered":"2024-04-22T01:10:50.489465+0000","last_clean":"2024-04-22T01:10:50.489465+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-22T01:10:50.489465+0000","last_undegraded":"2024-04-22T01:10:50.489465+0000","last_fullsized":"2024-04-22T01:10:50.489465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27728,"num_write":424,"num_write_kb":88654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1252","reported_seq":1327,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.894882+0000","last_change":"2024-04-21T22:53:37.190126+0000","last_active":"2024-04-22T01:10:50.894882+0000","last_peered":"2024-04-22T01:10:50.894882+0000","last_clean":"2024-04-22T01:10:50.894882+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-22T01:10:50.894882+0000","last_undegraded":"2024-04-22T01:10:50.894882+0000","last_fullsized":"2024-04-22T01:10:50.894882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10339768,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":10694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'398","reported_seq":500,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669877+0000","last_change":"2024-04-21T22:53:38.584158+0000","last_active":"2024-04-22T01:10:50.669877+0000","last_peered":"2024-04-22T01:10:50.669877+0000","last_clean":"2024-04-22T01:10:50.669877+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-22T01:10:50.669877+0000","last_undegraded":"2024-04-22T01:10:50.669877+0000","last_fullsized":"2024-04-22T01:10:50.669877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27611,"num_write":368,"num_write_kb":80241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'3971","reported_seq":4045,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.475044+0000","last_change":"2024-04-21T22:53:37.140241+0000","last_active":"2024-04-22T01:10:44.475044+0000","last_peered":"2024-04-22T01:10:44.475044+0000","last_clean":"2024-04-22T01:10:44.475044+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-22T01:10:44.475044+0000","last_undegraded":"2024-04-22T01:10:44.475044+0000","last_fullsized":"2024-04-22T01:10:44.475044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":3971,"log_dups_size":0,"ondisk_log_size":3971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:33:02.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'395","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.643361+0000","last_change":"2024-04-21T22:53:38.502498+0000","last_active":"2024-04-22T01:10:50.643361+0000","last_peered":"2024-04-22T01:10:50.643361+0000","last_clean":"2024-04-22T01:10:50.643361+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-22T01:10:50.643361+0000","last_undegraded":"2024-04-22T01:10:50.643361+0000","last_fullsized":"2024-04-22T01:10:50.643361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17003,"num_write":357,"num_write_kb":47379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2300","reported_seq":2385,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.801153+0000","last_change":"2024-04-22T01:11:04.801240+0000","last_active":"2024-04-22T01:11:04.801153+0000","last_peered":"2024-04-22T01:11:04.801153+0000","last_clean":"2024-04-22T01:11:04.801153+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-22T01:11:04.801153+0000","last_undegraded":"2024-04-22T01:11:04.801153+0000","last_fullsized":"2024-04-22T01:11:04.801153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2300","last_scrub_stamp":"2024-04-22T01:11:04.800934+0000","last_deep_scrub":"25'2300","last_deep_scrub_stamp":"2024-04-22T01:11:04.800934+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.800934+0000","objects_scrubbed":6,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:14.506323+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2254,"num_write_kb":13663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'414","reported_seq":540,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.787798+0000","last_change":"2024-04-21T22:53:38.612637+0000","last_active":"2024-04-22T01:10:50.787798+0000","last_peered":"2024-04-22T01:10:50.787798+0000","last_clean":"2024-04-22T01:10:50.787798+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-22T01:10:50.787798+0000","last_undegraded":"2024-04-22T01:10:50.787798+0000","last_fullsized":"2024-04-22T01:10:50.787798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26385,"num_write":381,"num_write_kb":92626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'720","reported_seq":796,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.927568+0000","last_change":"2024-04-21T22:53:37.192725+0000","last_active":"2024-04-22T01:08:57.927568+0000","last_peered":"2024-04-22T01:08:57.927568+0000","last_clean":"2024-04-22T01:08:57.927568+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-22T01:08:57.927568+0000","last_undegraded":"2024-04-22T01:08:57.927568+0000","last_fullsized":"2024-04-22T01:08:57.927568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:24:04.465318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'386","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.479154+0000","last_change":"2024-04-21T22:53:38.593468+0000","last_active":"2024-04-22T01:10:50.479154+0000","last_peered":"2024-04-22T01:10:50.479154+0000","last_clean":"2024-04-22T01:10:50.479154+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-22T01:10:50.479154+0000","last_undegraded":"2024-04-22T01:10:50.479154+0000","last_fullsized":"2024-04-22T01:10:50.479154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5166,"num_write":360,"num_write_kb":42321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'60","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:43.447123+0000","last_change":"2024-04-21T22:53:37.190401+0000","last_active":"2024-04-22T01:10:43.447123+0000","last_peered":"2024-04-22T01:10:43.447123+0000","last_clean":"2024-04-22T01:10:43.447123+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-22T01:10:43.447123+0000","last_undegraded":"2024-04-22T01:10:43.447123+0000","last_fullsized":"2024-04-22T01:10:43.447123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'397","reported_seq":525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.639807+0000","last_change":"2024-04-21T22:53:38.614363+0000","last_active":"2024-04-22T01:10:50.639807+0000","last_peered":"2024-04-22T01:10:50.639807+0000","last_clean":"2024-04-22T01:10:50.639807+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-22T01:10:50.639807+0000","last_undegraded":"2024-04-22T01:10:50.639807+0000","last_fullsized":"2024-04-22T01:10:50.639807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27517,"num_write":361,"num_write_kb":56016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'51","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:59.563999+0000","last_change":"2024-04-21T22:53:37.194463+0000","last_active":"2024-04-22T01:08:59.563999+0000","last_peered":"2024-04-22T01:08:59.563999+0000","last_clean":"2024-04-22T01:08:59.563999+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-22T01:08:59.563999+0000","last_undegraded":"2024-04-22T01:08:59.563999+0000","last_fullsized":"2024-04-22T01:08:59.563999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'460","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.777866+0000","last_change":"2024-04-21T22:53:38.585239+0000","last_active":"2024-04-22T01:10:50.777866+0000","last_peered":"2024-04-22T01:10:50.777866+0000","last_clean":"2024-04-22T01:10:50.777866+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-22T01:10:50.777866+0000","last_undegraded":"2024-04-22T01:10:50.777866+0000","last_fullsized":"2024-04-22T01:10:50.777866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":20178,"num_write":438,"num_write_kb":96694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'919","reported_seq":995,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:40.532907+0000","last_change":"2024-04-21T22:53:37.139382+0000","last_active":"2024-04-22T01:10:40.532907+0000","last_peered":"2024-04-22T01:10:40.532907+0000","last_clean":"2024-04-22T01:10:40.532907+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-22T01:10:40.532907+0000","last_undegraded":"2024-04-22T01:10:40.532907+0000","last_fullsized":"2024-04-22T01:10:40.532907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:35:51.633501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'481","reported_seq":613,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.643113+0000","last_change":"2024-04-21T22:53:38.501059+0000","last_active":"2024-04-22T01:10:50.643113+0000","last_peered":"2024-04-22T01:10:50.643113+0000","last_clean":"2024-04-22T01:10:50.643113+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-22T01:10:50.643113+0000","last_undegraded":"2024-04-22T01:10:50.643113+0000","last_fullsized":"2024-04-22T01:10:50.643113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33204,"num_write":448,"num_write_kb":124685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'818","reported_seq":897,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:39.443360+0000","last_change":"2024-04-21T22:53:37.253011+0000","last_active":"2024-04-22T01:10:39.443360+0000","last_peered":"2024-04-22T01:10:39.443360+0000","last_clean":"2024-04-22T01:10:39.443360+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-22T01:10:39.443360+0000","last_undegraded":"2024-04-22T01:10:39.443360+0000","last_fullsized":"2024-04-22T01:10:39.443360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'350","reported_seq":462,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:55.489230+0000","last_change":"2024-04-21T22:53:38.609955+0000","last_active":"2024-04-22T01:10:55.489230+0000","last_peered":"2024-04-22T01:10:55.489230+0000","last_clean":"2024-04-22T01:10:55.489230+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-22T01:10:55.489230+0000","last_undegraded":"2024-04-22T01:10:55.489230+0000","last_fullsized":"2024-04-22T01:10:55.489230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12827,"num_write":324,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'820","reported_seq":899,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:39.664467+0000","last_change":"2024-04-21T22:53:37.252463+0000","last_active":"2024-04-22T01:08:39.664467+0000","last_peered":"2024-04-22T01:08:39.664467+0000","last_clean":"2024-04-22T01:08:39.664467+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-22T01:08:39.664467+0000","last_undegraded":"2024-04-22T01:08:39.664467+0000","last_fullsized":"2024-04-22T01:08:39.664467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:59:13.100147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'428","reported_seq":582,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.790814+0000","last_change":"2024-04-21T22:53:38.616405+0000","last_active":"2024-04-22T01:10:50.790814+0000","last_peered":"2024-04-22T01:10:50.790814+0000","last_clean":"2024-04-22T01:10:50.790814+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-22T01:10:50.790814+0000","last_undegraded":"2024-04-22T01:10:50.790814+0000","last_fullsized":"2024-04-22T01:10:50.790814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36323,"num_write":394,"num_write_kb":104531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'354","reported_seq":442,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.232856+0000","last_change":"2024-04-22T01:11:07.232987+0000","last_active":"2024-04-22T01:11:07.232856+0000","last_peered":"2024-04-22T01:11:07.232856+0000","last_clean":"2024-04-22T01:11:07.232856+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-22T01:11:07.232856+0000","last_undegraded":"2024-04-22T01:11:07.232856+0000","last_fullsized":"2024-04-22T01:11:07.232856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'354","last_scrub_stamp":"2024-04-22T01:11:07.232565+0000","last_deep_scrub":"25'354","last_deep_scrub_stamp":"2024-04-22T01:11:07.232565+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.232565+0000","objects_scrubbed":2,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:14:48.094691+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'429","reported_seq":548,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:54.581214+0000","last_change":"2024-04-21T22:53:38.610899+0000","last_active":"2024-04-22T01:10:54.581214+0000","last_peered":"2024-04-22T01:10:54.581214+0000","last_clean":"2024-04-22T01:10:54.581214+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-22T01:10:54.581214+0000","last_undegraded":"2024-04-22T01:10:54.581214+0000","last_fullsized":"2024-04-22T01:10:54.581214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22478,"num_write":396,"num_write_kb":50602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'340","reported_seq":419,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:30.741959+0000","last_change":"2024-04-21T22:53:37.188035+0000","last_active":"2024-04-22T01:10:30.741959+0000","last_peered":"2024-04-22T01:10:30.741959+0000","last_clean":"2024-04-22T01:10:30.741959+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-22T01:10:30.741959+0000","last_undegraded":"2024-04-22T01:10:30.741959+0000","last_fullsized":"2024-04-22T01:10:30.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:28.787333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'412","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:55.460096+0000","last_change":"2024-04-21T22:53:38.576323+0000","last_active":"2024-04-22T01:10:55.460096+0000","last_peered":"2024-04-22T01:10:55.460096+0000","last_clean":"2024-04-22T01:10:55.460096+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-22T01:10:55.460096+0000","last_undegraded":"2024-04-22T01:10:55.460096+0000","last_fullsized":"2024-04-22T01:10:55.460096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12764,"num_write":388,"num_write_kb":59120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'163","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:02.926761+0000","last_change":"2024-04-22T01:11:02.926813+0000","last_active":"2024-04-22T01:11:02.926761+0000","last_peered":"2024-04-22T01:11:02.926761+0000","last_clean":"2024-04-22T01:11:02.926761+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-22T01:11:02.926761+0000","last_undegraded":"2024-04-22T01:11:02.926761+0000","last_fullsized":"2024-04-22T01:11:02.926761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'163","last_scrub_stamp":"2024-04-22T01:11:02.926654+0000","last_deep_scrub":"25'163","last_deep_scrub_stamp":"2024-04-22T01:11:02.926654+0000","last_clean_scrub_stamp":"2024-04-22T01:11:02.926654+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:44:16.121734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'373","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:36.285624+0000","last_change":"2024-04-21T22:53:37.192143+0000","last_active":"2024-04-22T01:10:36.285624+0000","last_peered":"2024-04-22T01:10:36.285624+0000","last_clean":"2024-04-22T01:10:36.285624+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-22T01:10:36.285624+0000","last_undegraded":"2024-04-22T01:10:36.285624+0000","last_fullsized":"2024-04-22T01:10:36.285624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'363","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672534+0000","last_change":"2024-04-21T22:53:38.501879+0000","last_active":"2024-04-22T01:10:50.672534+0000","last_peered":"2024-04-22T01:10:50.672534+0000","last_clean":"2024-04-22T01:10:50.672534+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-22T01:10:50.672534+0000","last_undegraded":"2024-04-22T01:10:50.672534+0000","last_fullsized":"2024-04-22T01:10:50.672534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26229,"num_write":331,"num_write_kb":46345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'1075","reported_seq":1162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:25.453742+0000","last_change":"2024-04-21T22:53:37.251871+0000","last_active":"2024-04-22T01:10:25.453742+0000","last_peered":"2024-04-22T01:10:25.453742+0000","last_clean":"2024-04-22T01:10:25.453742+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-22T01:10:25.453742+0000","last_undegraded":"2024-04-22T01:10:25.453742+0000","last_fullsized":"2024-04-22T01:10:25.453742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'414","reported_seq":606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.504820+0000","last_change":"2024-04-21T22:53:38.601229+0000","last_active":"2024-04-22T01:10:50.504820+0000","last_peered":"2024-04-22T01:10:50.504820+0000","last_clean":"2024-04-22T01:10:50.504820+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-22T01:10:50.504820+0000","last_undegraded":"2024-04-22T01:10:50.504820+0000","last_fullsized":"2024-04-22T01:10:50.504820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:58.488868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":57177,"num_write":383,"num_write_kb":104760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'4405","reported_seq":8838,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:45.470456+0000","last_change":"2024-04-21T22:53:37.253763+0000","last_active":"2024-04-22T01:10:45.470456+0000","last_peered":"2024-04-22T01:10:45.470456+0000","last_clean":"2024-04-22T01:10:45.470456+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-22T01:10:45.470456+0000","last_undegraded":"2024-04-22T01:10:45.470456+0000","last_fullsized":"2024-04-22T01:10:45.470456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:20.335599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":4349,"num_write_kb":4731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.671996+0000","last_change":"2024-04-21T22:53:38.585151+0000","last_active":"2024-04-22T01:10:50.671996+0000","last_peered":"2024-04-22T01:10:50.671996+0000","last_clean":"2024-04-22T01:10:50.671996+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-22T01:10:50.671996+0000","last_undegraded":"2024-04-22T01:10:50.671996+0000","last_fullsized":"2024-04-22T01:10:50.671996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21533,"num_write":374,"num_write_kb":54814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1080","reported_seq":1164,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:05.440683+0000","last_change":"2024-04-21T22:53:37.191698+0000","last_active":"2024-04-22T01:09:05.440683+0000","last_peered":"2024-04-22T01:09:05.440683+0000","last_clean":"2024-04-22T01:09:05.440683+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-22T01:09:05.440683+0000","last_undegraded":"2024-04-22T01:09:05.440683+0000","last_fullsized":"2024-04-22T01:09:05.440683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":8663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'379","reported_seq":483,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.784806+0000","last_change":"2024-04-21T22:53:38.621078+0000","last_active":"2024-04-22T01:10:50.784806+0000","last_peered":"2024-04-22T01:10:50.784806+0000","last_clean":"2024-04-22T01:10:50.784806+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-22T01:10:50.784806+0000","last_undegraded":"2024-04-22T01:10:50.784806+0000","last_fullsized":"2024-04-22T01:10:50.784806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7866,"num_write":347,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'361","reported_seq":446,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.085282+0000","last_change":"2024-04-21T22:53:37.254896+0000","last_active":"2024-04-22T01:11:07.085282+0000","last_peered":"2024-04-22T01:11:07.085282+0000","last_clean":"2024-04-22T01:11:07.085282+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-22T01:11:07.085282+0000","last_undegraded":"2024-04-22T01:11:07.085282+0000","last_fullsized":"2024-04-22T01:11:07.085282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'447","reported_seq":581,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.462590+0000","last_change":"2024-04-21T22:53:38.595730+0000","last_active":"2024-04-22T01:10:50.462590+0000","last_peered":"2024-04-22T01:10:50.462590+0000","last_clean":"2024-04-22T01:10:50.462590+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-22T01:10:50.462590+0000","last_undegraded":"2024-04-22T01:10:50.462590+0000","last_fullsized":"2024-04-22T01:10:50.462590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21571,"num_write":411,"num_write_kb":92495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'995","reported_seq":1079,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:21.952572+0000","last_change":"2024-04-21T22:53:37.188390+0000","last_active":"2024-04-22T01:10:21.952572+0000","last_peered":"2024-04-22T01:10:21.952572+0000","last_clean":"2024-04-22T01:10:21.952572+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-22T01:10:21.952572+0000","last_undegraded":"2024-04-22T01:10:21.952572+0000","last_fullsized":"2024-04-22T01:10:21.952572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'396","reported_seq":528,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.475188+0000","last_change":"2024-04-21T22:53:38.599783+0000","last_active":"2024-04-22T01:10:50.475188+0000","last_peered":"2024-04-22T01:10:50.475188+0000","last_clean":"2024-04-22T01:10:50.475188+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-22T01:10:50.475188+0000","last_undegraded":"2024-04-22T01:10:50.475188+0000","last_fullsized":"2024-04-22T01:10:50.475188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:56:00.090346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32877,"num_write":358,"num_write_kb":75502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'6444","reported_seq":6525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.883708+0000","last_change":"2024-04-21T22:53:37.187701+0000","last_active":"2024-04-22T01:10:44.883708+0000","last_peered":"2024-04-22T01:10:44.883708+0000","last_clean":"2024-04-22T01:10:44.883708+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-22T01:10:44.883708+0000","last_undegraded":"2024-04-22T01:10:44.883708+0000","last_fullsized":"2024-04-22T01:10:44.883708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":6444,"log_dups_size":0,"ondisk_log_size":6444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:07.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17429,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'369","reported_seq":513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672077+0000","last_change":"2024-04-21T22:53:38.596392+0000","last_active":"2024-04-22T01:10:50.672077+0000","last_peered":"2024-04-22T01:10:50.672077+0000","last_clean":"2024-04-22T01:10:50.672077+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-22T01:10:50.672077+0000","last_undegraded":"2024-04-22T01:10:50.672077+0000","last_fullsized":"2024-04-22T01:10:50.672077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:43:18.762215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39028,"num_write":349,"num_write_kb":80130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'453","reported_seq":535,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:44.463700+0000","last_change":"2024-04-21T22:53:37.189638+0000","last_active":"2024-04-22T01:10:44.463700+0000","last_peered":"2024-04-22T01:10:44.463700+0000","last_clean":"2024-04-22T01:10:44.463700+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-22T01:10:44.463700+0000","last_undegraded":"2024-04-22T01:10:44.463700+0000","last_fullsized":"2024-04-22T01:10:44.463700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":607,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669157+0000","last_change":"2024-04-21T22:53:38.477713+0000","last_active":"2024-04-22T01:10:50.669157+0000","last_peered":"2024-04-22T01:10:50.669157+0000","last_clean":"2024-04-22T01:10:50.669157+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-22T01:10:50.669157+0000","last_undegraded":"2024-04-22T01:10:50.669157+0000","last_fullsized":"2024-04-22T01:10:50.669157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:17.468417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43751,"num_write":424,"num_write_kb":64176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'391","reported_seq":473,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:09.574848+0000","last_change":"2024-04-21T22:53:37.193640+0000","last_active":"2024-04-22T01:10:09.574848+0000","last_peered":"2024-04-22T01:10:09.574848+0000","last_clean":"2024-04-22T01:10:09.574848+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-22T01:10:09.574848+0000","last_undegraded":"2024-04-22T01:10:09.574848+0000","last_fullsized":"2024-04-22T01:10:09.574848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":560,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.595710+0000","last_change":"2024-04-21T22:53:38.467750+0000","last_active":"2024-04-22T01:10:50.595710+0000","last_peered":"2024-04-22T01:10:50.595710+0000","last_clean":"2024-04-22T01:10:50.595710+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-22T01:10:50.595710+0000","last_undegraded":"2024-04-22T01:10:50.595710+0000","last_fullsized":"2024-04-22T01:10:50.595710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21201,"num_write":420,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'469","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:57.661579+0000","last_change":"2024-04-21T22:53:37.188895+0000","last_active":"2024-04-22T01:08:57.661579+0000","last_peered":"2024-04-22T01:08:57.661579+0000","last_clean":"2024-04-22T01:08:57.661579+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-22T01:08:57.661579+0000","last_undegraded":"2024-04-22T01:08:57.661579+0000","last_fullsized":"2024-04-22T01:08:57.661579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:34:07.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'409","reported_seq":507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.672574+0000","last_change":"2024-04-21T22:53:38.477006+0000","last_active":"2024-04-22T01:10:50.672574+0000","last_peered":"2024-04-22T01:10:50.672574+0000","last_clean":"2024-04-22T01:10:50.672574+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-22T01:10:50.672574+0000","last_undegraded":"2024-04-22T01:10:50.672574+0000","last_fullsized":"2024-04-22T01:10:50.672574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:28:16.915882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6132,"num_write":377,"num_write_kb":79520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1237","reported_seq":1318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:08:54.289194+0000","last_change":"2024-04-21T22:53:37.253973+0000","last_active":"2024-04-22T01:08:54.289194+0000","last_peered":"2024-04-22T01:08:54.289194+0000","last_clean":"2024-04-22T01:08:54.289194+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-22T01:08:54.289194+0000","last_undegraded":"2024-04-22T01:08:54.289194+0000","last_fullsized":"2024-04-22T01:08:54.289194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:03:08.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.524423+0000","last_change":"2024-04-21T22:53:38.595361+0000","last_active":"2024-04-22T01:10:50.524423+0000","last_peered":"2024-04-22T01:10:50.524423+0000","last_clean":"2024-04-22T01:10:50.524423+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-22T01:10:50.524423+0000","last_undegraded":"2024-04-22T01:10:50.524423+0000","last_fullsized":"2024-04-22T01:10:50.524423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:07:59.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16119,"num_write":379,"num_write_kb":38543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1279","reported_seq":1359,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:55.460035+0000","last_change":"2024-04-21T22:53:37.192460+0000","last_active":"2024-04-22T01:10:55.460035+0000","last_peered":"2024-04-22T01:10:55.460035+0000","last_clean":"2024-04-22T01:10:55.460035+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-22T01:10:55.460035+0000","last_undegraded":"2024-04-22T01:10:55.460035+0000","last_fullsized":"2024-04-22T01:10:55.460035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":12886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'432","reported_seq":563,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:55.459968+0000","last_change":"2024-04-21T22:53:38.579114+0000","last_active":"2024-04-22T01:10:55.459968+0000","last_peered":"2024-04-22T01:10:55.459968+0000","last_clean":"2024-04-22T01:10:55.459968+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-22T01:10:55.459968+0000","last_undegraded":"2024-04-22T01:10:55.459968+0000","last_fullsized":"2024-04-22T01:10:55.459968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23225,"num_write":401,"num_write_kb":108270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'409","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.639869+0000","last_change":"2024-04-21T22:53:38.607573+0000","last_active":"2024-04-22T01:10:50.639869+0000","last_peered":"2024-04-22T01:10:50.639869+0000","last_clean":"2024-04-22T01:10:50.639869+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-22T01:10:50.639869+0000","last_undegraded":"2024-04-22T01:10:50.639869+0000","last_fullsized":"2024-04-22T01:10:50.639869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22627,"num_write":363,"num_write_kb":69341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'794","reported_seq":875,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.364311+0000","last_change":"2024-04-22T01:11:04.364347+0000","last_active":"2024-04-22T01:11:04.364311+0000","last_peered":"2024-04-22T01:11:04.364311+0000","last_clean":"2024-04-22T01:11:04.364311+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-22T01:11:04.364311+0000","last_undegraded":"2024-04-22T01:11:04.364311+0000","last_fullsized":"2024-04-22T01:11:04.364311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'794","last_scrub_stamp":"2024-04-22T01:11:04.364227+0000","last_deep_scrub":"25'794","last_deep_scrub_stamp":"2024-04-22T01:11:04.364227+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.364227+0000","objects_scrubbed":2,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:46.996846+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'375","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.791358+0000","last_change":"2024-04-21T22:53:38.621779+0000","last_active":"2024-04-22T01:10:50.791358+0000","last_peered":"2024-04-22T01:10:50.791358+0000","last_clean":"2024-04-22T01:10:50.791358+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-22T01:10:50.791358+0000","last_undegraded":"2024-04-22T01:10:50.791358+0000","last_fullsized":"2024-04-22T01:10:50.791358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17046,"num_write":339,"num_write_kb":42889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2012","reported_seq":2093,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:03.378122+0000","last_change":"2024-04-22T01:11:03.378159+0000","last_active":"2024-04-22T01:11:03.378122+0000","last_peered":"2024-04-22T01:11:03.378122+0000","last_clean":"2024-04-22T01:11:03.378122+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-22T01:11:03.378122+0000","last_undegraded":"2024-04-22T01:11:03.378122+0000","last_fullsized":"2024-04-22T01:11:03.378122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2012","last_scrub_stamp":"2024-04-22T01:11:03.378047+0000","last_deep_scrub":"25'2012","last_deep_scrub_stamp":"2024-04-22T01:11:03.378047+0000","last_clean_scrub_stamp":"2024-04-22T01:11:03.378047+0000","objects_scrubbed":5,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:19:32.308006+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":17305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'380","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.085611+0000","last_change":"2024-04-21T22:53:38.586698+0000","last_active":"2024-04-22T01:11:07.085611+0000","last_peered":"2024-04-22T01:11:07.085611+0000","last_clean":"2024-04-22T01:11:07.085611+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-22T01:11:07.085611+0000","last_undegraded":"2024-04-22T01:11:07.085611+0000","last_fullsized":"2024-04-22T01:11:07.085611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35342,"num_write":358,"num_write_kb":67635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'688","reported_seq":775,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:08.139442+0000","last_change":"2024-04-21T22:53:37.256678+0000","last_active":"2024-04-22T01:10:08.139442+0000","last_peered":"2024-04-22T01:10:08.139442+0000","last_clean":"2024-04-22T01:10:08.139442+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-22T01:10:08.139442+0000","last_undegraded":"2024-04-22T01:10:08.139442+0000","last_fullsized":"2024-04-22T01:10:08.139442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'405","reported_seq":554,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:10:50.669256+0000","last_change":"2024-04-21T22:53:38.587227+0000","last_active":"2024-04-22T01:10:50.669256+0000","last_peered":"2024-04-22T01:10:50.669256+0000","last_clean":"2024-04-22T01:10:50.669256+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-22T01:10:50.669256+0000","last_undegraded":"2024-04-22T01:10:50.669256+0000","last_fullsized":"2024-04-22T01:10:50.669256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37645,"num_write":381,"num_write_kb":68489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'718","reported_seq":801,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:09:43.880788+0000","last_change":"2024-04-21T22:53:37.185500+0000","last_active":"2024-04-22T01:09:43.880788+0000","last_peered":"2024-04-22T01:09:43.880788+0000","last_clean":"2024-04-22T01:09:43.880788+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-22T01:09:43.880788+0000","last_undegraded":"2024-04-22T01:09:43.880788+0000","last_fullsized":"2024-04-22T01:09:43.880788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:35.691696+0000","last_clean_scrub_stamp":"2024-04-21T22:53:35.691696+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:36:53.711120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":676,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":1454219,"num_write":24465,"num_write_kb":4289319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213130007,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":48352,"num_write_kb":232418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228024320,"data_stored":426260014,"data_compressed":52327842,"data_compressed_allocated":69902336,"data_compressed_original":268197888,"omap_allocated":0,"internal_metadata":0},"log_size":39167,"ondisk_log_size":39167,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62916,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424511102,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71724,"kb_used_data":18340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":18780160,"data_stored":33648040,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511102,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151488,"kb_used_data":43960,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94220352,"statfs":{"total":96636764160,"available":96481640448,"internally_reserved":0,"allocated":45015040,"data_stored":88174574,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424511102,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84940,"kb_used_data":17668,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286900,"statfs":{"total":96636764160,"available":96549785600,"internally_reserved":0,"allocated":18092032,"data_stored":33648712,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424511103,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93264,"kb_used_data":25992,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278576,"statfs":{"total":96636764160,"available":96541261824,"internally_reserved":0,"allocated":26615808,"data_stored":48772550,"data_compressed":5793004,"data_compressed_allocated":7802880,"data_compressed_original":30134272,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424511102,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137712,"kb_used_data":30184,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94234128,"statfs":{"total":96636764160,"available":96495747072,"internally_reserved":0,"allocated":30908416,"data_stored":54620904,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511101,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148336,"kb_used_data":44968,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94223504,"statfs":{"total":96636764160,"available":96484868096,"internally_reserved":0,"allocated":46047232,"data_stored":81736600,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543808,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128480,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94243360,"statfs":{"total":96636764160,"available":96505200640,"internally_reserved":0,"allocated":17195008,"data_stored":35110341,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543807,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130280,"kb_used_data":26912,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94241560,"statfs":{"total":96636764160,"available":96503357440,"internally_reserved":0,"allocated":27557888,"data_stored":52477893,"data_compressed":6455074,"data_compressed_allocated":8462336,"data_compressed_original":33558528,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45789184,"data_stored":81642992,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26296320,"data_stored":48088574,"data_compressed":5761546,"data_compressed_allocated":7761920,"data_compressed_original":29560832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17833984,"data_stored":33555104,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44756992,"data_stored":88080966,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30650368,"data_stored":54527296,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":51793917,"data_compressed":6423616,"data_compressed_allocated":8421376,"data_compressed_original":32985088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18522112,"data_stored":33554432,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16936960,"data_stored":35016733,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T01:11:09.800 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.800 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.800 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.800 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.800 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.800 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.800 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.801 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.802 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.803 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.804 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.805 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.806 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.807 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.808 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.809 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.810 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.810 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-21T22:53:35.691696+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=35, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:09.810 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T01:11:29.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T01:11:29.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb052137640 1 Processor -- start 2024-04-22T01:11:29.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb052137640 1 -- start start 2024-04-22T01:11:29.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb052137640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb04c0c3a60 0x7fb04c0c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:29.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb052137640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb04c06c9a0 con 0x7fb04c0ca310 2024-04-22T01:11:29.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb052137640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb04c15a370 con 0x7fb04c154500 2024-04-22T01:11:29.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb052137640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb04c1548e0 con 0x7fb04c0c3a60 2024-04-22T01:11:29.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb04affd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb04c0ca310 0x7fb04c0ca760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45986/0 (socket says 172.21.15.110:45986) 2024-04-22T01:11:29.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb04affd640 1 -- 172.21.15.110:0/2733586382 learned_addr learned my addr 172.21.15.110:0/2733586382 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.940+0000 7fb04bfff640 1 --2- 172.21.15.110:0/2733586382 >> v2:172.21.15.154:3300/0 conn(0x7fb04c0c3a60 0x7fb04c0c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:29.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.944+0000 7fb04a7fc640 1 -- 172.21.15.110:0/2733586382 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831230480 0 0) 0x7fb04c06c9a0 con 0x7fb04c0ca310 2024-04-22T01:11:29.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.944+0000 7fb04a7fc640 1 -- 172.21.15.110:0/2733586382 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb034003530 con 0x7fb04c0ca310 2024-04-22T01:11:29.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.948+0000 7fb04bfff640 1 -- 172.21.15.110:0/2733586382 >> v1:172.21.15.154:6789/0 conn(0x7fb04c154500 legacy=0x7fb04c0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:29.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.948+0000 7fb04bfff640 1 -- 172.21.15.110:0/2733586382 >> v1:172.21.15.110:6789/0 conn(0x7fb04c0ca310 legacy=0x7fb04c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:29.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.948+0000 7fb04bfff640 1 -- 172.21.15.110:0/2733586382 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c15a650 con 0x7fb04c0c3a60 2024-04-22T01:11:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.956+0000 7fb04bfff640 1 --2- 172.21.15.110:0/2733586382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0c3a60 0x7fb04c0c3eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb04c154a60 tx=0x7fb04401f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ef14df02ccef52 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:29.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb04a7fc640 1 -- 172.21.15.110:0/2733586382 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440b4070 con 0x7fb04c0c3a60 2024-04-22T01:11:29.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb04a7fc640 1 -- 172.21.15.110:0/2733586382 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0440af600 con 0x7fb04c0c3a60 2024-04-22T01:11:29.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb04a7fc640 1 -- 172.21.15.110:0/2733586382 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440af9d0 con 0x7fb04c0c3a60 2024-04-22T01:11:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- 172.21.15.110:0/2733586382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0c3a60 msgr2=0x7fb04c0c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 --2- 172.21.15.110:0/2733586382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0c3a60 0x7fb04c0c3eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb04c154a60 tx=0x7fb04401f100 comp rx=0 tx=0).stop 2024-04-22T01:11:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- 172.21.15.110:0/2733586382 shutdown_connections 2024-04-22T01:11:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 --2- 172.21.15.110:0/2733586382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0c3a60 0x7fb04c0c3eb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- 172.21.15.110:0/2733586382 >> 172.21.15.110:0/2733586382 conn(0x7fb04c0714f0 msgr2=0x7fb04c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- 172.21.15.110:0/2733586382 shutdown_connections 2024-04-22T01:11:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- 172.21.15.110:0/2733586382 wait complete. 2024-04-22T01:11:29.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 Processor -- start 2024-04-22T01:11:29.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- start start 2024-04-22T01:11:29.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04c0c3a60 0x7fb04c1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:29.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0ca310 0x7fb04c148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:29.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb04c154500 0x7fb04c1494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:29.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c15aef0 con 0x7fb04c0c3a60 2024-04-22T01:11:29.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c15ac10 con 0x7fb04c0ca310 2024-04-22T01:11:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.984+0000 7fb052137640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb04c0c9b00 con 0x7fb04c154500 2024-04-22T01:11:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.988+0000 7fb04b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04c0c3a60 0x7fb04c1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.988+0000 7fb04b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04c0c3a60 0x7fb04c1f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38804/0 (socket says 172.21.15.110:38804) 2024-04-22T01:11:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.988+0000 7fb04b7fe640 1 -- 172.21.15.110:0/3403730125 learned_addr learned my addr 172.21.15.110:0/3403730125 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.988+0000 7fb04bfff640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb04c154500 0x7fb04c1494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:29.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.992+0000 7fb04b7fe640 1 -- 172.21.15.110:0/3403730125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb04c154500 msgr2=0x7fb04c1494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:29.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.992+0000 7fb04b7fe640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb04c154500 0x7fb04c1494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:29.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.992+0000 7fb04b7fe640 1 -- 172.21.15.110:0/3403730125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0ca310 msgr2=0x7fb04c148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:29.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.992+0000 7fb04b7fe640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0ca310 0x7fb04c148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:29.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.992+0000 7fb04b7fe640 1 -- 172.21.15.110:0/3403730125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c154070 con 0x7fb04c0c3a60 2024-04-22T01:11:29.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:29.996+0000 7fb04b7fe640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04c0c3a60 0x7fb04c1f3360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b440 tx=0x7fb03c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:30.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.004+0000 7fb033fff640 1 -- 172.21.15.110:0/3403730125 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c015020 con 0x7fb04c0c3a60 2024-04-22T01:11:30.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.004+0000 7fb033fff640 1 -- 172.21.15.110:0/3403730125 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03c011890 con 0x7fb04c0c3a60 2024-04-22T01:11:30.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.004+0000 7fb033fff640 1 -- 172.21.15.110:0/3403730125 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011c80 con 0x7fb04c0c3a60 2024-04-22T01:11:30.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.004+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04c15a040 con 0x7fb04c0c3a60 2024-04-22T01:11:30.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.004+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04c159a80 con 0x7fb04c0c3a60 2024-04-22T01:11:30.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.004+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04c04f510 con 0x7fb04c0c3a60 2024-04-22T01:11:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.292+0000 7fb033fff640 1 -- 172.21.15.110:0/3403730125 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb03c018020 con 0x7fb04c0c3a60 2024-04-22T01:11:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.292+0000 7fb033fff640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb038067910 0x7fb038069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.292+0000 7fb04affd640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb038067910 0x7fb038069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:30.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.296+0000 7fb04affd640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb038067910 0x7fb038069dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb040007fd0 tx=0x7fb040007900 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:30.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.332+0000 7fb033fff640 1 -- 172.21.15.110:0/3403730125 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb03c0544f0 con 0x7fb04c0c3a60 2024-04-22T01:11:30.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.332+0000 7fb033fff640 1 -- 172.21.15.110:0/3403730125 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7fb03c01f030 con 0x7fb04c0c3a60 2024-04-22T01:11:30.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.504+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb04c157b60 con 0x7fb038067910 2024-04-22T01:11:30.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.520+0000 7fb033fff640 1 -- 172.21.15.110:0/3403730125 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254900 (secure 0 0 0) 0x7fb04c157b60 con 0x7fb038067910 2024-04-22T01:11:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:11:30.524 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb038067910 msgr2=0x7fb038069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb038067910 0x7fb038069dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb040007fd0 tx=0x7fb040007900 comp rx=0 tx=0).stop 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04c0c3a60 msgr2=0x7fb04c1f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04c0c3a60 0x7fb04c1f3360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b440 tx=0x7fb03c00b900 comp rx=0 tx=0).stop 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 shutdown_connections 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7fb038067910 0x7fb038069dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb04c154500 0x7fb04c1494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb04c0ca310 0x7fb04c148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 --2- 172.21.15.110:0/3403730125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb04c0c3a60 0x7fb04c1f3360 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 >> 172.21.15.110:0/3403730125 conn(0x7fb04c0714f0 msgr2=0x7fb04c0c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:30.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 shutdown_connections 2024-04-22T01:11:30.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:30.524+0000 7fb052137640 1 -- 172.21.15.110:0/3403730125 wait complete. 2024-04-22T01:11:30.543 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":4177,"stamp":"2024-04-22T01:11:28.509969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213720375,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":7236,"num_read_kb":1459077,"num_write":73026,"num_write_kb":4525199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65761,"ondisk_log_size":65761,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":946224,"kb_used_data":224816,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":754028496,"statfs":{"total":773094113280,"available":772125179904,"internally_reserved":0,"allocated":230211584,"data_stored":428189614,"data_compressed":52390758,"data_compressed_allocated":69984256,"data_compressed_original":269344768,"omap_allocated":12749,"internal_metadata":738643507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004529"},"pg_stats":[{"pgid":"3.3f","version":"25'426","reported_seq":570,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.405088+0000","last_change":"2024-04-22T01:11:13.405145+0000","last_active":"2024-04-22T01:11:13.405088+0000","last_peered":"2024-04-22T01:11:13.405088+0000","last_clean":"2024-04-22T01:11:13.405088+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-22T01:11:13.405088+0000","last_undegraded":"2024-04-22T01:11:13.405088+0000","last_fullsized":"2024-04-22T01:11:13.405088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'426","last_scrub_stamp":"2024-04-22T01:11:13.404914+0000","last_deep_scrub":"25'426","last_deep_scrub_stamp":"2024-04-22T01:11:13.404914+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.404914+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:48.928377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28398,"num_write":395,"num_write_kb":75936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'442","reported_seq":577,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:20.417339+0000","last_change":"2024-04-22T01:11:20.417454+0000","last_active":"2024-04-22T01:11:20.417339+0000","last_peered":"2024-04-22T01:11:20.417339+0000","last_clean":"2024-04-22T01:11:20.417339+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-22T01:11:20.417339+0000","last_undegraded":"2024-04-22T01:11:20.417339+0000","last_fullsized":"2024-04-22T01:11:20.417339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'442","last_scrub_stamp":"2024-04-22T01:11:20.417020+0000","last_deep_scrub":"25'442","last_deep_scrub_stamp":"2024-04-22T01:11:20.417020+0000","last_clean_scrub_stamp":"2024-04-22T01:11:20.417020+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:45:03.807857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20820,"num_write":419,"num_write_kb":84104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'391","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.268870+0000","last_change":"2024-04-22T01:11:12.268930+0000","last_active":"2024-04-22T01:11:12.268870+0000","last_peered":"2024-04-22T01:11:12.268870+0000","last_clean":"2024-04-22T01:11:12.268870+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-22T01:11:12.268870+0000","last_undegraded":"2024-04-22T01:11:12.268870+0000","last_fullsized":"2024-04-22T01:11:12.268870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'391","last_scrub_stamp":"2024-04-22T01:11:12.268692+0000","last_deep_scrub":"25'391","last_deep_scrub_stamp":"2024-04-22T01:11:12.268692+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.268692+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:43.525880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18719,"num_write":364,"num_write_kb":70997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'353","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:05.773757+0000","last_change":"2024-04-22T01:11:05.773784+0000","last_active":"2024-04-22T01:11:05.773757+0000","last_peered":"2024-04-22T01:11:05.773757+0000","last_clean":"2024-04-22T01:11:05.773757+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-22T01:11:05.773757+0000","last_undegraded":"2024-04-22T01:11:05.773757+0000","last_fullsized":"2024-04-22T01:11:05.773757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'353","last_scrub_stamp":"2024-04-22T01:11:05.773674+0000","last_deep_scrub":"25'353","last_deep_scrub_stamp":"2024-04-22T01:11:05.773674+0000","last_clean_scrub_stamp":"2024-04-22T01:11:05.773674+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:02.656378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":316,"num_write_kb":12972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'420","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.418036+0000","last_change":"2024-04-22T01:11:09.418036+0000","last_active":"2024-04-22T01:11:09.418036+0000","last_peered":"2024-04-22T01:11:09.418036+0000","last_clean":"2024-04-22T01:11:09.418036+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-22T01:11:09.418036+0000","last_undegraded":"2024-04-22T01:11:09.418036+0000","last_fullsized":"2024-04-22T01:11:09.418036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'420","last_scrub_stamp":"2024-04-22T01:11:09.417694+0000","last_deep_scrub":"25'420","last_deep_scrub_stamp":"2024-04-22T01:11:09.417694+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.417694+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:26.333227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":394,"num_write_kb":67878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'395","reported_seq":508,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.752756+0000","last_change":"2024-04-22T01:11:06.752756+0000","last_active":"2024-04-22T01:11:06.752756+0000","last_peered":"2024-04-22T01:11:06.752756+0000","last_clean":"2024-04-22T01:11:06.752756+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-22T01:11:06.752756+0000","last_undegraded":"2024-04-22T01:11:06.752756+0000","last_fullsized":"2024-04-22T01:11:06.752756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:06.752495+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:06.752495+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.752495+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:32:45.257256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17967,"num_write":373,"num_write_kb":71499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.330450+0000","last_change":"2024-04-22T01:11:18.330569+0000","last_active":"2024-04-22T01:11:18.330450+0000","last_peered":"2024-04-22T01:11:18.330450+0000","last_clean":"2024-04-22T01:11:18.330450+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-22T01:11:18.330450+0000","last_undegraded":"2024-04-22T01:11:18.330450+0000","last_fullsized":"2024-04-22T01:11:18.330450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2024-04-22T01:11:18.330225+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2024-04-22T01:11:18.330225+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.330225+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:03:02.232748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13670,"num_write":376,"num_write_kb":39263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'387","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:21.438911+0000","last_change":"2024-04-22T01:11:21.438976+0000","last_active":"2024-04-22T01:11:21.438911+0000","last_peered":"2024-04-22T01:11:21.438911+0000","last_clean":"2024-04-22T01:11:21.438911+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-22T01:11:21.438911+0000","last_undegraded":"2024-04-22T01:11:21.438911+0000","last_fullsized":"2024-04-22T01:11:21.438911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'387","last_scrub_stamp":"2024-04-22T01:11:21.438704+0000","last_deep_scrub":"25'387","last_deep_scrub_stamp":"2024-04-22T01:11:21.438704+0000","last_clean_scrub_stamp":"2024-04-22T01:11:21.438704+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:50.045778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":42822,"num_write":351,"num_write_kb":100036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'424","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.951443+0000","last_change":"2024-04-22T01:11:04.951506+0000","last_active":"2024-04-22T01:11:04.951443+0000","last_peered":"2024-04-22T01:11:04.951443+0000","last_clean":"2024-04-22T01:11:04.951443+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-22T01:11:04.951443+0000","last_undegraded":"2024-04-22T01:11:04.951443+0000","last_fullsized":"2024-04-22T01:11:04.951443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'424","last_scrub_stamp":"2024-04-22T01:11:04.951252+0000","last_deep_scrub":"25'424","last_deep_scrub_stamp":"2024-04-22T01:11:04.951252+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.951252+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:01.833955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20454,"num_write":396,"num_write_kb":59842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.369238+0000","last_change":"2024-04-22T01:11:10.369238+0000","last_active":"2024-04-22T01:11:10.369238+0000","last_peered":"2024-04-22T01:11:10.369238+0000","last_clean":"2024-04-22T01:11:10.369238+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-22T01:11:10.369238+0000","last_undegraded":"2024-04-22T01:11:10.369238+0000","last_fullsized":"2024-04-22T01:11:10.369238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2024-04-22T01:11:10.368978+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2024-04-22T01:11:10.368978+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.368978+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:40:25.354102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5548,"num_write":382,"num_write_kb":76042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'383","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.367891+0000","last_change":"2024-04-22T01:11:15.367891+0000","last_active":"2024-04-22T01:11:15.367891+0000","last_peered":"2024-04-22T01:11:15.367891+0000","last_clean":"2024-04-22T01:11:15.367891+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-22T01:11:15.367891+0000","last_undegraded":"2024-04-22T01:11:15.367891+0000","last_fullsized":"2024-04-22T01:11:15.367891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'383","last_scrub_stamp":"2024-04-22T01:11:15.367636+0000","last_deep_scrub":"25'383","last_deep_scrub_stamp":"2024-04-22T01:11:15.367636+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.367636+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:05:11.251261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12739,"num_write":368,"num_write_kb":54575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'362","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.300351+0000","last_change":"2024-04-22T01:11:17.300351+0000","last_active":"2024-04-22T01:11:17.300351+0000","last_peered":"2024-04-22T01:11:17.300351+0000","last_clean":"2024-04-22T01:11:17.300351+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-22T01:11:17.300351+0000","last_undegraded":"2024-04-22T01:11:17.300351+0000","last_fullsized":"2024-04-22T01:11:17.300351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'362","last_scrub_stamp":"2024-04-22T01:11:17.299985+0000","last_deep_scrub":"25'362","last_deep_scrub_stamp":"2024-04-22T01:11:17.299985+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.299985+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:27:42.312255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9062,"num_write":334,"num_write_kb":50352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'384","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.069021+0000","last_change":"2024-04-22T01:11:17.069021+0000","last_active":"2024-04-22T01:11:17.069021+0000","last_peered":"2024-04-22T01:11:17.069021+0000","last_clean":"2024-04-22T01:11:17.069021+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-22T01:11:17.069021+0000","last_undegraded":"2024-04-22T01:11:17.069021+0000","last_fullsized":"2024-04-22T01:11:17.069021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'384","last_scrub_stamp":"2024-04-22T01:11:17.068762+0000","last_deep_scrub":"25'384","last_deep_scrub_stamp":"2024-04-22T01:11:17.068762+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.068762+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:55.516037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12819,"num_write":349,"num_write_kb":62920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'430","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.028076+0000","last_change":"2024-04-22T01:11:13.028139+0000","last_active":"2024-04-22T01:11:13.028076+0000","last_peered":"2024-04-22T01:11:13.028076+0000","last_clean":"2024-04-22T01:11:13.028076+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-22T01:11:13.028076+0000","last_undegraded":"2024-04-22T01:11:13.028076+0000","last_fullsized":"2024-04-22T01:11:13.028076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'430","last_scrub_stamp":"2024-04-22T01:11:13.027884+0000","last_deep_scrub":"25'430","last_deep_scrub_stamp":"2024-04-22T01:11:13.027884+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.027884+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:29:17.952649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21265,"num_write":396,"num_write_kb":88387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'436","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:22.430992+0000","last_change":"2024-04-22T01:11:22.431053+0000","last_active":"2024-04-22T01:11:22.430992+0000","last_peered":"2024-04-22T01:11:22.430992+0000","last_clean":"2024-04-22T01:11:22.430992+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-22T01:11:22.430992+0000","last_undegraded":"2024-04-22T01:11:22.430992+0000","last_fullsized":"2024-04-22T01:11:22.430992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'436","last_scrub_stamp":"2024-04-22T01:11:22.430796+0000","last_deep_scrub":"25'436","last_deep_scrub_stamp":"2024-04-22T01:11:22.430796+0000","last_clean_scrub_stamp":"2024-04-22T01:11:22.430796+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:54:33.338619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21940,"num_write":398,"num_write_kb":112507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'433","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.040681+0000","last_change":"2024-04-22T01:11:07.040681+0000","last_active":"2024-04-22T01:11:07.040681+0000","last_peered":"2024-04-22T01:11:07.040681+0000","last_clean":"2024-04-22T01:11:07.040681+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-22T01:11:07.040681+0000","last_undegraded":"2024-04-22T01:11:07.040681+0000","last_fullsized":"2024-04-22T01:11:07.040681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'433","last_scrub_stamp":"2024-04-22T01:11:07.040297+0000","last_deep_scrub":"25'433","last_deep_scrub_stamp":"2024-04-22T01:11:07.040297+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.040297+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:02:49.193958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26769,"num_write":400,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'401","reported_seq":514,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:05.092055+0000","last_change":"2024-04-21T22:54:44.971067+0000","last_active":"2024-04-22T01:11:05.092055+0000","last_peered":"2024-04-22T01:11:05.092055+0000","last_clean":"2024-04-22T01:11:05.092055+0000","last_became_active":"2024-04-21T22:54:44.970288+0000","last_became_peered":"2024-04-21T22:54:44.970288+0000","last_unstale":"2024-04-22T01:11:05.092055+0000","last_undegraded":"2024-04-22T01:11:05.092055+0000","last_fullsized":"2024-04-22T01:11:05.092055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:53:36.908691+0000","last_clean_scrub_stamp":"2024-04-21T22:53:36.908691+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17556,"num_write":374,"num_write_kb":67589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'395","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.153384+0000","last_change":"2024-04-22T01:11:12.153384+0000","last_active":"2024-04-22T01:11:12.153384+0000","last_peered":"2024-04-22T01:11:12.153384+0000","last_clean":"2024-04-22T01:11:12.153384+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-22T01:11:12.153384+0000","last_undegraded":"2024-04-22T01:11:12.153384+0000","last_fullsized":"2024-04-22T01:11:12.153384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:12.153156+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:12.153156+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.153156+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:57.104303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22256,"num_write":365,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'432","reported_seq":591,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.072941+0000","last_change":"2024-04-22T01:11:06.072981+0000","last_active":"2024-04-22T01:11:06.072941+0000","last_peered":"2024-04-22T01:11:06.072941+0000","last_clean":"2024-04-22T01:11:06.072941+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-22T01:11:06.072941+0000","last_undegraded":"2024-04-22T01:11:06.072941+0000","last_fullsized":"2024-04-22T01:11:06.072941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'432","last_scrub_stamp":"2024-04-22T01:11:06.072840+0000","last_deep_scrub":"25'432","last_deep_scrub_stamp":"2024-04-22T01:11:06.072840+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.072840+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:27:38.604899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39722,"num_write":402,"num_write_kb":89327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:02.290331+0000","last_change":"2024-04-22T01:11:02.290354+0000","last_active":"2024-04-22T01:11:02.290331+0000","last_peered":"2024-04-22T01:11:02.290331+0000","last_clean":"2024-04-22T01:11:02.290331+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-22T01:11:02.290331+0000","last_undegraded":"2024-04-22T01:11:02.290331+0000","last_fullsized":"2024-04-22T01:11:02.290331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'435","last_scrub_stamp":"2024-04-22T01:11:02.290250+0000","last_deep_scrub":"25'435","last_deep_scrub_stamp":"2024-04-22T01:11:02.290250+0000","last_clean_scrub_stamp":"2024-04-22T01:11:02.290250+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:36:09.152675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4220,"num_write":403,"num_write_kb":46421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'421","reported_seq":533,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.689186+0000","last_change":"2024-04-22T01:11:13.689245+0000","last_active":"2024-04-22T01:11:13.689186+0000","last_peered":"2024-04-22T01:11:13.689186+0000","last_clean":"2024-04-22T01:11:13.689186+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-22T01:11:13.689186+0000","last_undegraded":"2024-04-22T01:11:13.689186+0000","last_fullsized":"2024-04-22T01:11:13.689186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2024-04-22T01:11:13.689008+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2024-04-22T01:11:13.689008+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.689008+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:27:46.221067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":8093,"num_write":400,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'410","reported_seq":544,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.987618+0000","last_change":"2024-04-22T01:11:07.987684+0000","last_active":"2024-04-22T01:11:07.987618+0000","last_peered":"2024-04-22T01:11:07.987618+0000","last_clean":"2024-04-22T01:11:07.987618+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-22T01:11:07.987618+0000","last_undegraded":"2024-04-22T01:11:07.987618+0000","last_fullsized":"2024-04-22T01:11:07.987618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2024-04-22T01:11:07.987433+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2024-04-22T01:11:07.987433+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.987433+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:09:54.764914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28547,"num_write":383,"num_write_kb":51065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'415","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.301744+0000","last_change":"2024-04-22T01:11:11.301811+0000","last_active":"2024-04-22T01:11:11.301744+0000","last_peered":"2024-04-22T01:11:11.301744+0000","last_clean":"2024-04-22T01:11:11.301744+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-22T01:11:11.301744+0000","last_undegraded":"2024-04-22T01:11:11.301744+0000","last_fullsized":"2024-04-22T01:11:11.301744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'415","last_scrub_stamp":"2024-04-22T01:11:11.301560+0000","last_deep_scrub":"25'415","last_deep_scrub_stamp":"2024-04-22T01:11:11.301560+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.301560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:17.618671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":35420,"num_write":386,"num_write_kb":88354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'418","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:23.127194+0000","last_change":"2024-04-22T01:11:23.127317+0000","last_active":"2024-04-22T01:11:23.127194+0000","last_peered":"2024-04-22T01:11:23.127194+0000","last_clean":"2024-04-22T01:11:23.127194+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-22T01:11:23.127194+0000","last_undegraded":"2024-04-22T01:11:23.127194+0000","last_fullsized":"2024-04-22T01:11:23.127194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'418","last_scrub_stamp":"2024-04-22T01:11:23.126969+0000","last_deep_scrub":"25'418","last_deep_scrub_stamp":"2024-04-22T01:11:23.126969+0000","last_clean_scrub_stamp":"2024-04-22T01:11:23.126969+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:54:32.167981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6808,"num_write":388,"num_write_kb":34297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'391","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.405103+0000","last_change":"2024-04-22T01:11:18.405162+0000","last_active":"2024-04-22T01:11:18.405103+0000","last_peered":"2024-04-22T01:11:18.405103+0000","last_clean":"2024-04-22T01:11:18.405103+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-22T01:11:18.405103+0000","last_undegraded":"2024-04-22T01:11:18.405103+0000","last_fullsized":"2024-04-22T01:11:18.405103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'391","last_scrub_stamp":"2024-04-22T01:11:18.404929+0000","last_deep_scrub":"25'391","last_deep_scrub_stamp":"2024-04-22T01:11:18.404929+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.404929+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:40:30.667990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4176,"num_write":374,"num_write_kb":46218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'491","reported_seq":630,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.698982+0000","last_change":"2024-04-22T01:11:08.699046+0000","last_active":"2024-04-22T01:11:08.698982+0000","last_peered":"2024-04-22T01:11:08.698982+0000","last_clean":"2024-04-22T01:11:08.698982+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-22T01:11:08.698982+0000","last_undegraded":"2024-04-22T01:11:08.698982+0000","last_fullsized":"2024-04-22T01:11:08.698982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'491","last_scrub_stamp":"2024-04-22T01:11:08.698752+0000","last_deep_scrub":"25'491","last_deep_scrub_stamp":"2024-04-22T01:11:08.698752+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.698752+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:09:55.476233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29218,"num_write":445,"num_write_kb":101143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'436","reported_seq":585,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.004586+0000","last_change":"2024-04-22T01:11:14.004651+0000","last_active":"2024-04-22T01:11:14.004586+0000","last_peered":"2024-04-22T01:11:14.004586+0000","last_clean":"2024-04-22T01:11:14.004586+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-22T01:11:14.004586+0000","last_undegraded":"2024-04-22T01:11:14.004586+0000","last_fullsized":"2024-04-22T01:11:14.004586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'436","last_scrub_stamp":"2024-04-22T01:11:14.004398+0000","last_deep_scrub":"25'436","last_deep_scrub_stamp":"2024-04-22T01:11:14.004398+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.004398+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:36:20.866823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29285,"num_write":407,"num_write_kb":84259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'386","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.030796+0000","last_change":"2024-04-22T01:11:18.030874+0000","last_active":"2024-04-22T01:11:18.030796+0000","last_peered":"2024-04-22T01:11:18.030796+0000","last_clean":"2024-04-22T01:11:18.030796+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-22T01:11:18.030796+0000","last_undegraded":"2024-04-22T01:11:18.030796+0000","last_fullsized":"2024-04-22T01:11:18.030796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'386","last_scrub_stamp":"2024-04-22T01:11:18.030607+0000","last_deep_scrub":"25'386","last_deep_scrub_stamp":"2024-04-22T01:11:18.030607+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.030607+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:21:05.407073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28108,"num_write":361,"num_write_kb":80021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'403","reported_seq":555,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.341416+0000","last_change":"2024-04-22T01:11:14.341535+0000","last_active":"2024-04-22T01:11:14.341416+0000","last_peered":"2024-04-22T01:11:14.341416+0000","last_clean":"2024-04-22T01:11:14.341416+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-22T01:11:14.341416+0000","last_undegraded":"2024-04-22T01:11:14.341416+0000","last_fullsized":"2024-04-22T01:11:14.341416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'403","last_scrub_stamp":"2024-04-22T01:11:14.341177+0000","last_deep_scrub":"25'403","last_deep_scrub_stamp":"2024-04-22T01:11:14.341177+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.341177+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:12.721060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31845,"num_write":369,"num_write_kb":46987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'465","reported_seq":614,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:22.084008+0000","last_change":"2024-04-22T01:11:22.084067+0000","last_active":"2024-04-22T01:11:22.084008+0000","last_peered":"2024-04-22T01:11:22.084008+0000","last_clean":"2024-04-22T01:11:22.084008+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-22T01:11:22.084008+0000","last_undegraded":"2024-04-22T01:11:22.084008+0000","last_fullsized":"2024-04-22T01:11:22.084008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'465","last_scrub_stamp":"2024-04-22T01:11:22.083813+0000","last_deep_scrub":"25'465","last_deep_scrub_stamp":"2024-04-22T01:11:22.083813+0000","last_clean_scrub_stamp":"2024-04-22T01:11:22.083813+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:30:31.865205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":45092,"num_write":433,"num_write_kb":99910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'465","reported_seq":629,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.148643+0000","last_change":"2024-04-22T01:11:13.148705+0000","last_active":"2024-04-22T01:11:13.148643+0000","last_peered":"2024-04-22T01:11:13.148643+0000","last_clean":"2024-04-22T01:11:13.148643+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-22T01:11:13.148643+0000","last_undegraded":"2024-04-22T01:11:13.148643+0000","last_fullsized":"2024-04-22T01:11:13.148643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'465","last_scrub_stamp":"2024-04-22T01:11:13.148449+0000","last_deep_scrub":"25'465","last_deep_scrub_stamp":"2024-04-22T01:11:13.148449+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.148449+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:15.464252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44084,"num_write":435,"num_write_kb":97059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'430","reported_seq":560,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.729170+0000","last_change":"2024-04-22T01:11:09.729170+0000","last_active":"2024-04-22T01:11:09.729170+0000","last_peered":"2024-04-22T01:11:09.729170+0000","last_clean":"2024-04-22T01:11:09.729170+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-22T01:11:09.729170+0000","last_undegraded":"2024-04-22T01:11:09.729170+0000","last_fullsized":"2024-04-22T01:11:09.729170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'430","last_scrub_stamp":"2024-04-22T01:11:09.728835+0000","last_deep_scrub":"25'430","last_deep_scrub_stamp":"2024-04-22T01:11:09.728835+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.728835+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:30:54.316751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14125,"num_write":397,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:05.995535+0000","last_change":"2024-04-22T01:11:05.995535+0000","last_active":"2024-04-22T01:11:05.995535+0000","last_peered":"2024-04-22T01:11:05.995535+0000","last_clean":"2024-04-22T01:11:05.995535+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-22T01:11:05.995535+0000","last_undegraded":"2024-04-22T01:11:05.995535+0000","last_fullsized":"2024-04-22T01:11:05.995535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-04-22T01:11:05.995397+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-04-22T01:11:05.995397+0000","last_clean_scrub_stamp":"2024-04-22T01:11:05.995397+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:32:44.500158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31266,"num_write":385,"num_write_kb":75657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'364","reported_seq":446,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.251851+0000","last_change":"2024-04-22T01:11:08.251920+0000","last_active":"2024-04-22T01:11:08.251851+0000","last_peered":"2024-04-22T01:11:08.251851+0000","last_clean":"2024-04-22T01:11:08.251851+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-22T01:11:08.251851+0000","last_undegraded":"2024-04-22T01:11:08.251851+0000","last_fullsized":"2024-04-22T01:11:08.251851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'364","last_scrub_stamp":"2024-04-22T01:11:08.251666+0000","last_deep_scrub":"25'364","last_deep_scrub_stamp":"2024-04-22T01:11:08.251666+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.251666+0000","objects_scrubbed":1,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:40:18.228278+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'372","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.738341+0000","last_change":"2024-04-22T01:11:17.738497+0000","last_active":"2024-04-22T01:11:17.738341+0000","last_peered":"2024-04-22T01:11:17.738341+0000","last_clean":"2024-04-22T01:11:17.738341+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-22T01:11:17.738341+0000","last_undegraded":"2024-04-22T01:11:17.738341+0000","last_fullsized":"2024-04-22T01:11:17.738341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'372","last_scrub_stamp":"2024-04-22T01:11:17.738091+0000","last_deep_scrub":"25'372","last_deep_scrub_stamp":"2024-04-22T01:11:17.738091+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.738091+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:40:32.723215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19141,"num_write":353,"num_write_kb":42712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'2179","reported_seq":2261,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.134811+0000","last_change":"2024-04-22T01:11:13.134915+0000","last_active":"2024-04-22T01:11:13.134811+0000","last_peered":"2024-04-22T01:11:13.134811+0000","last_clean":"2024-04-22T01:11:13.134811+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-22T01:11:13.134811+0000","last_undegraded":"2024-04-22T01:11:13.134811+0000","last_fullsized":"2024-04-22T01:11:13.134811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2179","last_scrub_stamp":"2024-04-22T01:11:13.134598+0000","last_deep_scrub":"25'2179","last_deep_scrub_stamp":"2024-04-22T01:11:13.134598+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.134598+0000","objects_scrubbed":4,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:48.658061+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2118,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'779","reported_seq":862,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.067306+0000","last_change":"2024-04-22T01:11:09.067443+0000","last_active":"2024-04-22T01:11:09.067306+0000","last_peered":"2024-04-22T01:11:09.067306+0000","last_clean":"2024-04-22T01:11:09.067306+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-22T01:11:09.067306+0000","last_undegraded":"2024-04-22T01:11:09.067306+0000","last_fullsized":"2024-04-22T01:11:09.067306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'779","last_scrub_stamp":"2024-04-22T01:11:09.066998+0000","last_deep_scrub":"25'779","last_deep_scrub_stamp":"2024-04-22T01:11:09.066998+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.066998+0000","objects_scrubbed":1,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:34.749197+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'427","reported_seq":553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:19.385907+0000","last_change":"2024-04-22T01:11:19.385907+0000","last_active":"2024-04-22T01:11:19.385907+0000","last_peered":"2024-04-22T01:11:19.385907+0000","last_clean":"2024-04-22T01:11:19.385907+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-22T01:11:19.385907+0000","last_undegraded":"2024-04-22T01:11:19.385907+0000","last_fullsized":"2024-04-22T01:11:19.385907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2024-04-22T01:11:19.385667+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2024-04-22T01:11:19.385667+0000","last_clean_scrub_stamp":"2024-04-22T01:11:19.385667+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:55:18.850859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27111,"num_write":394,"num_write_kb":58934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1419","reported_seq":1503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.142329+0000","last_change":"2024-04-22T01:11:12.142329+0000","last_active":"2024-04-22T01:11:12.142329+0000","last_peered":"2024-04-22T01:11:12.142329+0000","last_clean":"2024-04-22T01:11:12.142329+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-22T01:11:12.142329+0000","last_undegraded":"2024-04-22T01:11:12.142329+0000","last_fullsized":"2024-04-22T01:11:12.142329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1419","last_scrub_stamp":"2024-04-22T01:11:12.142033+0000","last_deep_scrub":"25'1419","last_deep_scrub_stamp":"2024-04-22T01:11:12.142033+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.142033+0000","objects_scrubbed":3,"log_size":1419,"log_dups_size":0,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:10:21.444321+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":12962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'395","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.709698+0000","last_change":"2024-04-22T01:11:15.709757+0000","last_active":"2024-04-22T01:11:15.709698+0000","last_peered":"2024-04-22T01:11:15.709698+0000","last_clean":"2024-04-22T01:11:15.709698+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-22T01:11:15.709698+0000","last_undegraded":"2024-04-22T01:11:15.709698+0000","last_fullsized":"2024-04-22T01:11:15.709698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:15.709518+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:15.709518+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.709518+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:45:22.919661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":217,"num_write":366,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'56","reported_seq":140,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:03.937470+0000","last_change":"2024-04-22T01:11:03.937470+0000","last_active":"2024-04-22T01:11:03.937470+0000","last_peered":"2024-04-22T01:11:03.937470+0000","last_clean":"2024-04-22T01:11:03.937470+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-22T01:11:03.937470+0000","last_undegraded":"2024-04-22T01:11:03.937470+0000","last_fullsized":"2024-04-22T01:11:03.937470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2024-04-22T01:11:03.937228+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2024-04-22T01:11:03.937228+0000","last_clean_scrub_stamp":"2024-04-22T01:11:03.937228+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:13.642617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'451","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.738426+0000","last_change":"2024-04-22T01:11:07.738426+0000","last_active":"2024-04-22T01:11:07.738426+0000","last_peered":"2024-04-22T01:11:07.738426+0000","last_clean":"2024-04-22T01:11:07.738426+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-22T01:11:07.738426+0000","last_undegraded":"2024-04-22T01:11:07.738426+0000","last_fullsized":"2024-04-22T01:11:07.738426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'451","last_scrub_stamp":"2024-04-22T01:11:07.738184+0000","last_deep_scrub":"25'451","last_deep_scrub_stamp":"2024-04-22T01:11:07.738184+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.738184+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:29.346899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27728,"num_write":424,"num_write_kb":88654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1254","reported_seq":1338,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:05.388985+0000","last_change":"2024-04-22T01:11:05.388985+0000","last_active":"2024-04-22T01:11:05.388985+0000","last_peered":"2024-04-22T01:11:05.388985+0000","last_clean":"2024-04-22T01:11:05.388985+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-22T01:11:05.388985+0000","last_undegraded":"2024-04-22T01:11:05.388985+0000","last_fullsized":"2024-04-22T01:11:05.388985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1254","last_scrub_stamp":"2024-04-22T01:11:05.388865+0000","last_deep_scrub":"25'1254","last_deep_scrub_stamp":"2024-04-22T01:11:05.388865+0000","last_clean_scrub_stamp":"2024-04-22T01:11:05.388865+0000","objects_scrubbed":3,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:26:37.571954+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10339768,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":10694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'398","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.297083+0000","last_change":"2024-04-22T01:11:13.297083+0000","last_active":"2024-04-22T01:11:13.297083+0000","last_peered":"2024-04-22T01:11:13.297083+0000","last_clean":"2024-04-22T01:11:13.297083+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-22T01:11:13.297083+0000","last_undegraded":"2024-04-22T01:11:13.297083+0000","last_fullsized":"2024-04-22T01:11:13.297083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2024-04-22T01:11:13.296807+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2024-04-22T01:11:13.296807+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.296807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:41:46.732273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27611,"num_write":368,"num_write_kb":80241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'3974","reported_seq":4058,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.269486+0000","last_change":"2024-04-22T01:11:09.269486+0000","last_active":"2024-04-22T01:11:09.269486+0000","last_peered":"2024-04-22T01:11:09.269486+0000","last_clean":"2024-04-22T01:11:09.269486+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-22T01:11:09.269486+0000","last_undegraded":"2024-04-22T01:11:09.269486+0000","last_fullsized":"2024-04-22T01:11:09.269486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3974","last_scrub_stamp":"2024-04-22T01:11:09.269259+0000","last_deep_scrub":"25'3974","last_deep_scrub_stamp":"2024-04-22T01:11:09.269259+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.269259+0000","objects_scrubbed":4,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:51:34.209336+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'395","reported_seq":520,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:19.046299+0000","last_change":"2024-04-22T01:11:19.046417+0000","last_active":"2024-04-22T01:11:19.046299+0000","last_peered":"2024-04-22T01:11:19.046299+0000","last_clean":"2024-04-22T01:11:19.046299+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-22T01:11:19.046299+0000","last_undegraded":"2024-04-22T01:11:19.046299+0000","last_fullsized":"2024-04-22T01:11:19.046299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:19.046034+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:19.046034+0000","last_clean_scrub_stamp":"2024-04-22T01:11:19.046034+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:22:41.395811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17003,"num_write":357,"num_write_kb":47379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2300","reported_seq":2385,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.801153+0000","last_change":"2024-04-22T01:11:04.801240+0000","last_active":"2024-04-22T01:11:04.801153+0000","last_peered":"2024-04-22T01:11:04.801153+0000","last_clean":"2024-04-22T01:11:04.801153+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-22T01:11:04.801153+0000","last_undegraded":"2024-04-22T01:11:04.801153+0000","last_fullsized":"2024-04-22T01:11:04.801153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2300","last_scrub_stamp":"2024-04-22T01:11:04.800934+0000","last_deep_scrub":"25'2300","last_deep_scrub_stamp":"2024-04-22T01:11:04.800934+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.800934+0000","objects_scrubbed":6,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:14.506323+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2254,"num_write_kb":13663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'414","reported_seq":549,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.428625+0000","last_change":"2024-04-22T01:11:12.428625+0000","last_active":"2024-04-22T01:11:12.428625+0000","last_peered":"2024-04-22T01:11:12.428625+0000","last_clean":"2024-04-22T01:11:12.428625+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-22T01:11:12.428625+0000","last_undegraded":"2024-04-22T01:11:12.428625+0000","last_fullsized":"2024-04-22T01:11:12.428625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-04-22T01:11:12.428293+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-04-22T01:11:12.428293+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.428293+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:10:21.730582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26385,"num_write":381,"num_write_kb":92626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'724","reported_seq":810,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.243140+0000","last_change":"2024-04-22T01:11:10.243140+0000","last_active":"2024-04-22T01:11:10.243140+0000","last_peered":"2024-04-22T01:11:10.243140+0000","last_clean":"2024-04-22T01:11:10.243140+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-22T01:11:10.243140+0000","last_undegraded":"2024-04-22T01:11:10.243140+0000","last_fullsized":"2024-04-22T01:11:10.243140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'724","last_scrub_stamp":"2024-04-22T01:11:10.242897+0000","last_deep_scrub":"25'724","last_deep_scrub_stamp":"2024-04-22T01:11:10.242897+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.242897+0000","objects_scrubbed":4,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:52:49.905341+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'386","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.057402+0000","last_change":"2024-04-22T01:11:12.057402+0000","last_active":"2024-04-22T01:11:12.057402+0000","last_peered":"2024-04-22T01:11:12.057402+0000","last_clean":"2024-04-22T01:11:12.057402+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-22T01:11:12.057402+0000","last_undegraded":"2024-04-22T01:11:12.057402+0000","last_fullsized":"2024-04-22T01:11:12.057402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'386","last_scrub_stamp":"2024-04-22T01:11:12.056969+0000","last_deep_scrub":"25'386","last_deep_scrub_stamp":"2024-04-22T01:11:12.056969+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.056969+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:43:24.148288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5166,"num_write":360,"num_write_kb":42321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'60","reported_seq":146,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.069730+0000","last_change":"2024-04-22T01:11:15.069730+0000","last_active":"2024-04-22T01:11:15.069730+0000","last_peered":"2024-04-22T01:11:15.069730+0000","last_clean":"2024-04-22T01:11:15.069730+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-22T01:11:15.069730+0000","last_undegraded":"2024-04-22T01:11:15.069730+0000","last_fullsized":"2024-04-22T01:11:15.069730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'60","last_scrub_stamp":"2024-04-22T01:11:15.069482+0000","last_deep_scrub":"25'60","last_deep_scrub_stamp":"2024-04-22T01:11:15.069482+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.069482+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:19:11.151792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'397","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:25.162512+0000","last_change":"2024-04-22T01:11:25.162578+0000","last_active":"2024-04-22T01:11:25.162512+0000","last_peered":"2024-04-22T01:11:25.162512+0000","last_clean":"2024-04-22T01:11:25.162512+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-22T01:11:25.162512+0000","last_undegraded":"2024-04-22T01:11:25.162512+0000","last_fullsized":"2024-04-22T01:11:25.162512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'397","last_scrub_stamp":"2024-04-22T01:11:25.162279+0000","last_deep_scrub":"25'397","last_deep_scrub_stamp":"2024-04-22T01:11:25.162279+0000","last_clean_scrub_stamp":"2024-04-22T01:11:25.162279+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:16:30.596119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27517,"num_write":361,"num_write_kb":56016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'51","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.407715+0000","last_change":"2024-04-22T01:11:07.407715+0000","last_active":"2024-04-22T01:11:07.407715+0000","last_peered":"2024-04-22T01:11:07.407715+0000","last_clean":"2024-04-22T01:11:07.407715+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-22T01:11:07.407715+0000","last_undegraded":"2024-04-22T01:11:07.407715+0000","last_fullsized":"2024-04-22T01:11:07.407715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'51","last_scrub_stamp":"2024-04-22T01:11:07.407540+0000","last_deep_scrub":"25'51","last_deep_scrub_stamp":"2024-04-22T01:11:07.407540+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.407540+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:16:55.884501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'460","reported_seq":591,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.034887+0000","last_change":"2024-04-22T01:11:07.034887+0000","last_active":"2024-04-22T01:11:07.034887+0000","last_peered":"2024-04-22T01:11:07.034887+0000","last_clean":"2024-04-22T01:11:07.034887+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-22T01:11:07.034887+0000","last_undegraded":"2024-04-22T01:11:07.034887+0000","last_fullsized":"2024-04-22T01:11:07.034887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'460","last_scrub_stamp":"2024-04-22T01:11:07.034663+0000","last_deep_scrub":"25'460","last_deep_scrub_stamp":"2024-04-22T01:11:07.034663+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.034663+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:28.643378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":20178,"num_write":438,"num_write_kb":96694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'925","reported_seq":1011,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.698167+0000","last_change":"2024-04-22T01:11:06.698167+0000","last_active":"2024-04-22T01:11:06.698167+0000","last_peered":"2024-04-22T01:11:06.698167+0000","last_clean":"2024-04-22T01:11:06.698167+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-22T01:11:06.698167+0000","last_undegraded":"2024-04-22T01:11:06.698167+0000","last_fullsized":"2024-04-22T01:11:06.698167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'925","last_scrub_stamp":"2024-04-22T01:11:06.697953+0000","last_deep_scrub":"25'925","last_deep_scrub_stamp":"2024-04-22T01:11:06.697953+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.697953+0000","objects_scrubbed":6,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:28.306667+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'481","reported_seq":622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.059406+0000","last_change":"2024-04-22T01:11:09.059406+0000","last_active":"2024-04-22T01:11:09.059406+0000","last_peered":"2024-04-22T01:11:09.059406+0000","last_clean":"2024-04-22T01:11:09.059406+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-22T01:11:09.059406+0000","last_undegraded":"2024-04-22T01:11:09.059406+0000","last_fullsized":"2024-04-22T01:11:09.059406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'481","last_scrub_stamp":"2024-04-22T01:11:09.059152+0000","last_deep_scrub":"25'481","last_deep_scrub_stamp":"2024-04-22T01:11:09.059152+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.059152+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:27.161572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33204,"num_write":448,"num_write_kb":124685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'820","reported_seq":907,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.457393+0000","last_change":"2024-04-22T01:11:08.457427+0000","last_active":"2024-04-22T01:11:08.457393+0000","last_peered":"2024-04-22T01:11:08.457393+0000","last_clean":"2024-04-22T01:11:08.457393+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-22T01:11:08.457393+0000","last_undegraded":"2024-04-22T01:11:08.457393+0000","last_fullsized":"2024-04-22T01:11:08.457393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'820","last_scrub_stamp":"2024-04-22T01:11:08.457308+0000","last_deep_scrub":"25'820","last_deep_scrub_stamp":"2024-04-22T01:11:08.457308+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.457308+0000","objects_scrubbed":2,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:36:03.806049+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'350","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.709394+0000","last_change":"2024-04-22T01:11:11.709457+0000","last_active":"2024-04-22T01:11:11.709394+0000","last_peered":"2024-04-22T01:11:11.709394+0000","last_clean":"2024-04-22T01:11:11.709394+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-22T01:11:11.709394+0000","last_undegraded":"2024-04-22T01:11:11.709394+0000","last_fullsized":"2024-04-22T01:11:11.709394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'350","last_scrub_stamp":"2024-04-22T01:11:11.709219+0000","last_deep_scrub":"25'350","last_deep_scrub_stamp":"2024-04-22T01:11:11.709219+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.709219+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:36:18.571644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12827,"num_write":324,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'822","reported_seq":910,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.759431+0000","last_change":"2024-04-22T01:11:10.759501+0000","last_active":"2024-04-22T01:11:10.759431+0000","last_peered":"2024-04-22T01:11:10.759431+0000","last_clean":"2024-04-22T01:11:10.759431+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-22T01:11:10.759431+0000","last_undegraded":"2024-04-22T01:11:10.759431+0000","last_fullsized":"2024-04-22T01:11:10.759431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'822","last_scrub_stamp":"2024-04-22T01:11:10.759257+0000","last_deep_scrub":"25'822","last_deep_scrub_stamp":"2024-04-22T01:11:10.759257+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.759257+0000","objects_scrubbed":2,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:37:01.617948+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'428","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.365124+0000","last_change":"2024-04-22T01:11:14.365182+0000","last_active":"2024-04-22T01:11:14.365124+0000","last_peered":"2024-04-22T01:11:14.365124+0000","last_clean":"2024-04-22T01:11:14.365124+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-22T01:11:14.365124+0000","last_undegraded":"2024-04-22T01:11:14.365124+0000","last_fullsized":"2024-04-22T01:11:14.365124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2024-04-22T01:11:14.364947+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2024-04-22T01:11:14.364947+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.364947+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:51:19.851435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36323,"num_write":394,"num_write_kb":104531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'354","reported_seq":442,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.232856+0000","last_change":"2024-04-22T01:11:07.232987+0000","last_active":"2024-04-22T01:11:07.232856+0000","last_peered":"2024-04-22T01:11:07.232856+0000","last_clean":"2024-04-22T01:11:07.232856+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-22T01:11:07.232856+0000","last_undegraded":"2024-04-22T01:11:07.232856+0000","last_fullsized":"2024-04-22T01:11:07.232856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'354","last_scrub_stamp":"2024-04-22T01:11:07.232565+0000","last_deep_scrub":"25'354","last_deep_scrub_stamp":"2024-04-22T01:11:07.232565+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.232565+0000","objects_scrubbed":2,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:14:48.094691+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'429","reported_seq":556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.411324+0000","last_change":"2024-04-22T01:11:11.411386+0000","last_active":"2024-04-22T01:11:11.411324+0000","last_peered":"2024-04-22T01:11:11.411324+0000","last_clean":"2024-04-22T01:11:11.411324+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-22T01:11:11.411324+0000","last_undegraded":"2024-04-22T01:11:11.411324+0000","last_fullsized":"2024-04-22T01:11:11.411324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2024-04-22T01:11:11.411148+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2024-04-22T01:11:11.411148+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.411148+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:27:52.078450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22478,"num_write":396,"num_write_kb":50602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'341","reported_seq":429,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.067744+0000","last_change":"2024-04-22T01:11:10.067812+0000","last_active":"2024-04-22T01:11:10.067744+0000","last_peered":"2024-04-22T01:11:10.067744+0000","last_clean":"2024-04-22T01:11:10.067744+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-22T01:11:10.067744+0000","last_undegraded":"2024-04-22T01:11:10.067744+0000","last_fullsized":"2024-04-22T01:11:10.067744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'341","last_scrub_stamp":"2024-04-22T01:11:10.067566+0000","last_deep_scrub":"25'341","last_deep_scrub_stamp":"2024-04-22T01:11:10.067566+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.067566+0000","objects_scrubbed":1,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:31.676280+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'412","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:20.029755+0000","last_change":"2024-04-22T01:11:20.029873+0000","last_active":"2024-04-22T01:11:20.029755+0000","last_peered":"2024-04-22T01:11:20.029755+0000","last_clean":"2024-04-22T01:11:20.029755+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-22T01:11:20.029755+0000","last_undegraded":"2024-04-22T01:11:20.029755+0000","last_fullsized":"2024-04-22T01:11:20.029755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2024-04-22T01:11:20.029504+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2024-04-22T01:11:20.029504+0000","last_clean_scrub_stamp":"2024-04-22T01:11:20.029504+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:05:24.662971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12764,"num_write":388,"num_write_kb":59120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'163","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:02.926761+0000","last_change":"2024-04-22T01:11:02.926813+0000","last_active":"2024-04-22T01:11:02.926761+0000","last_peered":"2024-04-22T01:11:02.926761+0000","last_clean":"2024-04-22T01:11:02.926761+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-22T01:11:02.926761+0000","last_undegraded":"2024-04-22T01:11:02.926761+0000","last_fullsized":"2024-04-22T01:11:02.926761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'163","last_scrub_stamp":"2024-04-22T01:11:02.926654+0000","last_deep_scrub":"25'163","last_deep_scrub_stamp":"2024-04-22T01:11:02.926654+0000","last_clean_scrub_stamp":"2024-04-22T01:11:02.926654+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:44:16.121734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'374","reported_seq":467,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.050857+0000","last_change":"2024-04-22T01:11:17.050947+0000","last_active":"2024-04-22T01:11:17.050857+0000","last_peered":"2024-04-22T01:11:17.050857+0000","last_clean":"2024-04-22T01:11:17.050857+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-22T01:11:17.050857+0000","last_undegraded":"2024-04-22T01:11:17.050857+0000","last_fullsized":"2024-04-22T01:11:17.050857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'374","last_scrub_stamp":"2024-04-22T01:11:17.050649+0000","last_deep_scrub":"25'374","last_deep_scrub_stamp":"2024-04-22T01:11:17.050649+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.050649+0000","objects_scrubbed":1,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:40:02.124581+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'363","reported_seq":498,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.679937+0000","last_change":"2024-04-22T01:11:14.680058+0000","last_active":"2024-04-22T01:11:14.679937+0000","last_peered":"2024-04-22T01:11:14.679937+0000","last_clean":"2024-04-22T01:11:14.679937+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-22T01:11:14.679937+0000","last_undegraded":"2024-04-22T01:11:14.679937+0000","last_fullsized":"2024-04-22T01:11:14.679937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'363","last_scrub_stamp":"2024-04-22T01:11:14.679711+0000","last_deep_scrub":"25'363","last_deep_scrub_stamp":"2024-04-22T01:11:14.679711+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.679711+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:02:56.833372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26229,"num_write":331,"num_write_kb":46345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'1078","reported_seq":1173,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.135412+0000","last_change":"2024-04-22T01:11:10.135489+0000","last_active":"2024-04-22T01:11:10.135412+0000","last_peered":"2024-04-22T01:11:10.135412+0000","last_clean":"2024-04-22T01:11:10.135412+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-22T01:11:10.135412+0000","last_undegraded":"2024-04-22T01:11:10.135412+0000","last_fullsized":"2024-04-22T01:11:10.135412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1078","last_scrub_stamp":"2024-04-22T01:11:10.135236+0000","last_deep_scrub":"25'1078","last_deep_scrub_stamp":"2024-04-22T01:11:10.135236+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.135236+0000","objects_scrubbed":3,"log_size":1078,"log_dups_size":0,"ondisk_log_size":1078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:40:25.120360+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'414","reported_seq":616,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.063540+0000","last_change":"2024-04-22T01:11:16.063565+0000","last_active":"2024-04-22T01:11:16.063540+0000","last_peered":"2024-04-22T01:11:16.063540+0000","last_clean":"2024-04-22T01:11:16.063540+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-22T01:11:16.063540+0000","last_undegraded":"2024-04-22T01:11:16.063540+0000","last_fullsized":"2024-04-22T01:11:16.063540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-04-22T01:11:16.063453+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-04-22T01:11:16.063453+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.063453+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:37:21.721155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":57177,"num_write":383,"num_write_kb":104760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'4405","reported_seq":8847,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.176677+0000","last_change":"2024-04-22T01:11:11.176740+0000","last_active":"2024-04-22T01:11:11.176677+0000","last_peered":"2024-04-22T01:11:11.176677+0000","last_clean":"2024-04-22T01:11:11.176677+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-22T01:11:11.176677+0000","last_undegraded":"2024-04-22T01:11:11.176677+0000","last_fullsized":"2024-04-22T01:11:11.176677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4405","last_scrub_stamp":"2024-04-22T01:11:11.176487+0000","last_deep_scrub":"25'4405","last_deep_scrub_stamp":"2024-04-22T01:11:11.176487+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.176487+0000","objects_scrubbed":1,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:38:50.145656+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":4349,"num_write_kb":4731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":537,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.317854+0000","last_change":"2024-04-22T01:11:15.317919+0000","last_active":"2024-04-22T01:11:15.317854+0000","last_peered":"2024-04-22T01:11:15.317854+0000","last_clean":"2024-04-22T01:11:15.317854+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-22T01:11:15.317854+0000","last_undegraded":"2024-04-22T01:11:15.317854+0000","last_fullsized":"2024-04-22T01:11:15.317854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2024-04-22T01:11:15.317668+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2024-04-22T01:11:15.317668+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.317668+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:30:58.648678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21533,"num_write":374,"num_write_kb":54814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1082","reported_seq":1175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.077188+0000","last_change":"2024-04-22T01:11:16.077256+0000","last_active":"2024-04-22T01:11:16.077188+0000","last_peered":"2024-04-22T01:11:16.077188+0000","last_clean":"2024-04-22T01:11:16.077188+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-22T01:11:16.077188+0000","last_undegraded":"2024-04-22T01:11:16.077188+0000","last_fullsized":"2024-04-22T01:11:16.077188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1082","last_scrub_stamp":"2024-04-22T01:11:16.077019+0000","last_deep_scrub":"25'1082","last_deep_scrub_stamp":"2024-04-22T01:11:16.077019+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.077019+0000","objects_scrubbed":2,"log_size":1082,"log_dups_size":0,"ondisk_log_size":1082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:35:17.346943+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":8663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'379","reported_seq":492,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.330712+0000","last_change":"2024-04-22T01:11:16.330773+0000","last_active":"2024-04-22T01:11:16.330712+0000","last_peered":"2024-04-22T01:11:16.330712+0000","last_clean":"2024-04-22T01:11:16.330712+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-22T01:11:16.330712+0000","last_undegraded":"2024-04-22T01:11:16.330712+0000","last_fullsized":"2024-04-22T01:11:16.330712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'379","last_scrub_stamp":"2024-04-22T01:11:16.330533+0000","last_deep_scrub":"25'379","last_deep_scrub_stamp":"2024-04-22T01:11:16.330533+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.330533+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:19:12.412843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7866,"num_write":347,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'362","reported_seq":455,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.238651+0000","last_change":"2024-04-22T01:11:09.238713+0000","last_active":"2024-04-22T01:11:09.238651+0000","last_peered":"2024-04-22T01:11:09.238651+0000","last_clean":"2024-04-22T01:11:09.238651+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-22T01:11:09.238651+0000","last_undegraded":"2024-04-22T01:11:09.238651+0000","last_fullsized":"2024-04-22T01:11:09.238651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'362","last_scrub_stamp":"2024-04-22T01:11:09.238448+0000","last_deep_scrub":"25'362","last_deep_scrub_stamp":"2024-04-22T01:11:09.238448+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.238448+0000","objects_scrubbed":1,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:57:39.622699+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'447","reported_seq":589,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.755044+0000","last_change":"2024-04-22T01:11:10.755104+0000","last_active":"2024-04-22T01:11:10.755044+0000","last_peered":"2024-04-22T01:11:10.755044+0000","last_clean":"2024-04-22T01:11:10.755044+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-22T01:11:10.755044+0000","last_undegraded":"2024-04-22T01:11:10.755044+0000","last_fullsized":"2024-04-22T01:11:10.755044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'447","last_scrub_stamp":"2024-04-22T01:11:10.754833+0000","last_deep_scrub":"25'447","last_deep_scrub_stamp":"2024-04-22T01:11:10.754833+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.754833+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:29:15.679599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21571,"num_write":411,"num_write_kb":92495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'997","reported_seq":1089,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.163553+0000","last_change":"2024-04-22T01:11:11.163709+0000","last_active":"2024-04-22T01:11:11.163553+0000","last_peered":"2024-04-22T01:11:11.163553+0000","last_clean":"2024-04-22T01:11:11.163553+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-22T01:11:11.163553+0000","last_undegraded":"2024-04-22T01:11:11.163553+0000","last_fullsized":"2024-04-22T01:11:11.163553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'997","last_scrub_stamp":"2024-04-22T01:11:11.163325+0000","last_deep_scrub":"25'997","last_deep_scrub_stamp":"2024-04-22T01:11:11.163325+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.163325+0000","objects_scrubbed":2,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:47:58.856899+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'396","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.049974+0000","last_change":"2024-04-22T01:11:15.050032+0000","last_active":"2024-04-22T01:11:15.049974+0000","last_peered":"2024-04-22T01:11:15.049974+0000","last_clean":"2024-04-22T01:11:15.049974+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-22T01:11:15.049974+0000","last_undegraded":"2024-04-22T01:11:15.049974+0000","last_fullsized":"2024-04-22T01:11:15.049974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'396","last_scrub_stamp":"2024-04-22T01:11:15.049789+0000","last_deep_scrub":"25'396","last_deep_scrub_stamp":"2024-04-22T01:11:15.049789+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.049789+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:19:43.979748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32877,"num_write":358,"num_write_kb":75502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'6444","reported_seq":6534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.693207+0000","last_change":"2024-04-22T01:11:08.693269+0000","last_active":"2024-04-22T01:11:08.693207+0000","last_peered":"2024-04-22T01:11:08.693207+0000","last_clean":"2024-04-22T01:11:08.693207+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-22T01:11:08.693207+0000","last_undegraded":"2024-04-22T01:11:08.693207+0000","last_fullsized":"2024-04-22T01:11:08.693207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6444","last_scrub_stamp":"2024-04-22T01:11:08.693005+0000","last_deep_scrub":"25'6444","last_deep_scrub_stamp":"2024-04-22T01:11:08.693005+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.693005+0000","objects_scrubbed":1,"log_size":6444,"log_dups_size":0,"ondisk_log_size":6444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:47:55.001921+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17429,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'369","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.728330+0000","last_change":"2024-04-22T01:11:16.728457+0000","last_active":"2024-04-22T01:11:16.728330+0000","last_peered":"2024-04-22T01:11:16.728330+0000","last_clean":"2024-04-22T01:11:16.728330+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-22T01:11:16.728330+0000","last_undegraded":"2024-04-22T01:11:16.728330+0000","last_fullsized":"2024-04-22T01:11:16.728330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'369","last_scrub_stamp":"2024-04-22T01:11:16.728008+0000","last_deep_scrub":"25'369","last_deep_scrub_stamp":"2024-04-22T01:11:16.728008+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.728008+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:33.643540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39028,"num_write":349,"num_write_kb":80130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'455","reported_seq":545,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.072053+0000","last_change":"2024-04-22T01:11:14.072125+0000","last_active":"2024-04-22T01:11:14.072053+0000","last_peered":"2024-04-22T01:11:14.072053+0000","last_clean":"2024-04-22T01:11:14.072053+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-22T01:11:14.072053+0000","last_undegraded":"2024-04-22T01:11:14.072053+0000","last_fullsized":"2024-04-22T01:11:14.072053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'455","last_scrub_stamp":"2024-04-22T01:11:14.071870+0000","last_deep_scrub":"25'455","last_deep_scrub_stamp":"2024-04-22T01:11:14.071870+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.071870+0000","objects_scrubbed":2,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:00:01.686651+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":616,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.715028+0000","last_change":"2024-04-22T01:11:12.715082+0000","last_active":"2024-04-22T01:11:12.715028+0000","last_peered":"2024-04-22T01:11:12.715028+0000","last_clean":"2024-04-22T01:11:12.715028+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-22T01:11:12.715028+0000","last_undegraded":"2024-04-22T01:11:12.715028+0000","last_fullsized":"2024-04-22T01:11:12.715028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'453","last_scrub_stamp":"2024-04-22T01:11:12.714852+0000","last_deep_scrub":"25'453","last_deep_scrub_stamp":"2024-04-22T01:11:12.714852+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.714852+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:37:18.372554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43751,"num_write":424,"num_write_kb":64176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'392","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.371641+0000","last_change":"2024-04-22T01:11:06.371674+0000","last_active":"2024-04-22T01:11:06.371641+0000","last_peered":"2024-04-22T01:11:06.371641+0000","last_clean":"2024-04-22T01:11:06.371641+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-22T01:11:06.371641+0000","last_undegraded":"2024-04-22T01:11:06.371641+0000","last_fullsized":"2024-04-22T01:11:06.371641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2024-04-22T01:11:06.371527+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2024-04-22T01:11:06.371527+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.371527+0000","objects_scrubbed":1,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:20:53.747993+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":568,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.091766+0000","last_change":"2024-04-22T01:11:08.091889+0000","last_active":"2024-04-22T01:11:08.091766+0000","last_peered":"2024-04-22T01:11:08.091766+0000","last_clean":"2024-04-22T01:11:08.091766+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-22T01:11:08.091766+0000","last_undegraded":"2024-04-22T01:11:08.091766+0000","last_fullsized":"2024-04-22T01:11:08.091766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-04-22T01:11:08.091479+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-04-22T01:11:08.091479+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.091479+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:45:15.301622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21201,"num_write":420,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'470","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.702154+0000","last_change":"2024-04-22T01:11:09.702222+0000","last_active":"2024-04-22T01:11:09.702154+0000","last_peered":"2024-04-22T01:11:09.702154+0000","last_clean":"2024-04-22T01:11:09.702154+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-22T01:11:09.702154+0000","last_undegraded":"2024-04-22T01:11:09.702154+0000","last_fullsized":"2024-04-22T01:11:09.702154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'470","last_scrub_stamp":"2024-04-22T01:11:09.701985+0000","last_deep_scrub":"25'470","last_deep_scrub_stamp":"2024-04-22T01:11:09.701985+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.701985+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:30:18.169534+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'409","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.680332+0000","last_change":"2024-04-22T01:11:11.680392+0000","last_active":"2024-04-22T01:11:11.680332+0000","last_peered":"2024-04-22T01:11:11.680332+0000","last_clean":"2024-04-22T01:11:11.680332+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-22T01:11:11.680332+0000","last_undegraded":"2024-04-22T01:11:11.680332+0000","last_fullsized":"2024-04-22T01:11:11.680332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2024-04-22T01:11:11.680140+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2024-04-22T01:11:11.680140+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.680140+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:20:54.008002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6132,"num_write":377,"num_write_kb":79520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1239","reported_seq":1329,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.093114+0000","last_change":"2024-04-22T01:11:11.093182+0000","last_active":"2024-04-22T01:11:11.093114+0000","last_peered":"2024-04-22T01:11:11.093114+0000","last_clean":"2024-04-22T01:11:11.093114+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-22T01:11:11.093114+0000","last_undegraded":"2024-04-22T01:11:11.093114+0000","last_fullsized":"2024-04-22T01:11:11.093114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1239","last_scrub_stamp":"2024-04-22T01:11:11.092919+0000","last_deep_scrub":"25'1239","last_deep_scrub_stamp":"2024-04-22T01:11:11.092919+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.092919+0000","objects_scrubbed":2,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:09:57.870400+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.163143+0000","last_change":"2024-04-22T01:11:14.163201+0000","last_active":"2024-04-22T01:11:14.163143+0000","last_peered":"2024-04-22T01:11:14.163143+0000","last_clean":"2024-04-22T01:11:14.163143+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-22T01:11:14.163143+0000","last_undegraded":"2024-04-22T01:11:14.163143+0000","last_fullsized":"2024-04-22T01:11:14.163143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2024-04-22T01:11:14.162951+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2024-04-22T01:11:14.162951+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.162951+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:35.600197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16119,"num_write":379,"num_write_kb":38543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1283","reported_seq":1371,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.126807+0000","last_change":"2024-04-22T01:11:18.126963+0000","last_active":"2024-04-22T01:11:18.126807+0000","last_peered":"2024-04-22T01:11:18.126807+0000","last_clean":"2024-04-22T01:11:18.126807+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-22T01:11:18.126807+0000","last_undegraded":"2024-04-22T01:11:18.126807+0000","last_fullsized":"2024-04-22T01:11:18.126807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1283","last_scrub_stamp":"2024-04-22T01:11:18.126567+0000","last_deep_scrub":"25'1283","last_deep_scrub_stamp":"2024-04-22T01:11:18.126567+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.126567+0000","objects_scrubbed":4,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:53:48.796519+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":12886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'432","reported_seq":571,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:21.036199+0000","last_change":"2024-04-22T01:11:21.036259+0000","last_active":"2024-04-22T01:11:21.036199+0000","last_peered":"2024-04-22T01:11:21.036199+0000","last_clean":"2024-04-22T01:11:21.036199+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-22T01:11:21.036199+0000","last_undegraded":"2024-04-22T01:11:21.036199+0000","last_fullsized":"2024-04-22T01:11:21.036199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'432","last_scrub_stamp":"2024-04-22T01:11:21.036022+0000","last_deep_scrub":"25'432","last_deep_scrub_stamp":"2024-04-22T01:11:21.036022+0000","last_clean_scrub_stamp":"2024-04-22T01:11:21.036022+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:32.879632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23225,"num_write":401,"num_write_kb":108270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'409","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:24.123954+0000","last_change":"2024-04-22T01:11:24.124077+0000","last_active":"2024-04-22T01:11:24.123954+0000","last_peered":"2024-04-22T01:11:24.123954+0000","last_clean":"2024-04-22T01:11:24.123954+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-22T01:11:24.123954+0000","last_undegraded":"2024-04-22T01:11:24.123954+0000","last_fullsized":"2024-04-22T01:11:24.123954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2024-04-22T01:11:24.123753+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2024-04-22T01:11:24.123753+0000","last_clean_scrub_stamp":"2024-04-22T01:11:24.123753+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:07:52.628920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22627,"num_write":363,"num_write_kb":69341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'794","reported_seq":876,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.364347+0000","last_change":"2024-04-22T01:11:04.364347+0000","last_active":"2024-04-22T01:11:04.364347+0000","last_peered":"2024-04-22T01:11:04.364347+0000","last_clean":"2024-04-22T01:11:04.364347+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-22T01:11:04.364347+0000","last_undegraded":"2024-04-22T01:11:04.364347+0000","last_fullsized":"2024-04-22T01:11:04.364347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'794","last_scrub_stamp":"2024-04-22T01:11:04.364227+0000","last_deep_scrub":"25'794","last_deep_scrub_stamp":"2024-04-22T01:11:04.364227+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.364227+0000","objects_scrubbed":2,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:46.996846+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'375","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.969141+0000","last_change":"2024-04-22T01:11:08.969141+0000","last_active":"2024-04-22T01:11:08.969141+0000","last_peered":"2024-04-22T01:11:08.969141+0000","last_clean":"2024-04-22T01:11:08.969141+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-22T01:11:08.969141+0000","last_undegraded":"2024-04-22T01:11:08.969141+0000","last_fullsized":"2024-04-22T01:11:08.969141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'375","last_scrub_stamp":"2024-04-22T01:11:08.968906+0000","last_deep_scrub":"25'375","last_deep_scrub_stamp":"2024-04-22T01:11:08.968906+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.968906+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:30:53.556822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17046,"num_write":339,"num_write_kb":42889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2012","reported_seq":2094,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:03.378159+0000","last_change":"2024-04-22T01:11:03.378159+0000","last_active":"2024-04-22T01:11:03.378159+0000","last_peered":"2024-04-22T01:11:03.378159+0000","last_clean":"2024-04-22T01:11:03.378159+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-22T01:11:03.378159+0000","last_undegraded":"2024-04-22T01:11:03.378159+0000","last_fullsized":"2024-04-22T01:11:03.378159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2012","last_scrub_stamp":"2024-04-22T01:11:03.378047+0000","last_deep_scrub":"25'2012","last_deep_scrub_stamp":"2024-04-22T01:11:03.378047+0000","last_clean_scrub_stamp":"2024-04-22T01:11:03.378047+0000","objects_scrubbed":5,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:19:32.308006+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":17305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'380","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.348942+0000","last_change":"2024-04-22T01:11:16.349004+0000","last_active":"2024-04-22T01:11:16.348942+0000","last_peered":"2024-04-22T01:11:16.348942+0000","last_clean":"2024-04-22T01:11:16.348942+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-22T01:11:16.348942+0000","last_undegraded":"2024-04-22T01:11:16.348942+0000","last_fullsized":"2024-04-22T01:11:16.348942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'380","last_scrub_stamp":"2024-04-22T01:11:16.348755+0000","last_deep_scrub":"25'380","last_deep_scrub_stamp":"2024-04-22T01:11:16.348755+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.348755+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:39:26.191865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35342,"num_write":358,"num_write_kb":67635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'690","reported_seq":785,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.307799+0000","last_change":"2024-04-22T01:11:10.307973+0000","last_active":"2024-04-22T01:11:10.307799+0000","last_peered":"2024-04-22T01:11:10.307799+0000","last_clean":"2024-04-22T01:11:10.307799+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-22T01:11:10.307799+0000","last_undegraded":"2024-04-22T01:11:10.307799+0000","last_fullsized":"2024-04-22T01:11:10.307799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'690","last_scrub_stamp":"2024-04-22T01:11:10.307484+0000","last_deep_scrub":"25'690","last_deep_scrub_stamp":"2024-04-22T01:11:10.307484+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.307484+0000","objects_scrubbed":2,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:47:32.771487+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'405","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.370801+0000","last_change":"2024-04-22T01:11:17.370876+0000","last_active":"2024-04-22T01:11:17.370801+0000","last_peered":"2024-04-22T01:11:17.370801+0000","last_clean":"2024-04-22T01:11:17.370801+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-22T01:11:17.370801+0000","last_undegraded":"2024-04-22T01:11:17.370801+0000","last_fullsized":"2024-04-22T01:11:17.370801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'405","last_scrub_stamp":"2024-04-22T01:11:17.370623+0000","last_deep_scrub":"25'405","last_deep_scrub_stamp":"2024-04-22T01:11:17.370623+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.370623+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:00:55.196702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37645,"num_write":381,"num_write_kb":68489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'722","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.692881+0000","last_change":"2024-04-22T01:11:07.692881+0000","last_active":"2024-04-22T01:11:07.692881+0000","last_peered":"2024-04-22T01:11:07.692881+0000","last_clean":"2024-04-22T01:11:07.692881+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-22T01:11:07.692881+0000","last_undegraded":"2024-04-22T01:11:07.692881+0000","last_fullsized":"2024-04-22T01:11:07.692881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'722","last_scrub_stamp":"2024-04-22T01:11:07.692530+0000","last_deep_scrub":"25'722","last_deep_scrub_stamp":"2024-04-22T01:11:07.692530+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.692530+0000","objects_scrubbed":4,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:29:07.964970+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":676,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":1454219,"num_write":24465,"num_write_kb":4289319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213130007,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":48352,"num_write_kb":232418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228024320,"data_stored":426260014,"data_compressed":52327842,"data_compressed_allocated":69902336,"data_compressed_original":268197888,"omap_allocated":0,"internal_metadata":0},"log_size":39221,"ondisk_log_size":39221,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62916,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424511106,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71724,"kb_used_data":18340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":18780160,"data_stored":33648040,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511106,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151488,"kb_used_data":43960,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94220352,"statfs":{"total":96636764160,"available":96481640448,"internally_reserved":0,"allocated":45015040,"data_stored":88174574,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424511106,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84940,"kb_used_data":17668,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286900,"statfs":{"total":96636764160,"available":96549785600,"internally_reserved":0,"allocated":18092032,"data_stored":33648712,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424511107,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93264,"kb_used_data":25992,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278576,"statfs":{"total":96636764160,"available":96541261824,"internally_reserved":0,"allocated":26615808,"data_stored":48772550,"data_compressed":5793004,"data_compressed_allocated":7802880,"data_compressed_original":30134272,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424511106,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137712,"kb_used_data":30184,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94234128,"statfs":{"total":96636764160,"available":96495747072,"internally_reserved":0,"allocated":30908416,"data_stored":54620904,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511105,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148336,"kb_used_data":44968,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94223504,"statfs":{"total":96636764160,"available":96484868096,"internally_reserved":0,"allocated":46047232,"data_stored":81736600,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543812,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128480,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94243360,"statfs":{"total":96636764160,"available":96505200640,"internally_reserved":0,"allocated":17195008,"data_stored":35110341,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543811,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130280,"kb_used_data":26912,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94241560,"statfs":{"total":96636764160,"available":96503357440,"internally_reserved":0,"allocated":27557888,"data_stored":52477893,"data_compressed":6455074,"data_compressed_allocated":8462336,"data_compressed_original":33558528,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45789184,"data_stored":81642992,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26296320,"data_stored":48088574,"data_compressed":5761546,"data_compressed_allocated":7761920,"data_compressed_original":29560832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17833984,"data_stored":33555104,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44756992,"data_stored":88080966,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30650368,"data_stored":54527296,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":51793917,"data_compressed":6423616,"data_compressed_allocated":8421376,"data_compressed_original":32985088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18522112,"data_stored":33554432,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16936960,"data_stored":35016733,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T01:11:30.549 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-21T22:53:36.908691+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=21, tm_hour=22, tm_min=53, tm_sec=36, tm_wday=6, tm_yday=112, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=1, tm_min=10, tm_sec=59, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T01:11:30.550 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T01:11:50.551 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T01:11:50.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f322a390640 1 Processor -- start 2024-04-22T01:11:50.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f322a390640 1 -- start start 2024-04-22T01:11:50.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f322a390640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3224150c20 0x7f32240c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:50.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f322a390640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32240c3320 con 0x7f3224156950 2024-04-22T01:11:50.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f322a390640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32240c7300 con 0x7f322406ee90 2024-04-22T01:11:50.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f322a390640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f32240c5640 con 0x7f3224150c20 2024-04-22T01:11:50.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f3223fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3224150c20 0x7f32240c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:50.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f3223fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3224150c20 0x7f32240c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51460/0 (socket says 172.21.15.110:51460) 2024-04-22T01:11:50.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.683+0000 7f3223fff640 1 -- 172.21.15.110:0/1343771315 learned_addr learned my addr 172.21.15.110:0/1343771315 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:50.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.687+0000 7f3223fff640 1 -- 172.21.15.110:0/1343771315 >> v1:172.21.15.154:6789/0 conn(0x7f322406ee90 legacy=0x7f32241612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:50.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.687+0000 7f3223fff640 1 -- 172.21.15.110:0/1343771315 >> v1:172.21.15.110:6789/0 conn(0x7f3224156950 legacy=0x7f32240c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:50.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.687+0000 7f3223fff640 1 -- 172.21.15.110:0/1343771315 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32240c4da0 con 0x7f3224150c20 2024-04-22T01:11:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.691+0000 7f3223fff640 1 --2- 172.21.15.110:0/1343771315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3224150c20 0x7f32240c7ac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3214009870 tx=0x7f321401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ceb1b296adcd848 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:50.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.695+0000 7f3222ffd640 1 -- 172.21.15.110:0/1343771315 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32140b5070 con 0x7f3224150c20 2024-04-22T01:11:50.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.695+0000 7f3222ffd640 1 -- 172.21.15.110:0/1343771315 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32140a8a10 con 0x7f3224150c20 2024-04-22T01:11:50.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.695+0000 7f3222ffd640 1 -- 172.21.15.110:0/1343771315 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32140a8de0 con 0x7f3224150c20 2024-04-22T01:11:50.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- 172.21.15.110:0/1343771315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3224150c20 msgr2=0x7f32240c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:50.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 --2- 172.21.15.110:0/1343771315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3224150c20 0x7f32240c7ac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3214009870 tx=0x7f321401ed10 comp rx=0 tx=0).stop 2024-04-22T01:11:50.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- 172.21.15.110:0/1343771315 shutdown_connections 2024-04-22T01:11:50.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 --2- 172.21.15.110:0/1343771315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3224150c20 0x7f32240c7ac0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:50.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- 172.21.15.110:0/1343771315 >> 172.21.15.110:0/1343771315 conn(0x7f32240cb710 msgr2=0x7f32240cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:50.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- 172.21.15.110:0/1343771315 shutdown_connections 2024-04-22T01:11:50.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- 172.21.15.110:0/1343771315 wait complete. 2024-04-22T01:11:50.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 Processor -- start 2024-04-22T01:11:50.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- start start 2024-04-22T01:11:50.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322406ee90 0x7f322414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:50.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3224150c20 0x7f322414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:50.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3224156950 0x7f3224146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:50.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f32240c75a0 con 0x7f322406ee90 2024-04-22T01:11:50.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32240c5360 con 0x7f3224156950 2024-04-22T01:11:50.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f322a390640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3224151000 con 0x7f3224150c20 2024-04-22T01:11:50.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f3223fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322406ee90 0x7f322414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:50.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f3223fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322406ee90 0x7f322414add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51470/0 (socket says 172.21.15.110:51470) 2024-04-22T01:11:50.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.699+0000 7f3223fff640 1 -- 172.21.15.110:0/461192028 learned_addr learned my addr 172.21.15.110:0/461192028 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:50.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.703+0000 7f322892d640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3224156950 0x7f3224146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:50.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.703+0000 7f32237fe640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3224150c20 0x7f322414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:50.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.703+0000 7f3223fff640 1 -- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3224150c20 msgr2=0x7f322414b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:50.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.703+0000 7f3223fff640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3224150c20 0x7f322414b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:50.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.703+0000 7f3223fff640 1 -- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3224156950 msgr2=0x7f3224146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:50.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.703+0000 7f3223fff640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3224156950 0x7f3224146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:50.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.703+0000 7f3223fff640 1 -- 172.21.15.110:0/461192028 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32241590d0 con 0x7f322406ee90 2024-04-22T01:11:50.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.707+0000 7f3223fff640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322406ee90 0x7f322414add0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f321401c940 tx=0x7f321401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:50.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.715+0000 7f3220ff9640 1 -- 172.21.15.110:0/461192028 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32140b5040 con 0x7f322406ee90 2024-04-22T01:11:50.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.715+0000 7f3220ff9640 1 -- 172.21.15.110:0/461192028 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32140be070 con 0x7f322406ee90 2024-04-22T01:11:50.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.715+0000 7f3220ff9640 1 -- 172.21.15.110:0/461192028 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32140b1b60 con 0x7f322406ee90 2024-04-22T01:11:50.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.715+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3224159370 con 0x7f322406ee90 2024-04-22T01:11:50.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.715+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32241f3980 con 0x7f322406ee90 2024-04-22T01:11:50.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.715+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322404f510 con 0x7f322406ee90 2024-04-22T01:11:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.747+0000 7f3220ff9640 1 -- 172.21.15.110:0/461192028 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32140b1d00 con 0x7f322406ee90 2024-04-22T01:11:50.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.751+0000 7f3220ff9640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3210067910 0x7f3210069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:50.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.751+0000 7f32237fe640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3210067910 0x7f3210069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:50.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.751+0000 7f32237fe640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3210067910 0x7f3210069dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32241edb40 tx=0x7f3218009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:50.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:50.755+0000 7f3220ff9640 1 -- 172.21.15.110:0/461192028 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f32140f1f10 con 0x7f322406ee90 2024-04-22T01:11:51.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.019+0000 7f3220ff9640 1 -- 172.21.15.110:0/461192028 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f3214018870 con 0x7f322406ee90 2024-04-22T01:11:51.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.175+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 --> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3224147830 con 0x7f3210067910 2024-04-22T01:11:51.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.187+0000 7f3220ff9640 1 -- 172.21.15.110:0/461192028 <== mgr.4113 v2:172.21.15.110:6800/3950016020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254919 (secure 0 0 0) 0x7f3218009550 con 0x7f3210067910 2024-04-22T01:11:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:11:51.191 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-22T01:11:51.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3210067910 msgr2=0x7f3210069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:51.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3210067910 0x7f3210069dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32241edb40 tx=0x7f3218009060 comp rx=0 tx=0).stop 2024-04-22T01:11:51.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322406ee90 msgr2=0x7f322414add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:51.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322406ee90 0x7f322414add0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f321401c940 tx=0x7f321401bab0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 shutdown_connections 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f3210067910 0x7f3210069dd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3224156950 0x7f3224146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3224150c20 0x7f322414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 --2- 172.21.15.110:0/461192028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322406ee90 0x7f322414add0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 >> 172.21.15.110:0/461192028 conn(0x7f32240cb710 msgr2=0x7f32240718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 shutdown_connections 2024-04-22T01:11:51.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.191+0000 7f322a390640 1 -- 172.21.15.110:0/461192028 wait complete. 2024-04-22T01:11:51.210 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":4188,"stamp":"2024-04-22T01:11:50.531895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213720375,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":7236,"num_read_kb":1459077,"num_write":73026,"num_write_kb":4525199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65761,"ondisk_log_size":65761,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":946224,"kb_used_data":224816,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":754028496,"statfs":{"total":773094113280,"available":772125179904,"internally_reserved":0,"allocated":230211584,"data_stored":428189614,"data_compressed":52390758,"data_compressed_allocated":69984256,"data_compressed_original":269344768,"omap_allocated":12749,"internal_metadata":738643507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004316"},"pg_stats":[{"pgid":"3.3f","version":"25'426","reported_seq":570,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.405088+0000","last_change":"2024-04-22T01:11:13.405145+0000","last_active":"2024-04-22T01:11:13.405088+0000","last_peered":"2024-04-22T01:11:13.405088+0000","last_clean":"2024-04-22T01:11:13.405088+0000","last_became_active":"2024-04-21T22:53:38.612511+0000","last_became_peered":"2024-04-21T22:53:38.612511+0000","last_unstale":"2024-04-22T01:11:13.405088+0000","last_undegraded":"2024-04-22T01:11:13.405088+0000","last_fullsized":"2024-04-22T01:11:13.405088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'426","last_scrub_stamp":"2024-04-22T01:11:13.404914+0000","last_deep_scrub":"25'426","last_deep_scrub_stamp":"2024-04-22T01:11:13.404914+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.404914+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:48.928377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28398,"num_write":395,"num_write_kb":75936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'442","reported_seq":577,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:20.417339+0000","last_change":"2024-04-22T01:11:20.417454+0000","last_active":"2024-04-22T01:11:20.417339+0000","last_peered":"2024-04-22T01:11:20.417339+0000","last_clean":"2024-04-22T01:11:20.417339+0000","last_became_active":"2024-04-21T22:53:38.595407+0000","last_became_peered":"2024-04-21T22:53:38.595407+0000","last_unstale":"2024-04-22T01:11:20.417339+0000","last_undegraded":"2024-04-22T01:11:20.417339+0000","last_fullsized":"2024-04-22T01:11:20.417339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'442","last_scrub_stamp":"2024-04-22T01:11:20.417020+0000","last_deep_scrub":"25'442","last_deep_scrub_stamp":"2024-04-22T01:11:20.417020+0000","last_clean_scrub_stamp":"2024-04-22T01:11:20.417020+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:45:03.807857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20820,"num_write":419,"num_write_kb":84104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'391","reported_seq":515,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.268870+0000","last_change":"2024-04-22T01:11:12.268930+0000","last_active":"2024-04-22T01:11:12.268870+0000","last_peered":"2024-04-22T01:11:12.268870+0000","last_clean":"2024-04-22T01:11:12.268870+0000","last_became_active":"2024-04-21T22:53:38.582260+0000","last_became_peered":"2024-04-21T22:53:38.582260+0000","last_unstale":"2024-04-22T01:11:12.268870+0000","last_undegraded":"2024-04-22T01:11:12.268870+0000","last_fullsized":"2024-04-22T01:11:12.268870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'391","last_scrub_stamp":"2024-04-22T01:11:12.268692+0000","last_deep_scrub":"25'391","last_deep_scrub_stamp":"2024-04-22T01:11:12.268692+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.268692+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:43.525880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18719,"num_write":364,"num_write_kb":70997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'353","reported_seq":458,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:05.773757+0000","last_change":"2024-04-22T01:11:05.773784+0000","last_active":"2024-04-22T01:11:05.773757+0000","last_peered":"2024-04-22T01:11:05.773757+0000","last_clean":"2024-04-22T01:11:05.773757+0000","last_became_active":"2024-04-21T22:53:38.495305+0000","last_became_peered":"2024-04-21T22:53:38.495305+0000","last_unstale":"2024-04-22T01:11:05.773757+0000","last_undegraded":"2024-04-22T01:11:05.773757+0000","last_fullsized":"2024-04-22T01:11:05.773757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'353","last_scrub_stamp":"2024-04-22T01:11:05.773674+0000","last_deep_scrub":"25'353","last_deep_scrub_stamp":"2024-04-22T01:11:05.773674+0000","last_clean_scrub_stamp":"2024-04-22T01:11:05.773674+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:02.656378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":316,"num_write_kb":12972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'420","reported_seq":512,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.418036+0000","last_change":"2024-04-22T01:11:09.418036+0000","last_active":"2024-04-22T01:11:09.418036+0000","last_peered":"2024-04-22T01:11:09.418036+0000","last_clean":"2024-04-22T01:11:09.418036+0000","last_became_active":"2024-04-21T22:53:38.605553+0000","last_became_peered":"2024-04-21T22:53:38.605553+0000","last_unstale":"2024-04-22T01:11:09.418036+0000","last_undegraded":"2024-04-22T01:11:09.418036+0000","last_fullsized":"2024-04-22T01:11:09.418036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'420","last_scrub_stamp":"2024-04-22T01:11:09.417694+0000","last_deep_scrub":"25'420","last_deep_scrub_stamp":"2024-04-22T01:11:09.417694+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.417694+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:26.333227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":394,"num_write_kb":67878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'395","reported_seq":508,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.752756+0000","last_change":"2024-04-22T01:11:06.752756+0000","last_active":"2024-04-22T01:11:06.752756+0000","last_peered":"2024-04-22T01:11:06.752756+0000","last_clean":"2024-04-22T01:11:06.752756+0000","last_became_active":"2024-04-21T22:53:38.499541+0000","last_became_peered":"2024-04-21T22:53:38.499541+0000","last_unstale":"2024-04-22T01:11:06.752756+0000","last_undegraded":"2024-04-22T01:11:06.752756+0000","last_fullsized":"2024-04-22T01:11:06.752756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:06.752495+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:06.752495+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.752495+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:32:45.257256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17967,"num_write":373,"num_write_kb":71499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'402","reported_seq":505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.330450+0000","last_change":"2024-04-22T01:11:18.330569+0000","last_active":"2024-04-22T01:11:18.330450+0000","last_peered":"2024-04-22T01:11:18.330450+0000","last_clean":"2024-04-22T01:11:18.330450+0000","last_became_active":"2024-04-21T22:53:38.617426+0000","last_became_peered":"2024-04-21T22:53:38.617426+0000","last_unstale":"2024-04-22T01:11:18.330450+0000","last_undegraded":"2024-04-22T01:11:18.330450+0000","last_fullsized":"2024-04-22T01:11:18.330450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'402","last_scrub_stamp":"2024-04-22T01:11:18.330225+0000","last_deep_scrub":"25'402","last_deep_scrub_stamp":"2024-04-22T01:11:18.330225+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.330225+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:03:02.232748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13670,"num_write":376,"num_write_kb":39263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'387","reported_seq":543,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:21.438911+0000","last_change":"2024-04-22T01:11:21.438976+0000","last_active":"2024-04-22T01:11:21.438911+0000","last_peered":"2024-04-22T01:11:21.438911+0000","last_clean":"2024-04-22T01:11:21.438911+0000","last_became_active":"2024-04-21T22:53:38.597143+0000","last_became_peered":"2024-04-21T22:53:38.597143+0000","last_unstale":"2024-04-22T01:11:21.438911+0000","last_undegraded":"2024-04-22T01:11:21.438911+0000","last_fullsized":"2024-04-22T01:11:21.438911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'387","last_scrub_stamp":"2024-04-22T01:11:21.438704+0000","last_deep_scrub":"25'387","last_deep_scrub_stamp":"2024-04-22T01:11:21.438704+0000","last_clean_scrub_stamp":"2024-04-22T01:11:21.438704+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:50.045778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":42822,"num_write":351,"num_write_kb":100036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'424","reported_seq":550,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.951443+0000","last_change":"2024-04-22T01:11:04.951506+0000","last_active":"2024-04-22T01:11:04.951443+0000","last_peered":"2024-04-22T01:11:04.951443+0000","last_clean":"2024-04-22T01:11:04.951443+0000","last_became_active":"2024-04-21T22:53:38.575670+0000","last_became_peered":"2024-04-21T22:53:38.575670+0000","last_unstale":"2024-04-22T01:11:04.951443+0000","last_undegraded":"2024-04-22T01:11:04.951443+0000","last_fullsized":"2024-04-22T01:11:04.951443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'424","last_scrub_stamp":"2024-04-22T01:11:04.951252+0000","last_deep_scrub":"25'424","last_deep_scrub_stamp":"2024-04-22T01:11:04.951252+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.951252+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:01.833955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20454,"num_write":396,"num_write_kb":59842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'411","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.369238+0000","last_change":"2024-04-22T01:11:10.369238+0000","last_active":"2024-04-22T01:11:10.369238+0000","last_peered":"2024-04-22T01:11:10.369238+0000","last_clean":"2024-04-22T01:11:10.369238+0000","last_became_active":"2024-04-21T22:53:38.606744+0000","last_became_peered":"2024-04-21T22:53:38.606744+0000","last_unstale":"2024-04-22T01:11:10.369238+0000","last_undegraded":"2024-04-22T01:11:10.369238+0000","last_fullsized":"2024-04-22T01:11:10.369238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'411","last_scrub_stamp":"2024-04-22T01:11:10.368978+0000","last_deep_scrub":"25'411","last_deep_scrub_stamp":"2024-04-22T01:11:10.368978+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.368978+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:40:25.354102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5548,"num_write":382,"num_write_kb":76042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'383","reported_seq":487,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.367891+0000","last_change":"2024-04-22T01:11:15.367891+0000","last_active":"2024-04-22T01:11:15.367891+0000","last_peered":"2024-04-22T01:11:15.367891+0000","last_clean":"2024-04-22T01:11:15.367891+0000","last_became_active":"2024-04-21T22:53:38.612519+0000","last_became_peered":"2024-04-21T22:53:38.612519+0000","last_unstale":"2024-04-22T01:11:15.367891+0000","last_undegraded":"2024-04-22T01:11:15.367891+0000","last_fullsized":"2024-04-22T01:11:15.367891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'383","last_scrub_stamp":"2024-04-22T01:11:15.367636+0000","last_deep_scrub":"25'383","last_deep_scrub_stamp":"2024-04-22T01:11:15.367636+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.367636+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:05:11.251261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12739,"num_write":368,"num_write_kb":54575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'362","reported_seq":476,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.300351+0000","last_change":"2024-04-22T01:11:17.300351+0000","last_active":"2024-04-22T01:11:17.300351+0000","last_peered":"2024-04-22T01:11:17.300351+0000","last_clean":"2024-04-22T01:11:17.300351+0000","last_became_active":"2024-04-21T22:53:38.620008+0000","last_became_peered":"2024-04-21T22:53:38.620008+0000","last_unstale":"2024-04-22T01:11:17.300351+0000","last_undegraded":"2024-04-22T01:11:17.300351+0000","last_fullsized":"2024-04-22T01:11:17.300351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'362","last_scrub_stamp":"2024-04-22T01:11:17.299985+0000","last_deep_scrub":"25'362","last_deep_scrub_stamp":"2024-04-22T01:11:17.299985+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.299985+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:27:42.312255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9062,"num_write":334,"num_write_kb":50352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'384","reported_seq":489,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.069021+0000","last_change":"2024-04-22T01:11:17.069021+0000","last_active":"2024-04-22T01:11:17.069021+0000","last_peered":"2024-04-22T01:11:17.069021+0000","last_clean":"2024-04-22T01:11:17.069021+0000","last_became_active":"2024-04-21T22:53:38.612203+0000","last_became_peered":"2024-04-21T22:53:38.612203+0000","last_unstale":"2024-04-22T01:11:17.069021+0000","last_undegraded":"2024-04-22T01:11:17.069021+0000","last_fullsized":"2024-04-22T01:11:17.069021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'384","last_scrub_stamp":"2024-04-22T01:11:17.068762+0000","last_deep_scrub":"25'384","last_deep_scrub_stamp":"2024-04-22T01:11:17.068762+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.068762+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:55.516037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12819,"num_write":349,"num_write_kb":62920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'430","reported_seq":546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.028076+0000","last_change":"2024-04-22T01:11:13.028139+0000","last_active":"2024-04-22T01:11:13.028076+0000","last_peered":"2024-04-22T01:11:13.028076+0000","last_clean":"2024-04-22T01:11:13.028076+0000","last_became_active":"2024-04-21T22:53:38.597624+0000","last_became_peered":"2024-04-21T22:53:38.597624+0000","last_unstale":"2024-04-22T01:11:13.028076+0000","last_undegraded":"2024-04-22T01:11:13.028076+0000","last_fullsized":"2024-04-22T01:11:13.028076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'430","last_scrub_stamp":"2024-04-22T01:11:13.027884+0000","last_deep_scrub":"25'430","last_deep_scrub_stamp":"2024-04-22T01:11:13.027884+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.027884+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:29:17.952649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21265,"num_write":396,"num_write_kb":88387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'436","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:22.430992+0000","last_change":"2024-04-22T01:11:22.431053+0000","last_active":"2024-04-22T01:11:22.430992+0000","last_peered":"2024-04-22T01:11:22.430992+0000","last_clean":"2024-04-22T01:11:22.430992+0000","last_became_active":"2024-04-21T22:53:38.619985+0000","last_became_peered":"2024-04-21T22:53:38.619985+0000","last_unstale":"2024-04-22T01:11:22.430992+0000","last_undegraded":"2024-04-22T01:11:22.430992+0000","last_fullsized":"2024-04-22T01:11:22.430992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'436","last_scrub_stamp":"2024-04-22T01:11:22.430796+0000","last_deep_scrub":"25'436","last_deep_scrub_stamp":"2024-04-22T01:11:22.430796+0000","last_clean_scrub_stamp":"2024-04-22T01:11:22.430796+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:54:33.338619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21940,"num_write":398,"num_write_kb":112507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'433","reported_seq":567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.040681+0000","last_change":"2024-04-22T01:11:07.040681+0000","last_active":"2024-04-22T01:11:07.040681+0000","last_peered":"2024-04-22T01:11:07.040681+0000","last_clean":"2024-04-22T01:11:07.040681+0000","last_became_active":"2024-04-21T22:53:38.498016+0000","last_became_peered":"2024-04-21T22:53:38.498016+0000","last_unstale":"2024-04-22T01:11:07.040681+0000","last_undegraded":"2024-04-22T01:11:07.040681+0000","last_fullsized":"2024-04-22T01:11:07.040681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'433","last_scrub_stamp":"2024-04-22T01:11:07.040297+0000","last_deep_scrub":"25'433","last_deep_scrub_stamp":"2024-04-22T01:11:07.040297+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.040297+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:02:49.193958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26769,"num_write":400,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'401","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:26.195879+0000","last_change":"2024-04-22T01:11:26.195940+0000","last_active":"2024-04-22T01:11:26.195879+0000","last_peered":"2024-04-22T01:11:26.195879+0000","last_clean":"2024-04-22T01:11:26.195879+0000","last_became_active":"2024-04-21T22:54:44.970288+0000","last_became_peered":"2024-04-21T22:54:44.970288+0000","last_unstale":"2024-04-22T01:11:26.195879+0000","last_undegraded":"2024-04-22T01:11:26.195879+0000","last_fullsized":"2024-04-22T01:11:26.195879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'401","last_scrub_stamp":"2024-04-22T01:11:26.195687+0000","last_deep_scrub":"25'401","last_deep_scrub_stamp":"2024-04-22T01:11:26.195687+0000","last_clean_scrub_stamp":"2024-04-22T01:11:26.195687+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:36:52.528078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17556,"num_write":374,"num_write_kb":67589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'395","reported_seq":519,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.153384+0000","last_change":"2024-04-22T01:11:12.153384+0000","last_active":"2024-04-22T01:11:12.153384+0000","last_peered":"2024-04-22T01:11:12.153384+0000","last_clean":"2024-04-22T01:11:12.153384+0000","last_became_active":"2024-04-21T22:53:38.498993+0000","last_became_peered":"2024-04-21T22:53:38.498993+0000","last_unstale":"2024-04-22T01:11:12.153384+0000","last_undegraded":"2024-04-22T01:11:12.153384+0000","last_fullsized":"2024-04-22T01:11:12.153384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:12.153156+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:12.153156+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.153156+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:57.104303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22256,"num_write":365,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'432","reported_seq":592,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.072981+0000","last_change":"2024-04-22T01:11:06.072981+0000","last_active":"2024-04-22T01:11:06.072981+0000","last_peered":"2024-04-22T01:11:06.072981+0000","last_clean":"2024-04-22T01:11:06.072981+0000","last_became_active":"2024-04-21T22:53:38.466837+0000","last_became_peered":"2024-04-21T22:53:38.466837+0000","last_unstale":"2024-04-22T01:11:06.072981+0000","last_undegraded":"2024-04-22T01:11:06.072981+0000","last_fullsized":"2024-04-22T01:11:06.072981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'432","last_scrub_stamp":"2024-04-22T01:11:06.072840+0000","last_deep_scrub":"25'432","last_deep_scrub_stamp":"2024-04-22T01:11:06.072840+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.072840+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:27:38.604899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39722,"num_write":402,"num_write_kb":89327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'435","reported_seq":531,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:02.290331+0000","last_change":"2024-04-22T01:11:02.290354+0000","last_active":"2024-04-22T01:11:02.290331+0000","last_peered":"2024-04-22T01:11:02.290331+0000","last_clean":"2024-04-22T01:11:02.290331+0000","last_became_active":"2024-04-21T22:53:38.609963+0000","last_became_peered":"2024-04-21T22:53:38.609963+0000","last_unstale":"2024-04-22T01:11:02.290331+0000","last_undegraded":"2024-04-22T01:11:02.290331+0000","last_fullsized":"2024-04-22T01:11:02.290331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'435","last_scrub_stamp":"2024-04-22T01:11:02.290250+0000","last_deep_scrub":"25'435","last_deep_scrub_stamp":"2024-04-22T01:11:02.290250+0000","last_clean_scrub_stamp":"2024-04-22T01:11:02.290250+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:36:09.152675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4220,"num_write":403,"num_write_kb":46421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'421","reported_seq":533,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.689186+0000","last_change":"2024-04-22T01:11:13.689245+0000","last_active":"2024-04-22T01:11:13.689186+0000","last_peered":"2024-04-22T01:11:13.689186+0000","last_clean":"2024-04-22T01:11:13.689186+0000","last_became_active":"2024-04-21T22:53:38.500964+0000","last_became_peered":"2024-04-21T22:53:38.500964+0000","last_unstale":"2024-04-22T01:11:13.689186+0000","last_undegraded":"2024-04-22T01:11:13.689186+0000","last_fullsized":"2024-04-22T01:11:13.689186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'421","last_scrub_stamp":"2024-04-22T01:11:13.689008+0000","last_deep_scrub":"25'421","last_deep_scrub_stamp":"2024-04-22T01:11:13.689008+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.689008+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:27:46.221067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":8093,"num_write":400,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'410","reported_seq":544,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.987618+0000","last_change":"2024-04-22T01:11:07.987684+0000","last_active":"2024-04-22T01:11:07.987618+0000","last_peered":"2024-04-22T01:11:07.987618+0000","last_clean":"2024-04-22T01:11:07.987618+0000","last_became_active":"2024-04-21T22:53:38.603331+0000","last_became_peered":"2024-04-21T22:53:38.603331+0000","last_unstale":"2024-04-22T01:11:07.987618+0000","last_undegraded":"2024-04-22T01:11:07.987618+0000","last_fullsized":"2024-04-22T01:11:07.987618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'410","last_scrub_stamp":"2024-04-22T01:11:07.987433+0000","last_deep_scrub":"25'410","last_deep_scrub_stamp":"2024-04-22T01:11:07.987433+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.987433+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:09:54.764914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28547,"num_write":383,"num_write_kb":51065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'415","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.301744+0000","last_change":"2024-04-22T01:11:11.301811+0000","last_active":"2024-04-22T01:11:11.301744+0000","last_peered":"2024-04-22T01:11:11.301744+0000","last_clean":"2024-04-22T01:11:11.301744+0000","last_became_active":"2024-04-21T22:53:38.582709+0000","last_became_peered":"2024-04-21T22:53:38.582709+0000","last_unstale":"2024-04-22T01:11:11.301744+0000","last_undegraded":"2024-04-22T01:11:11.301744+0000","last_fullsized":"2024-04-22T01:11:11.301744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'415","last_scrub_stamp":"2024-04-22T01:11:11.301560+0000","last_deep_scrub":"25'415","last_deep_scrub_stamp":"2024-04-22T01:11:11.301560+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.301560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:17.618671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":35420,"num_write":386,"num_write_kb":88354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'418","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:23.127194+0000","last_change":"2024-04-22T01:11:23.127317+0000","last_active":"2024-04-22T01:11:23.127194+0000","last_peered":"2024-04-22T01:11:23.127194+0000","last_clean":"2024-04-22T01:11:23.127194+0000","last_became_active":"2024-04-21T22:53:38.586850+0000","last_became_peered":"2024-04-21T22:53:38.586850+0000","last_unstale":"2024-04-22T01:11:23.127194+0000","last_undegraded":"2024-04-22T01:11:23.127194+0000","last_fullsized":"2024-04-22T01:11:23.127194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'418","last_scrub_stamp":"2024-04-22T01:11:23.126969+0000","last_deep_scrub":"25'418","last_deep_scrub_stamp":"2024-04-22T01:11:23.126969+0000","last_clean_scrub_stamp":"2024-04-22T01:11:23.126969+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:54:32.167981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6808,"num_write":388,"num_write_kb":34297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'391","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.405103+0000","last_change":"2024-04-22T01:11:18.405162+0000","last_active":"2024-04-22T01:11:18.405103+0000","last_peered":"2024-04-22T01:11:18.405103+0000","last_clean":"2024-04-22T01:11:18.405103+0000","last_became_active":"2024-04-21T22:53:38.586608+0000","last_became_peered":"2024-04-21T22:53:38.586608+0000","last_unstale":"2024-04-22T01:11:18.405103+0000","last_undegraded":"2024-04-22T01:11:18.405103+0000","last_fullsized":"2024-04-22T01:11:18.405103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'391","last_scrub_stamp":"2024-04-22T01:11:18.404929+0000","last_deep_scrub":"25'391","last_deep_scrub_stamp":"2024-04-22T01:11:18.404929+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.404929+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:40:30.667990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4176,"num_write":374,"num_write_kb":46218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'491","reported_seq":630,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.698982+0000","last_change":"2024-04-22T01:11:08.699046+0000","last_active":"2024-04-22T01:11:08.698982+0000","last_peered":"2024-04-22T01:11:08.698982+0000","last_clean":"2024-04-22T01:11:08.698982+0000","last_became_active":"2024-04-21T22:53:38.505144+0000","last_became_peered":"2024-04-21T22:53:38.505144+0000","last_unstale":"2024-04-22T01:11:08.698982+0000","last_undegraded":"2024-04-22T01:11:08.698982+0000","last_fullsized":"2024-04-22T01:11:08.698982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'491","last_scrub_stamp":"2024-04-22T01:11:08.698752+0000","last_deep_scrub":"25'491","last_deep_scrub_stamp":"2024-04-22T01:11:08.698752+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.698752+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:09:55.476233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29218,"num_write":445,"num_write_kb":101143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'436","reported_seq":585,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.004586+0000","last_change":"2024-04-22T01:11:14.004651+0000","last_active":"2024-04-22T01:11:14.004586+0000","last_peered":"2024-04-22T01:11:14.004586+0000","last_clean":"2024-04-22T01:11:14.004586+0000","last_became_active":"2024-04-21T22:53:38.597744+0000","last_became_peered":"2024-04-21T22:53:38.597744+0000","last_unstale":"2024-04-22T01:11:14.004586+0000","last_undegraded":"2024-04-22T01:11:14.004586+0000","last_fullsized":"2024-04-22T01:11:14.004586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'436","last_scrub_stamp":"2024-04-22T01:11:14.004398+0000","last_deep_scrub":"25'436","last_deep_scrub_stamp":"2024-04-22T01:11:14.004398+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.004398+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:36:20.866823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29285,"num_write":407,"num_write_kb":84259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'386","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.030796+0000","last_change":"2024-04-22T01:11:18.030874+0000","last_active":"2024-04-22T01:11:18.030796+0000","last_peered":"2024-04-22T01:11:18.030796+0000","last_clean":"2024-04-22T01:11:18.030796+0000","last_became_active":"2024-04-21T22:53:38.623181+0000","last_became_peered":"2024-04-21T22:53:38.623181+0000","last_unstale":"2024-04-22T01:11:18.030796+0000","last_undegraded":"2024-04-22T01:11:18.030796+0000","last_fullsized":"2024-04-22T01:11:18.030796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'386","last_scrub_stamp":"2024-04-22T01:11:18.030607+0000","last_deep_scrub":"25'386","last_deep_scrub_stamp":"2024-04-22T01:11:18.030607+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.030607+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:21:05.407073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":28108,"num_write":361,"num_write_kb":80021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'403","reported_seq":556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.341535+0000","last_change":"2024-04-22T01:11:14.341535+0000","last_active":"2024-04-22T01:11:14.341535+0000","last_peered":"2024-04-22T01:11:14.341535+0000","last_clean":"2024-04-22T01:11:14.341535+0000","last_became_active":"2024-04-21T22:53:38.583867+0000","last_became_peered":"2024-04-21T22:53:38.583867+0000","last_unstale":"2024-04-22T01:11:14.341535+0000","last_undegraded":"2024-04-22T01:11:14.341535+0000","last_fullsized":"2024-04-22T01:11:14.341535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'403","last_scrub_stamp":"2024-04-22T01:11:14.341177+0000","last_deep_scrub":"25'403","last_deep_scrub_stamp":"2024-04-22T01:11:14.341177+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.341177+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:12.721060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31845,"num_write":369,"num_write_kb":46987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'465","reported_seq":614,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:22.084008+0000","last_change":"2024-04-22T01:11:22.084067+0000","last_active":"2024-04-22T01:11:22.084008+0000","last_peered":"2024-04-22T01:11:22.084008+0000","last_clean":"2024-04-22T01:11:22.084008+0000","last_became_active":"2024-04-21T22:53:38.583229+0000","last_became_peered":"2024-04-21T22:53:38.583229+0000","last_unstale":"2024-04-22T01:11:22.084008+0000","last_undegraded":"2024-04-22T01:11:22.084008+0000","last_fullsized":"2024-04-22T01:11:22.084008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'465","last_scrub_stamp":"2024-04-22T01:11:22.083813+0000","last_deep_scrub":"25'465","last_deep_scrub_stamp":"2024-04-22T01:11:22.083813+0000","last_clean_scrub_stamp":"2024-04-22T01:11:22.083813+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:30:31.865205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":45092,"num_write":433,"num_write_kb":99910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'465","reported_seq":629,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.148643+0000","last_change":"2024-04-22T01:11:13.148705+0000","last_active":"2024-04-22T01:11:13.148643+0000","last_peered":"2024-04-22T01:11:13.148643+0000","last_clean":"2024-04-22T01:11:13.148643+0000","last_became_active":"2024-04-21T22:53:38.579434+0000","last_became_peered":"2024-04-21T22:53:38.579434+0000","last_unstale":"2024-04-22T01:11:13.148643+0000","last_undegraded":"2024-04-22T01:11:13.148643+0000","last_fullsized":"2024-04-22T01:11:13.148643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'465","last_scrub_stamp":"2024-04-22T01:11:13.148449+0000","last_deep_scrub":"25'465","last_deep_scrub_stamp":"2024-04-22T01:11:13.148449+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.148449+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:15.464252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44084,"num_write":435,"num_write_kb":97059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'430","reported_seq":560,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.729170+0000","last_change":"2024-04-22T01:11:09.729170+0000","last_active":"2024-04-22T01:11:09.729170+0000","last_peered":"2024-04-22T01:11:09.729170+0000","last_clean":"2024-04-22T01:11:09.729170+0000","last_became_active":"2024-04-21T22:53:38.593798+0000","last_became_peered":"2024-04-21T22:53:38.593798+0000","last_unstale":"2024-04-22T01:11:09.729170+0000","last_undegraded":"2024-04-22T01:11:09.729170+0000","last_fullsized":"2024-04-22T01:11:09.729170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'430","last_scrub_stamp":"2024-04-22T01:11:09.728835+0000","last_deep_scrub":"25'430","last_deep_scrub_stamp":"2024-04-22T01:11:09.728835+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.728835+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:30:54.316751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14125,"num_write":397,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'414","reported_seq":556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:05.995535+0000","last_change":"2024-04-22T01:11:05.995535+0000","last_active":"2024-04-22T01:11:05.995535+0000","last_peered":"2024-04-22T01:11:05.995535+0000","last_clean":"2024-04-22T01:11:05.995535+0000","last_became_active":"2024-04-21T22:53:38.582414+0000","last_became_peered":"2024-04-21T22:53:38.582414+0000","last_unstale":"2024-04-22T01:11:05.995535+0000","last_undegraded":"2024-04-22T01:11:05.995535+0000","last_fullsized":"2024-04-22T01:11:05.995535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-04-22T01:11:05.995397+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-04-22T01:11:05.995397+0000","last_clean_scrub_stamp":"2024-04-22T01:11:05.995397+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:32:44.500158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":31266,"num_write":385,"num_write_kb":75657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'364","reported_seq":446,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.251851+0000","last_change":"2024-04-22T01:11:08.251920+0000","last_active":"2024-04-22T01:11:08.251851+0000","last_peered":"2024-04-22T01:11:08.251851+0000","last_clean":"2024-04-22T01:11:08.251851+0000","last_became_active":"2024-04-21T22:53:37.254011+0000","last_became_peered":"2024-04-21T22:53:37.254011+0000","last_unstale":"2024-04-22T01:11:08.251851+0000","last_undegraded":"2024-04-22T01:11:08.251851+0000","last_fullsized":"2024-04-22T01:11:08.251851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'364","last_scrub_stamp":"2024-04-22T01:11:08.251666+0000","last_deep_scrub":"25'364","last_deep_scrub_stamp":"2024-04-22T01:11:08.251666+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.251666+0000","objects_scrubbed":1,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:40:18.228278+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'372","reported_seq":496,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.738341+0000","last_change":"2024-04-22T01:11:17.738497+0000","last_active":"2024-04-22T01:11:17.738341+0000","last_peered":"2024-04-22T01:11:17.738341+0000","last_clean":"2024-04-22T01:11:17.738341+0000","last_became_active":"2024-04-21T22:53:38.601611+0000","last_became_peered":"2024-04-21T22:53:38.601611+0000","last_unstale":"2024-04-22T01:11:17.738341+0000","last_undegraded":"2024-04-22T01:11:17.738341+0000","last_fullsized":"2024-04-22T01:11:17.738341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'372","last_scrub_stamp":"2024-04-22T01:11:17.738091+0000","last_deep_scrub":"25'372","last_deep_scrub_stamp":"2024-04-22T01:11:17.738091+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.738091+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:40:32.723215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19141,"num_write":353,"num_write_kb":42712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'2179","reported_seq":2261,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.134811+0000","last_change":"2024-04-22T01:11:13.134915+0000","last_active":"2024-04-22T01:11:13.134811+0000","last_peered":"2024-04-22T01:11:13.134811+0000","last_clean":"2024-04-22T01:11:13.134811+0000","last_became_active":"2024-04-21T22:53:37.188307+0000","last_became_peered":"2024-04-21T22:53:37.188307+0000","last_unstale":"2024-04-22T01:11:13.134811+0000","last_undegraded":"2024-04-22T01:11:13.134811+0000","last_fullsized":"2024-04-22T01:11:13.134811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2179","last_scrub_stamp":"2024-04-22T01:11:13.134598+0000","last_deep_scrub":"25'2179","last_deep_scrub_stamp":"2024-04-22T01:11:13.134598+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.134598+0000","objects_scrubbed":4,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:48.658061+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2118,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'779","reported_seq":862,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.067306+0000","last_change":"2024-04-22T01:11:09.067443+0000","last_active":"2024-04-22T01:11:09.067306+0000","last_peered":"2024-04-22T01:11:09.067306+0000","last_clean":"2024-04-22T01:11:09.067306+0000","last_became_active":"2024-04-21T22:53:37.187267+0000","last_became_peered":"2024-04-21T22:53:37.187267+0000","last_unstale":"2024-04-22T01:11:09.067306+0000","last_undegraded":"2024-04-22T01:11:09.067306+0000","last_fullsized":"2024-04-22T01:11:09.067306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'779","last_scrub_stamp":"2024-04-22T01:11:09.066998+0000","last_deep_scrub":"25'779","last_deep_scrub_stamp":"2024-04-22T01:11:09.066998+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.066998+0000","objects_scrubbed":1,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:34.749197+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'427","reported_seq":553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:19.385907+0000","last_change":"2024-04-22T01:11:19.385907+0000","last_active":"2024-04-22T01:11:19.385907+0000","last_peered":"2024-04-22T01:11:19.385907+0000","last_clean":"2024-04-22T01:11:19.385907+0000","last_became_active":"2024-04-21T22:53:38.595411+0000","last_became_peered":"2024-04-21T22:53:38.595411+0000","last_unstale":"2024-04-22T01:11:19.385907+0000","last_undegraded":"2024-04-22T01:11:19.385907+0000","last_fullsized":"2024-04-22T01:11:19.385907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'427","last_scrub_stamp":"2024-04-22T01:11:19.385667+0000","last_deep_scrub":"25'427","last_deep_scrub_stamp":"2024-04-22T01:11:19.385667+0000","last_clean_scrub_stamp":"2024-04-22T01:11:19.385667+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:55:18.850859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27111,"num_write":394,"num_write_kb":58934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'1419","reported_seq":1503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.142329+0000","last_change":"2024-04-22T01:11:12.142329+0000","last_active":"2024-04-22T01:11:12.142329+0000","last_peered":"2024-04-22T01:11:12.142329+0000","last_clean":"2024-04-22T01:11:12.142329+0000","last_became_active":"2024-04-21T22:53:37.188077+0000","last_became_peered":"2024-04-21T22:53:37.188077+0000","last_unstale":"2024-04-22T01:11:12.142329+0000","last_undegraded":"2024-04-22T01:11:12.142329+0000","last_fullsized":"2024-04-22T01:11:12.142329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1419","last_scrub_stamp":"2024-04-22T01:11:12.142033+0000","last_deep_scrub":"25'1419","last_deep_scrub_stamp":"2024-04-22T01:11:12.142033+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.142033+0000","objects_scrubbed":3,"log_size":1419,"log_dups_size":0,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:10:21.444321+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":12962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'395","reported_seq":479,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.709698+0000","last_change":"2024-04-22T01:11:15.709757+0000","last_active":"2024-04-22T01:11:15.709698+0000","last_peered":"2024-04-22T01:11:15.709698+0000","last_clean":"2024-04-22T01:11:15.709698+0000","last_became_active":"2024-04-21T22:53:38.579713+0000","last_became_peered":"2024-04-21T22:53:38.579713+0000","last_unstale":"2024-04-22T01:11:15.709698+0000","last_undegraded":"2024-04-22T01:11:15.709698+0000","last_fullsized":"2024-04-22T01:11:15.709698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:15.709518+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:15.709518+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.709518+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:45:22.919661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":217,"num_write":366,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'56","reported_seq":140,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:03.937470+0000","last_change":"2024-04-22T01:11:03.937470+0000","last_active":"2024-04-22T01:11:03.937470+0000","last_peered":"2024-04-22T01:11:03.937470+0000","last_clean":"2024-04-22T01:11:03.937470+0000","last_became_active":"2024-04-21T22:53:37.184691+0000","last_became_peered":"2024-04-21T22:53:37.184691+0000","last_unstale":"2024-04-22T01:11:03.937470+0000","last_undegraded":"2024-04-22T01:11:03.937470+0000","last_fullsized":"2024-04-22T01:11:03.937470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2024-04-22T01:11:03.937228+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2024-04-22T01:11:03.937228+0000","last_clean_scrub_stamp":"2024-04-22T01:11:03.937228+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:13.642617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'451","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.738426+0000","last_change":"2024-04-22T01:11:07.738426+0000","last_active":"2024-04-22T01:11:07.738426+0000","last_peered":"2024-04-22T01:11:07.738426+0000","last_clean":"2024-04-22T01:11:07.738426+0000","last_became_active":"2024-04-21T22:53:38.501576+0000","last_became_peered":"2024-04-21T22:53:38.501576+0000","last_unstale":"2024-04-22T01:11:07.738426+0000","last_undegraded":"2024-04-22T01:11:07.738426+0000","last_fullsized":"2024-04-22T01:11:07.738426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'451","last_scrub_stamp":"2024-04-22T01:11:07.738184+0000","last_deep_scrub":"25'451","last_deep_scrub_stamp":"2024-04-22T01:11:07.738184+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.738184+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:29.346899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27728,"num_write":424,"num_write_kb":88654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'1254","reported_seq":1338,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:05.388985+0000","last_change":"2024-04-22T01:11:05.388985+0000","last_active":"2024-04-22T01:11:05.388985+0000","last_peered":"2024-04-22T01:11:05.388985+0000","last_clean":"2024-04-22T01:11:05.388985+0000","last_became_active":"2024-04-21T22:53:37.189793+0000","last_became_peered":"2024-04-21T22:53:37.189793+0000","last_unstale":"2024-04-22T01:11:05.388985+0000","last_undegraded":"2024-04-22T01:11:05.388985+0000","last_fullsized":"2024-04-22T01:11:05.388985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1254","last_scrub_stamp":"2024-04-22T01:11:05.388865+0000","last_deep_scrub":"25'1254","last_deep_scrub_stamp":"2024-04-22T01:11:05.388865+0000","last_clean_scrub_stamp":"2024-04-22T01:11:05.388865+0000","objects_scrubbed":3,"log_size":1254,"log_dups_size":0,"ondisk_log_size":1254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:26:37.571954+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10339768,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":10694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'398","reported_seq":509,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:13.297083+0000","last_change":"2024-04-22T01:11:13.297083+0000","last_active":"2024-04-22T01:11:13.297083+0000","last_peered":"2024-04-22T01:11:13.297083+0000","last_clean":"2024-04-22T01:11:13.297083+0000","last_became_active":"2024-04-21T22:53:38.583443+0000","last_became_peered":"2024-04-21T22:53:38.583443+0000","last_unstale":"2024-04-22T01:11:13.297083+0000","last_undegraded":"2024-04-22T01:11:13.297083+0000","last_fullsized":"2024-04-22T01:11:13.297083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'398","last_scrub_stamp":"2024-04-22T01:11:13.296807+0000","last_deep_scrub":"25'398","last_deep_scrub_stamp":"2024-04-22T01:11:13.296807+0000","last_clean_scrub_stamp":"2024-04-22T01:11:13.296807+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:41:46.732273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":27611,"num_write":368,"num_write_kb":80241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'3974","reported_seq":4058,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.269486+0000","last_change":"2024-04-22T01:11:09.269486+0000","last_active":"2024-04-22T01:11:09.269486+0000","last_peered":"2024-04-22T01:11:09.269486+0000","last_clean":"2024-04-22T01:11:09.269486+0000","last_became_active":"2024-04-21T22:53:37.139438+0000","last_became_peered":"2024-04-21T22:53:37.139438+0000","last_unstale":"2024-04-22T01:11:09.269486+0000","last_undegraded":"2024-04-22T01:11:09.269486+0000","last_fullsized":"2024-04-22T01:11:09.269486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3974","last_scrub_stamp":"2024-04-22T01:11:09.269259+0000","last_deep_scrub":"25'3974","last_deep_scrub_stamp":"2024-04-22T01:11:09.269259+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.269259+0000","objects_scrubbed":4,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:51:34.209336+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'395","reported_seq":520,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:19.046299+0000","last_change":"2024-04-22T01:11:19.046417+0000","last_active":"2024-04-22T01:11:19.046299+0000","last_peered":"2024-04-22T01:11:19.046299+0000","last_clean":"2024-04-22T01:11:19.046299+0000","last_became_active":"2024-04-21T22:53:38.501772+0000","last_became_peered":"2024-04-21T22:53:38.501772+0000","last_unstale":"2024-04-22T01:11:19.046299+0000","last_undegraded":"2024-04-22T01:11:19.046299+0000","last_fullsized":"2024-04-22T01:11:19.046299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-22T01:11:19.046034+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-22T01:11:19.046034+0000","last_clean_scrub_stamp":"2024-04-22T01:11:19.046034+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:22:41.395811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17003,"num_write":357,"num_write_kb":47379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2300","reported_seq":2385,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.801153+0000","last_change":"2024-04-22T01:11:04.801240+0000","last_active":"2024-04-22T01:11:04.801153+0000","last_peered":"2024-04-22T01:11:04.801153+0000","last_clean":"2024-04-22T01:11:04.801153+0000","last_became_active":"2024-04-21T22:53:37.133556+0000","last_became_peered":"2024-04-21T22:53:37.133556+0000","last_unstale":"2024-04-22T01:11:04.801153+0000","last_undegraded":"2024-04-22T01:11:04.801153+0000","last_fullsized":"2024-04-22T01:11:04.801153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2300","last_scrub_stamp":"2024-04-22T01:11:04.800934+0000","last_deep_scrub":"25'2300","last_deep_scrub_stamp":"2024-04-22T01:11:04.800934+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.800934+0000","objects_scrubbed":6,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:14.506323+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2254,"num_write_kb":13663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'414","reported_seq":549,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.428625+0000","last_change":"2024-04-22T01:11:12.428625+0000","last_active":"2024-04-22T01:11:12.428625+0000","last_peered":"2024-04-22T01:11:12.428625+0000","last_clean":"2024-04-22T01:11:12.428625+0000","last_became_active":"2024-04-21T22:53:38.611947+0000","last_became_peered":"2024-04-21T22:53:38.611947+0000","last_unstale":"2024-04-22T01:11:12.428625+0000","last_undegraded":"2024-04-22T01:11:12.428625+0000","last_fullsized":"2024-04-22T01:11:12.428625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-04-22T01:11:12.428293+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-04-22T01:11:12.428293+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.428293+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:10:21.730582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26385,"num_write":381,"num_write_kb":92626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'724","reported_seq":810,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.243140+0000","last_change":"2024-04-22T01:11:10.243140+0000","last_active":"2024-04-22T01:11:10.243140+0000","last_peered":"2024-04-22T01:11:10.243140+0000","last_clean":"2024-04-22T01:11:10.243140+0000","last_became_active":"2024-04-21T22:53:37.190659+0000","last_became_peered":"2024-04-21T22:53:37.190659+0000","last_unstale":"2024-04-22T01:11:10.243140+0000","last_undegraded":"2024-04-22T01:11:10.243140+0000","last_fullsized":"2024-04-22T01:11:10.243140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'724","last_scrub_stamp":"2024-04-22T01:11:10.242897+0000","last_deep_scrub":"25'724","last_deep_scrub_stamp":"2024-04-22T01:11:10.242897+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.242897+0000","objects_scrubbed":4,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:52:49.905341+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'386","reported_seq":486,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.057402+0000","last_change":"2024-04-22T01:11:12.057402+0000","last_active":"2024-04-22T01:11:12.057402+0000","last_peered":"2024-04-22T01:11:12.057402+0000","last_clean":"2024-04-22T01:11:12.057402+0000","last_became_active":"2024-04-21T22:53:38.592564+0000","last_became_peered":"2024-04-21T22:53:38.592564+0000","last_unstale":"2024-04-22T01:11:12.057402+0000","last_undegraded":"2024-04-22T01:11:12.057402+0000","last_fullsized":"2024-04-22T01:11:12.057402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'386","last_scrub_stamp":"2024-04-22T01:11:12.056969+0000","last_deep_scrub":"25'386","last_deep_scrub_stamp":"2024-04-22T01:11:12.056969+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.056969+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:43:24.148288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5166,"num_write":360,"num_write_kb":42321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'60","reported_seq":146,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.069730+0000","last_change":"2024-04-22T01:11:15.069730+0000","last_active":"2024-04-22T01:11:15.069730+0000","last_peered":"2024-04-22T01:11:15.069730+0000","last_clean":"2024-04-22T01:11:15.069730+0000","last_became_active":"2024-04-21T22:53:37.190012+0000","last_became_peered":"2024-04-21T22:53:37.190012+0000","last_unstale":"2024-04-22T01:11:15.069730+0000","last_undegraded":"2024-04-22T01:11:15.069730+0000","last_fullsized":"2024-04-22T01:11:15.069730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'60","last_scrub_stamp":"2024-04-22T01:11:15.069482+0000","last_deep_scrub":"25'60","last_deep_scrub_stamp":"2024-04-22T01:11:15.069482+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.069482+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:19:11.151792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'397","reported_seq":534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:25.162512+0000","last_change":"2024-04-22T01:11:25.162578+0000","last_active":"2024-04-22T01:11:25.162512+0000","last_peered":"2024-04-22T01:11:25.162512+0000","last_clean":"2024-04-22T01:11:25.162512+0000","last_became_active":"2024-04-21T22:53:38.613613+0000","last_became_peered":"2024-04-21T22:53:38.613613+0000","last_unstale":"2024-04-22T01:11:25.162512+0000","last_undegraded":"2024-04-22T01:11:25.162512+0000","last_fullsized":"2024-04-22T01:11:25.162512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'397","last_scrub_stamp":"2024-04-22T01:11:25.162279+0000","last_deep_scrub":"25'397","last_deep_scrub_stamp":"2024-04-22T01:11:25.162279+0000","last_clean_scrub_stamp":"2024-04-22T01:11:25.162279+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:16:30.596119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27517,"num_write":361,"num_write_kb":56016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'51","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.407715+0000","last_change":"2024-04-22T01:11:07.407715+0000","last_active":"2024-04-22T01:11:07.407715+0000","last_peered":"2024-04-22T01:11:07.407715+0000","last_clean":"2024-04-22T01:11:07.407715+0000","last_became_active":"2024-04-21T22:53:37.194090+0000","last_became_peered":"2024-04-21T22:53:37.194090+0000","last_unstale":"2024-04-22T01:11:07.407715+0000","last_undegraded":"2024-04-22T01:11:07.407715+0000","last_fullsized":"2024-04-22T01:11:07.407715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'51","last_scrub_stamp":"2024-04-22T01:11:07.407540+0000","last_deep_scrub":"25'51","last_deep_scrub_stamp":"2024-04-22T01:11:07.407540+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.407540+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:16:55.884501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'460","reported_seq":591,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.034887+0000","last_change":"2024-04-22T01:11:07.034887+0000","last_active":"2024-04-22T01:11:07.034887+0000","last_peered":"2024-04-22T01:11:07.034887+0000","last_clean":"2024-04-22T01:11:07.034887+0000","last_became_active":"2024-04-21T22:53:38.584515+0000","last_became_peered":"2024-04-21T22:53:38.584515+0000","last_unstale":"2024-04-22T01:11:07.034887+0000","last_undegraded":"2024-04-22T01:11:07.034887+0000","last_fullsized":"2024-04-22T01:11:07.034887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'460","last_scrub_stamp":"2024-04-22T01:11:07.034663+0000","last_deep_scrub":"25'460","last_deep_scrub_stamp":"2024-04-22T01:11:07.034663+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.034663+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:28.643378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":20178,"num_write":438,"num_write_kb":96694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'925","reported_seq":1011,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.698167+0000","last_change":"2024-04-22T01:11:06.698167+0000","last_active":"2024-04-22T01:11:06.698167+0000","last_peered":"2024-04-22T01:11:06.698167+0000","last_clean":"2024-04-22T01:11:06.698167+0000","last_became_active":"2024-04-21T22:53:37.138583+0000","last_became_peered":"2024-04-21T22:53:37.138583+0000","last_unstale":"2024-04-22T01:11:06.698167+0000","last_undegraded":"2024-04-22T01:11:06.698167+0000","last_fullsized":"2024-04-22T01:11:06.698167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'925","last_scrub_stamp":"2024-04-22T01:11:06.697953+0000","last_deep_scrub":"25'925","last_deep_scrub_stamp":"2024-04-22T01:11:06.697953+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.697953+0000","objects_scrubbed":6,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:28.306667+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'481","reported_seq":622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.059406+0000","last_change":"2024-04-22T01:11:09.059406+0000","last_active":"2024-04-22T01:11:09.059406+0000","last_peered":"2024-04-22T01:11:09.059406+0000","last_clean":"2024-04-22T01:11:09.059406+0000","last_became_active":"2024-04-21T22:53:38.500304+0000","last_became_peered":"2024-04-21T22:53:38.500304+0000","last_unstale":"2024-04-22T01:11:09.059406+0000","last_undegraded":"2024-04-22T01:11:09.059406+0000","last_fullsized":"2024-04-22T01:11:09.059406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'481","last_scrub_stamp":"2024-04-22T01:11:09.059152+0000","last_deep_scrub":"25'481","last_deep_scrub_stamp":"2024-04-22T01:11:09.059152+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.059152+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:27.161572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33204,"num_write":448,"num_write_kb":124685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'820","reported_seq":908,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.457427+0000","last_change":"2024-04-22T01:11:08.457427+0000","last_active":"2024-04-22T01:11:08.457427+0000","last_peered":"2024-04-22T01:11:08.457427+0000","last_clean":"2024-04-22T01:11:08.457427+0000","last_became_active":"2024-04-21T22:53:37.252297+0000","last_became_peered":"2024-04-21T22:53:37.252297+0000","last_unstale":"2024-04-22T01:11:08.457427+0000","last_undegraded":"2024-04-22T01:11:08.457427+0000","last_fullsized":"2024-04-22T01:11:08.457427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'820","last_scrub_stamp":"2024-04-22T01:11:08.457308+0000","last_deep_scrub":"25'820","last_deep_scrub_stamp":"2024-04-22T01:11:08.457308+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.457308+0000","objects_scrubbed":2,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:36:03.806049+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'350","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.709394+0000","last_change":"2024-04-22T01:11:11.709457+0000","last_active":"2024-04-22T01:11:11.709394+0000","last_peered":"2024-04-22T01:11:11.709394+0000","last_clean":"2024-04-22T01:11:11.709394+0000","last_became_active":"2024-04-21T22:53:38.609055+0000","last_became_peered":"2024-04-21T22:53:38.609055+0000","last_unstale":"2024-04-22T01:11:11.709394+0000","last_undegraded":"2024-04-22T01:11:11.709394+0000","last_fullsized":"2024-04-22T01:11:11.709394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'350","last_scrub_stamp":"2024-04-22T01:11:11.709219+0000","last_deep_scrub":"25'350","last_deep_scrub_stamp":"2024-04-22T01:11:11.709219+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.709219+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:36:18.571644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12827,"num_write":324,"num_write_kb":21916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'822","reported_seq":910,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.759431+0000","last_change":"2024-04-22T01:11:10.759501+0000","last_active":"2024-04-22T01:11:10.759431+0000","last_peered":"2024-04-22T01:11:10.759431+0000","last_clean":"2024-04-22T01:11:10.759431+0000","last_became_active":"2024-04-21T22:53:37.251938+0000","last_became_peered":"2024-04-21T22:53:37.251938+0000","last_unstale":"2024-04-22T01:11:10.759431+0000","last_undegraded":"2024-04-22T01:11:10.759431+0000","last_fullsized":"2024-04-22T01:11:10.759431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'822","last_scrub_stamp":"2024-04-22T01:11:10.759257+0000","last_deep_scrub":"25'822","last_deep_scrub_stamp":"2024-04-22T01:11:10.759257+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.759257+0000","objects_scrubbed":2,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:37:01.617948+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'428","reported_seq":591,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.365182+0000","last_change":"2024-04-22T01:11:14.365182+0000","last_active":"2024-04-22T01:11:14.365182+0000","last_peered":"2024-04-22T01:11:14.365182+0000","last_clean":"2024-04-22T01:11:14.365182+0000","last_became_active":"2024-04-21T22:53:38.615369+0000","last_became_peered":"2024-04-21T22:53:38.615369+0000","last_unstale":"2024-04-22T01:11:14.365182+0000","last_undegraded":"2024-04-22T01:11:14.365182+0000","last_fullsized":"2024-04-22T01:11:14.365182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'428","last_scrub_stamp":"2024-04-22T01:11:14.364947+0000","last_deep_scrub":"25'428","last_deep_scrub_stamp":"2024-04-22T01:11:14.364947+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.364947+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:51:19.851435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36323,"num_write":394,"num_write_kb":104531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'354","reported_seq":442,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.232856+0000","last_change":"2024-04-22T01:11:07.232987+0000","last_active":"2024-04-22T01:11:07.232856+0000","last_peered":"2024-04-22T01:11:07.232856+0000","last_clean":"2024-04-22T01:11:07.232856+0000","last_became_active":"2024-04-21T22:53:37.252422+0000","last_became_peered":"2024-04-21T22:53:37.252422+0000","last_unstale":"2024-04-22T01:11:07.232856+0000","last_undegraded":"2024-04-22T01:11:07.232856+0000","last_fullsized":"2024-04-22T01:11:07.232856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'354","last_scrub_stamp":"2024-04-22T01:11:07.232565+0000","last_deep_scrub":"25'354","last_deep_scrub_stamp":"2024-04-22T01:11:07.232565+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.232565+0000","objects_scrubbed":2,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:14:48.094691+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'429","reported_seq":556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.411324+0000","last_change":"2024-04-22T01:11:11.411386+0000","last_active":"2024-04-22T01:11:11.411324+0000","last_peered":"2024-04-22T01:11:11.411324+0000","last_clean":"2024-04-22T01:11:11.411324+0000","last_became_active":"2024-04-21T22:53:38.610083+0000","last_became_peered":"2024-04-21T22:53:38.610083+0000","last_unstale":"2024-04-22T01:11:11.411324+0000","last_undegraded":"2024-04-22T01:11:11.411324+0000","last_fullsized":"2024-04-22T01:11:11.411324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2024-04-22T01:11:11.411148+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2024-04-22T01:11:11.411148+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.411148+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:27:52.078450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22478,"num_write":396,"num_write_kb":50602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'341","reported_seq":429,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.067744+0000","last_change":"2024-04-22T01:11:10.067812+0000","last_active":"2024-04-22T01:11:10.067744+0000","last_peered":"2024-04-22T01:11:10.067744+0000","last_clean":"2024-04-22T01:11:10.067744+0000","last_became_active":"2024-04-21T22:53:37.187437+0000","last_became_peered":"2024-04-21T22:53:37.187437+0000","last_unstale":"2024-04-22T01:11:10.067744+0000","last_undegraded":"2024-04-22T01:11:10.067744+0000","last_fullsized":"2024-04-22T01:11:10.067744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'341","last_scrub_stamp":"2024-04-22T01:11:10.067566+0000","last_deep_scrub":"25'341","last_deep_scrub_stamp":"2024-04-22T01:11:10.067566+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.067566+0000","objects_scrubbed":1,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:33:31.676280+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'412","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:20.029755+0000","last_change":"2024-04-22T01:11:20.029873+0000","last_active":"2024-04-22T01:11:20.029755+0000","last_peered":"2024-04-22T01:11:20.029755+0000","last_clean":"2024-04-22T01:11:20.029755+0000","last_became_active":"2024-04-21T22:53:38.575487+0000","last_became_peered":"2024-04-21T22:53:38.575487+0000","last_unstale":"2024-04-22T01:11:20.029755+0000","last_undegraded":"2024-04-22T01:11:20.029755+0000","last_fullsized":"2024-04-22T01:11:20.029755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2024-04-22T01:11:20.029504+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2024-04-22T01:11:20.029504+0000","last_clean_scrub_stamp":"2024-04-22T01:11:20.029504+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:05:24.662971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12764,"num_write":388,"num_write_kb":59120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'163","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:02.926813+0000","last_change":"2024-04-22T01:11:02.926813+0000","last_active":"2024-04-22T01:11:02.926813+0000","last_peered":"2024-04-22T01:11:02.926813+0000","last_clean":"2024-04-22T01:11:02.926813+0000","last_became_active":"2024-04-21T22:52:58.452054+0000","last_became_peered":"2024-04-21T22:52:58.452054+0000","last_unstale":"2024-04-22T01:11:02.926813+0000","last_undegraded":"2024-04-22T01:11:02.926813+0000","last_fullsized":"2024-04-22T01:11:02.926813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'163","last_scrub_stamp":"2024-04-22T01:11:02.926654+0000","last_deep_scrub":"25'163","last_deep_scrub_stamp":"2024-04-22T01:11:02.926654+0000","last_clean_scrub_stamp":"2024-04-22T01:11:02.926654+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:44:16.121734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'374","reported_seq":467,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.050857+0000","last_change":"2024-04-22T01:11:17.050947+0000","last_active":"2024-04-22T01:11:17.050857+0000","last_peered":"2024-04-22T01:11:17.050857+0000","last_clean":"2024-04-22T01:11:17.050857+0000","last_became_active":"2024-04-21T22:53:37.191340+0000","last_became_peered":"2024-04-21T22:53:37.191340+0000","last_unstale":"2024-04-22T01:11:17.050857+0000","last_undegraded":"2024-04-22T01:11:17.050857+0000","last_fullsized":"2024-04-22T01:11:17.050857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'374","last_scrub_stamp":"2024-04-22T01:11:17.050649+0000","last_deep_scrub":"25'374","last_deep_scrub_stamp":"2024-04-22T01:11:17.050649+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.050649+0000","objects_scrubbed":1,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:40:02.124581+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'363","reported_seq":498,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.679937+0000","last_change":"2024-04-22T01:11:14.680058+0000","last_active":"2024-04-22T01:11:14.679937+0000","last_peered":"2024-04-22T01:11:14.679937+0000","last_clean":"2024-04-22T01:11:14.679937+0000","last_became_active":"2024-04-21T22:53:38.501061+0000","last_became_peered":"2024-04-21T22:53:38.501061+0000","last_unstale":"2024-04-22T01:11:14.679937+0000","last_undegraded":"2024-04-22T01:11:14.679937+0000","last_fullsized":"2024-04-22T01:11:14.679937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'363","last_scrub_stamp":"2024-04-22T01:11:14.679711+0000","last_deep_scrub":"25'363","last_deep_scrub_stamp":"2024-04-22T01:11:14.679711+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.679711+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:02:56.833372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26229,"num_write":331,"num_write_kb":46345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'1078","reported_seq":1173,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.135412+0000","last_change":"2024-04-22T01:11:10.135489+0000","last_active":"2024-04-22T01:11:10.135412+0000","last_peered":"2024-04-22T01:11:10.135412+0000","last_clean":"2024-04-22T01:11:10.135412+0000","last_became_active":"2024-04-21T22:53:37.251532+0000","last_became_peered":"2024-04-21T22:53:37.251532+0000","last_unstale":"2024-04-22T01:11:10.135412+0000","last_undegraded":"2024-04-22T01:11:10.135412+0000","last_fullsized":"2024-04-22T01:11:10.135412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1078","last_scrub_stamp":"2024-04-22T01:11:10.135236+0000","last_deep_scrub":"25'1078","last_deep_scrub_stamp":"2024-04-22T01:11:10.135236+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.135236+0000","objects_scrubbed":3,"log_size":1078,"log_dups_size":0,"ondisk_log_size":1078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:40:25.120360+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'414","reported_seq":616,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.063540+0000","last_change":"2024-04-22T01:11:16.063565+0000","last_active":"2024-04-22T01:11:16.063540+0000","last_peered":"2024-04-22T01:11:16.063540+0000","last_clean":"2024-04-22T01:11:16.063540+0000","last_became_active":"2024-04-21T22:53:38.600862+0000","last_became_peered":"2024-04-21T22:53:38.600862+0000","last_unstale":"2024-04-22T01:11:16.063540+0000","last_undegraded":"2024-04-22T01:11:16.063540+0000","last_fullsized":"2024-04-22T01:11:16.063540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'414","last_scrub_stamp":"2024-04-22T01:11:16.063453+0000","last_deep_scrub":"25'414","last_deep_scrub_stamp":"2024-04-22T01:11:16.063453+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.063453+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:37:21.721155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":57177,"num_write":383,"num_write_kb":104760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'4405","reported_seq":8847,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.176677+0000","last_change":"2024-04-22T01:11:11.176740+0000","last_active":"2024-04-22T01:11:11.176677+0000","last_peered":"2024-04-22T01:11:11.176677+0000","last_clean":"2024-04-22T01:11:11.176677+0000","last_became_active":"2024-04-21T22:53:37.253238+0000","last_became_peered":"2024-04-21T22:53:37.253238+0000","last_unstale":"2024-04-22T01:11:11.176677+0000","last_undegraded":"2024-04-22T01:11:11.176677+0000","last_fullsized":"2024-04-22T01:11:11.176677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4405","last_scrub_stamp":"2024-04-22T01:11:11.176487+0000","last_deep_scrub":"25'4405","last_deep_scrub_stamp":"2024-04-22T01:11:11.176487+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.176487+0000","objects_scrubbed":1,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:38:50.145656+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462177,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":4349,"num_write_kb":4731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'408","reported_seq":537,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.317854+0000","last_change":"2024-04-22T01:11:15.317919+0000","last_active":"2024-04-22T01:11:15.317854+0000","last_peered":"2024-04-22T01:11:15.317854+0000","last_clean":"2024-04-22T01:11:15.317854+0000","last_became_active":"2024-04-21T22:53:38.584586+0000","last_became_peered":"2024-04-21T22:53:38.584586+0000","last_unstale":"2024-04-22T01:11:15.317854+0000","last_undegraded":"2024-04-22T01:11:15.317854+0000","last_fullsized":"2024-04-22T01:11:15.317854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'408","last_scrub_stamp":"2024-04-22T01:11:15.317668+0000","last_deep_scrub":"25'408","last_deep_scrub_stamp":"2024-04-22T01:11:15.317668+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.317668+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:30:58.648678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21533,"num_write":374,"num_write_kb":54814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1082","reported_seq":1175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.077188+0000","last_change":"2024-04-22T01:11:16.077256+0000","last_active":"2024-04-22T01:11:16.077188+0000","last_peered":"2024-04-22T01:11:16.077188+0000","last_clean":"2024-04-22T01:11:16.077188+0000","last_became_active":"2024-04-21T22:53:37.191372+0000","last_became_peered":"2024-04-21T22:53:37.191372+0000","last_unstale":"2024-04-22T01:11:16.077188+0000","last_undegraded":"2024-04-22T01:11:16.077188+0000","last_fullsized":"2024-04-22T01:11:16.077188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1082","last_scrub_stamp":"2024-04-22T01:11:16.077019+0000","last_deep_scrub":"25'1082","last_deep_scrub_stamp":"2024-04-22T01:11:16.077019+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.077019+0000","objects_scrubbed":2,"log_size":1082,"log_dups_size":0,"ondisk_log_size":1082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:35:17.346943+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":8663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'379","reported_seq":492,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.330712+0000","last_change":"2024-04-22T01:11:16.330773+0000","last_active":"2024-04-22T01:11:16.330712+0000","last_peered":"2024-04-22T01:11:16.330712+0000","last_clean":"2024-04-22T01:11:16.330712+0000","last_became_active":"2024-04-21T22:53:38.620418+0000","last_became_peered":"2024-04-21T22:53:38.620418+0000","last_unstale":"2024-04-22T01:11:16.330712+0000","last_undegraded":"2024-04-22T01:11:16.330712+0000","last_fullsized":"2024-04-22T01:11:16.330712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'379","last_scrub_stamp":"2024-04-22T01:11:16.330533+0000","last_deep_scrub":"25'379","last_deep_scrub_stamp":"2024-04-22T01:11:16.330533+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.330533+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:19:12.412843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7866,"num_write":347,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"25'362","reported_seq":455,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.238651+0000","last_change":"2024-04-22T01:11:09.238713+0000","last_active":"2024-04-22T01:11:09.238651+0000","last_peered":"2024-04-22T01:11:09.238651+0000","last_clean":"2024-04-22T01:11:09.238651+0000","last_became_active":"2024-04-21T22:53:37.254174+0000","last_became_peered":"2024-04-21T22:53:37.254174+0000","last_unstale":"2024-04-22T01:11:09.238651+0000","last_undegraded":"2024-04-22T01:11:09.238651+0000","last_fullsized":"2024-04-22T01:11:09.238651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'362","last_scrub_stamp":"2024-04-22T01:11:09.238448+0000","last_deep_scrub":"25'362","last_deep_scrub_stamp":"2024-04-22T01:11:09.238448+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.238448+0000","objects_scrubbed":1,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:57:39.622699+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'447","reported_seq":589,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.755044+0000","last_change":"2024-04-22T01:11:10.755104+0000","last_active":"2024-04-22T01:11:10.755044+0000","last_peered":"2024-04-22T01:11:10.755044+0000","last_clean":"2024-04-22T01:11:10.755044+0000","last_became_active":"2024-04-21T22:53:38.594940+0000","last_became_peered":"2024-04-21T22:53:38.594940+0000","last_unstale":"2024-04-22T01:11:10.755044+0000","last_undegraded":"2024-04-22T01:11:10.755044+0000","last_fullsized":"2024-04-22T01:11:10.755044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'447","last_scrub_stamp":"2024-04-22T01:11:10.754833+0000","last_deep_scrub":"25'447","last_deep_scrub_stamp":"2024-04-22T01:11:10.754833+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.754833+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:29:15.679599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21571,"num_write":411,"num_write_kb":92495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'997","reported_seq":1089,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.163553+0000","last_change":"2024-04-22T01:11:11.163709+0000","last_active":"2024-04-22T01:11:11.163553+0000","last_peered":"2024-04-22T01:11:11.163553+0000","last_clean":"2024-04-22T01:11:11.163553+0000","last_became_active":"2024-04-21T22:53:37.187737+0000","last_became_peered":"2024-04-21T22:53:37.187737+0000","last_unstale":"2024-04-22T01:11:11.163553+0000","last_undegraded":"2024-04-22T01:11:11.163553+0000","last_fullsized":"2024-04-22T01:11:11.163553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'997","last_scrub_stamp":"2024-04-22T01:11:11.163325+0000","last_deep_scrub":"25'997","last_deep_scrub_stamp":"2024-04-22T01:11:11.163325+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.163325+0000","objects_scrubbed":2,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:47:58.856899+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'396","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:15.049974+0000","last_change":"2024-04-22T01:11:15.050032+0000","last_active":"2024-04-22T01:11:15.049974+0000","last_peered":"2024-04-22T01:11:15.049974+0000","last_clean":"2024-04-22T01:11:15.049974+0000","last_became_active":"2024-04-21T22:53:38.599327+0000","last_became_peered":"2024-04-21T22:53:38.599327+0000","last_unstale":"2024-04-22T01:11:15.049974+0000","last_undegraded":"2024-04-22T01:11:15.049974+0000","last_fullsized":"2024-04-22T01:11:15.049974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'396","last_scrub_stamp":"2024-04-22T01:11:15.049789+0000","last_deep_scrub":"25'396","last_deep_scrub_stamp":"2024-04-22T01:11:15.049789+0000","last_clean_scrub_stamp":"2024-04-22T01:11:15.049789+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:19:43.979748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32877,"num_write":358,"num_write_kb":75502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'6444","reported_seq":6534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.693207+0000","last_change":"2024-04-22T01:11:08.693269+0000","last_active":"2024-04-22T01:11:08.693207+0000","last_peered":"2024-04-22T01:11:08.693207+0000","last_clean":"2024-04-22T01:11:08.693207+0000","last_became_active":"2024-04-21T22:53:37.186813+0000","last_became_peered":"2024-04-21T22:53:37.186813+0000","last_unstale":"2024-04-22T01:11:08.693207+0000","last_undegraded":"2024-04-22T01:11:08.693207+0000","last_fullsized":"2024-04-22T01:11:08.693207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6444","last_scrub_stamp":"2024-04-22T01:11:08.693005+0000","last_deep_scrub":"25'6444","last_deep_scrub_stamp":"2024-04-22T01:11:08.693005+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.693005+0000","objects_scrubbed":1,"log_size":6444,"log_dups_size":0,"ondisk_log_size":6444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:47:55.001921+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17429,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'369","reported_seq":522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.728330+0000","last_change":"2024-04-22T01:11:16.728457+0000","last_active":"2024-04-22T01:11:16.728330+0000","last_peered":"2024-04-22T01:11:16.728330+0000","last_clean":"2024-04-22T01:11:16.728330+0000","last_became_active":"2024-04-21T22:53:38.595952+0000","last_became_peered":"2024-04-21T22:53:38.595952+0000","last_unstale":"2024-04-22T01:11:16.728330+0000","last_undegraded":"2024-04-22T01:11:16.728330+0000","last_fullsized":"2024-04-22T01:11:16.728330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'369","last_scrub_stamp":"2024-04-22T01:11:16.728008+0000","last_deep_scrub":"25'369","last_deep_scrub_stamp":"2024-04-22T01:11:16.728008+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.728008+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:33.643540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39028,"num_write":349,"num_write_kb":80130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'455","reported_seq":545,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.072053+0000","last_change":"2024-04-22T01:11:14.072125+0000","last_active":"2024-04-22T01:11:14.072053+0000","last_peered":"2024-04-22T01:11:14.072053+0000","last_clean":"2024-04-22T01:11:14.072053+0000","last_became_active":"2024-04-21T22:53:37.189263+0000","last_became_peered":"2024-04-21T22:53:37.189263+0000","last_unstale":"2024-04-22T01:11:14.072053+0000","last_undegraded":"2024-04-22T01:11:14.072053+0000","last_fullsized":"2024-04-22T01:11:14.072053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'455","last_scrub_stamp":"2024-04-22T01:11:14.071870+0000","last_deep_scrub":"25'455","last_deep_scrub_stamp":"2024-04-22T01:11:14.071870+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.071870+0000","objects_scrubbed":2,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:00:01.686651+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'453","reported_seq":616,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:12.715028+0000","last_change":"2024-04-22T01:11:12.715082+0000","last_active":"2024-04-22T01:11:12.715028+0000","last_peered":"2024-04-22T01:11:12.715028+0000","last_clean":"2024-04-22T01:11:12.715028+0000","last_became_active":"2024-04-21T22:53:38.477006+0000","last_became_peered":"2024-04-21T22:53:38.477006+0000","last_unstale":"2024-04-22T01:11:12.715028+0000","last_undegraded":"2024-04-22T01:11:12.715028+0000","last_fullsized":"2024-04-22T01:11:12.715028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'453","last_scrub_stamp":"2024-04-22T01:11:12.714852+0000","last_deep_scrub":"25'453","last_deep_scrub_stamp":"2024-04-22T01:11:12.714852+0000","last_clean_scrub_stamp":"2024-04-22T01:11:12.714852+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:37:18.372554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43751,"num_write":424,"num_write_kb":64176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'392","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:06.371641+0000","last_change":"2024-04-22T01:11:06.371674+0000","last_active":"2024-04-22T01:11:06.371641+0000","last_peered":"2024-04-22T01:11:06.371641+0000","last_clean":"2024-04-22T01:11:06.371641+0000","last_became_active":"2024-04-21T22:53:37.193263+0000","last_became_peered":"2024-04-21T22:53:37.193263+0000","last_unstale":"2024-04-22T01:11:06.371641+0000","last_undegraded":"2024-04-22T01:11:06.371641+0000","last_fullsized":"2024-04-22T01:11:06.371641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'392","last_scrub_stamp":"2024-04-22T01:11:06.371527+0000","last_deep_scrub":"25'392","last_deep_scrub_stamp":"2024-04-22T01:11:06.371527+0000","last_clean_scrub_stamp":"2024-04-22T01:11:06.371527+0000","objects_scrubbed":1,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:20:53.747993+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'444","reported_seq":568,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.091766+0000","last_change":"2024-04-22T01:11:08.091889+0000","last_active":"2024-04-22T01:11:08.091766+0000","last_peered":"2024-04-22T01:11:08.091766+0000","last_clean":"2024-04-22T01:11:08.091766+0000","last_became_active":"2024-04-21T22:53:38.466964+0000","last_became_peered":"2024-04-21T22:53:38.466964+0000","last_unstale":"2024-04-22T01:11:08.091766+0000","last_undegraded":"2024-04-22T01:11:08.091766+0000","last_fullsized":"2024-04-22T01:11:08.091766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'444","last_scrub_stamp":"2024-04-22T01:11:08.091479+0000","last_deep_scrub":"25'444","last_deep_scrub_stamp":"2024-04-22T01:11:08.091479+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.091479+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:45:15.301622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21201,"num_write":420,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'470","reported_seq":561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:09.702154+0000","last_change":"2024-04-22T01:11:09.702222+0000","last_active":"2024-04-22T01:11:09.702154+0000","last_peered":"2024-04-22T01:11:09.702154+0000","last_clean":"2024-04-22T01:11:09.702154+0000","last_became_active":"2024-04-21T22:53:37.186570+0000","last_became_peered":"2024-04-21T22:53:37.186570+0000","last_unstale":"2024-04-22T01:11:09.702154+0000","last_undegraded":"2024-04-22T01:11:09.702154+0000","last_fullsized":"2024-04-22T01:11:09.702154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'470","last_scrub_stamp":"2024-04-22T01:11:09.701985+0000","last_deep_scrub":"25'470","last_deep_scrub_stamp":"2024-04-22T01:11:09.701985+0000","last_clean_scrub_stamp":"2024-04-22T01:11:09.701985+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:30:18.169534+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'409","reported_seq":516,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.680332+0000","last_change":"2024-04-22T01:11:11.680392+0000","last_active":"2024-04-22T01:11:11.680332+0000","last_peered":"2024-04-22T01:11:11.680332+0000","last_clean":"2024-04-22T01:11:11.680332+0000","last_became_active":"2024-04-21T22:53:38.476010+0000","last_became_peered":"2024-04-21T22:53:38.476010+0000","last_unstale":"2024-04-22T01:11:11.680332+0000","last_undegraded":"2024-04-22T01:11:11.680332+0000","last_fullsized":"2024-04-22T01:11:11.680332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2024-04-22T01:11:11.680140+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2024-04-22T01:11:11.680140+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.680140+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:20:54.008002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6132,"num_write":377,"num_write_kb":79520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'1239","reported_seq":1329,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:11.093114+0000","last_change":"2024-04-22T01:11:11.093182+0000","last_active":"2024-04-22T01:11:11.093114+0000","last_peered":"2024-04-22T01:11:11.093114+0000","last_clean":"2024-04-22T01:11:11.093114+0000","last_became_active":"2024-04-21T22:53:37.253534+0000","last_became_peered":"2024-04-21T22:53:37.253534+0000","last_unstale":"2024-04-22T01:11:11.093114+0000","last_undegraded":"2024-04-22T01:11:11.093114+0000","last_fullsized":"2024-04-22T01:11:11.093114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1239","last_scrub_stamp":"2024-04-22T01:11:11.092919+0000","last_deep_scrub":"25'1239","last_deep_scrub_stamp":"2024-04-22T01:11:11.092919+0000","last_clean_scrub_stamp":"2024-04-22T01:11:11.092919+0000","objects_scrubbed":2,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:09:57.870400+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'412","reported_seq":538,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:14.163143+0000","last_change":"2024-04-22T01:11:14.163201+0000","last_active":"2024-04-22T01:11:14.163143+0000","last_peered":"2024-04-22T01:11:14.163143+0000","last_clean":"2024-04-22T01:11:14.163143+0000","last_became_active":"2024-04-21T22:53:38.594054+0000","last_became_peered":"2024-04-21T22:53:38.594054+0000","last_unstale":"2024-04-22T01:11:14.163143+0000","last_undegraded":"2024-04-22T01:11:14.163143+0000","last_fullsized":"2024-04-22T01:11:14.163143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'412","last_scrub_stamp":"2024-04-22T01:11:14.162951+0000","last_deep_scrub":"25'412","last_deep_scrub_stamp":"2024-04-22T01:11:14.162951+0000","last_clean_scrub_stamp":"2024-04-22T01:11:14.162951+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:35.600197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16119,"num_write":379,"num_write_kb":38543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'1283","reported_seq":1371,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:18.126807+0000","last_change":"2024-04-22T01:11:18.126963+0000","last_active":"2024-04-22T01:11:18.126807+0000","last_peered":"2024-04-22T01:11:18.126807+0000","last_clean":"2024-04-22T01:11:18.126807+0000","last_became_active":"2024-04-21T22:53:37.191816+0000","last_became_peered":"2024-04-21T22:53:37.191816+0000","last_unstale":"2024-04-22T01:11:18.126807+0000","last_undegraded":"2024-04-22T01:11:18.126807+0000","last_fullsized":"2024-04-22T01:11:18.126807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1283","last_scrub_stamp":"2024-04-22T01:11:18.126567+0000","last_deep_scrub":"25'1283","last_deep_scrub_stamp":"2024-04-22T01:11:18.126567+0000","last_clean_scrub_stamp":"2024-04-22T01:11:18.126567+0000","objects_scrubbed":4,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:53:48.796519+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":12886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'432","reported_seq":571,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:21.036199+0000","last_change":"2024-04-22T01:11:21.036259+0000","last_active":"2024-04-22T01:11:21.036199+0000","last_peered":"2024-04-22T01:11:21.036199+0000","last_clean":"2024-04-22T01:11:21.036199+0000","last_became_active":"2024-04-21T22:53:38.578291+0000","last_became_peered":"2024-04-21T22:53:38.578291+0000","last_unstale":"2024-04-22T01:11:21.036199+0000","last_undegraded":"2024-04-22T01:11:21.036199+0000","last_fullsized":"2024-04-22T01:11:21.036199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'432","last_scrub_stamp":"2024-04-22T01:11:21.036022+0000","last_deep_scrub":"25'432","last_deep_scrub_stamp":"2024-04-22T01:11:21.036022+0000","last_clean_scrub_stamp":"2024-04-22T01:11:21.036022+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:39:32.879632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23225,"num_write":401,"num_write_kb":108270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'409","reported_seq":523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:24.123954+0000","last_change":"2024-04-22T01:11:24.124077+0000","last_active":"2024-04-22T01:11:24.123954+0000","last_peered":"2024-04-22T01:11:24.123954+0000","last_clean":"2024-04-22T01:11:24.123954+0000","last_became_active":"2024-04-21T22:53:38.606724+0000","last_became_peered":"2024-04-21T22:53:38.606724+0000","last_unstale":"2024-04-22T01:11:24.123954+0000","last_undegraded":"2024-04-22T01:11:24.123954+0000","last_fullsized":"2024-04-22T01:11:24.123954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'409","last_scrub_stamp":"2024-04-22T01:11:24.123753+0000","last_deep_scrub":"25'409","last_deep_scrub_stamp":"2024-04-22T01:11:24.123753+0000","last_clean_scrub_stamp":"2024-04-22T01:11:24.123753+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:07:52.628920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22627,"num_write":363,"num_write_kb":69341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'794","reported_seq":876,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:04.364347+0000","last_change":"2024-04-22T01:11:04.364347+0000","last_active":"2024-04-22T01:11:04.364347+0000","last_peered":"2024-04-22T01:11:04.364347+0000","last_clean":"2024-04-22T01:11:04.364347+0000","last_became_active":"2024-04-21T22:53:37.189252+0000","last_became_peered":"2024-04-21T22:53:37.189252+0000","last_unstale":"2024-04-22T01:11:04.364347+0000","last_undegraded":"2024-04-22T01:11:04.364347+0000","last_fullsized":"2024-04-22T01:11:04.364347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'794","last_scrub_stamp":"2024-04-22T01:11:04.364227+0000","last_deep_scrub":"25'794","last_deep_scrub_stamp":"2024-04-22T01:11:04.364227+0000","last_clean_scrub_stamp":"2024-04-22T01:11:04.364227+0000","objects_scrubbed":2,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:46.996846+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'375","reported_seq":488,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:08.969141+0000","last_change":"2024-04-22T01:11:08.969141+0000","last_active":"2024-04-22T01:11:08.969141+0000","last_peered":"2024-04-22T01:11:08.969141+0000","last_clean":"2024-04-22T01:11:08.969141+0000","last_became_active":"2024-04-21T22:53:38.621187+0000","last_became_peered":"2024-04-21T22:53:38.621187+0000","last_unstale":"2024-04-22T01:11:08.969141+0000","last_undegraded":"2024-04-22T01:11:08.969141+0000","last_fullsized":"2024-04-22T01:11:08.969141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'375","last_scrub_stamp":"2024-04-22T01:11:08.968906+0000","last_deep_scrub":"25'375","last_deep_scrub_stamp":"2024-04-22T01:11:08.968906+0000","last_clean_scrub_stamp":"2024-04-22T01:11:08.968906+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:30:53.556822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17046,"num_write":339,"num_write_kb":42889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2012","reported_seq":2094,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:03.378159+0000","last_change":"2024-04-22T01:11:03.378159+0000","last_active":"2024-04-22T01:11:03.378159+0000","last_peered":"2024-04-22T01:11:03.378159+0000","last_clean":"2024-04-22T01:11:03.378159+0000","last_became_active":"2024-04-21T22:53:37.187722+0000","last_became_peered":"2024-04-21T22:53:37.187722+0000","last_unstale":"2024-04-22T01:11:03.378159+0000","last_undegraded":"2024-04-22T01:11:03.378159+0000","last_fullsized":"2024-04-22T01:11:03.378159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2012","last_scrub_stamp":"2024-04-22T01:11:03.378047+0000","last_deep_scrub":"25'2012","last_deep_scrub_stamp":"2024-04-22T01:11:03.378047+0000","last_clean_scrub_stamp":"2024-04-22T01:11:03.378047+0000","objects_scrubbed":5,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:19:32.308006+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":17305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'380","reported_seq":530,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:16.348942+0000","last_change":"2024-04-22T01:11:16.349004+0000","last_active":"2024-04-22T01:11:16.348942+0000","last_peered":"2024-04-22T01:11:16.348942+0000","last_clean":"2024-04-22T01:11:16.348942+0000","last_became_active":"2024-04-21T22:53:38.585789+0000","last_became_peered":"2024-04-21T22:53:38.585789+0000","last_unstale":"2024-04-22T01:11:16.348942+0000","last_undegraded":"2024-04-22T01:11:16.348942+0000","last_fullsized":"2024-04-22T01:11:16.348942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'380","last_scrub_stamp":"2024-04-22T01:11:16.348755+0000","last_deep_scrub":"25'380","last_deep_scrub_stamp":"2024-04-22T01:11:16.348755+0000","last_clean_scrub_stamp":"2024-04-22T01:11:16.348755+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:39:26.191865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35342,"num_write":358,"num_write_kb":67635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'690","reported_seq":785,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:10.307799+0000","last_change":"2024-04-22T01:11:10.307973+0000","last_active":"2024-04-22T01:11:10.307799+0000","last_peered":"2024-04-22T01:11:10.307799+0000","last_clean":"2024-04-22T01:11:10.307799+0000","last_became_active":"2024-04-21T22:53:37.256172+0000","last_became_peered":"2024-04-21T22:53:37.256172+0000","last_unstale":"2024-04-22T01:11:10.307799+0000","last_undegraded":"2024-04-22T01:11:10.307799+0000","last_fullsized":"2024-04-22T01:11:10.307799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'690","last_scrub_stamp":"2024-04-22T01:11:10.307484+0000","last_deep_scrub":"25'690","last_deep_scrub_stamp":"2024-04-22T01:11:10.307484+0000","last_clean_scrub_stamp":"2024-04-22T01:11:10.307484+0000","objects_scrubbed":2,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:47:32.771487+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'405","reported_seq":562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:17.370801+0000","last_change":"2024-04-22T01:11:17.370876+0000","last_active":"2024-04-22T01:11:17.370801+0000","last_peered":"2024-04-22T01:11:17.370801+0000","last_clean":"2024-04-22T01:11:17.370801+0000","last_became_active":"2024-04-21T22:53:38.586479+0000","last_became_peered":"2024-04-21T22:53:38.586479+0000","last_unstale":"2024-04-22T01:11:17.370801+0000","last_undegraded":"2024-04-22T01:11:17.370801+0000","last_fullsized":"2024-04-22T01:11:17.370801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'405","last_scrub_stamp":"2024-04-22T01:11:17.370623+0000","last_deep_scrub":"25'405","last_deep_scrub_stamp":"2024-04-22T01:11:17.370623+0000","last_clean_scrub_stamp":"2024-04-22T01:11:17.370623+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:00:55.196702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37645,"num_write":381,"num_write_kb":68489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'722","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T01:11:07.692881+0000","last_change":"2024-04-22T01:11:07.692881+0000","last_active":"2024-04-22T01:11:07.692881+0000","last_peered":"2024-04-22T01:11:07.692881+0000","last_clean":"2024-04-22T01:11:07.692881+0000","last_became_active":"2024-04-21T22:53:37.184949+0000","last_became_peered":"2024-04-21T22:53:37.184949+0000","last_unstale":"2024-04-22T01:11:07.692881+0000","last_undegraded":"2024-04-22T01:11:07.692881+0000","last_fullsized":"2024-04-22T01:11:07.692881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'722","last_scrub_stamp":"2024-04-22T01:11:07.692530+0000","last_deep_scrub":"25'722","last_deep_scrub_stamp":"2024-04-22T01:11:07.692530+0000","last_clean_scrub_stamp":"2024-04-22T01:11:07.692530+0000","objects_scrubbed":4,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:29:07.964970+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":676,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2741,"num_read_kb":1454219,"num_write":24465,"num_write_kb":4289319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26377,"ondisk_log_size":26377,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213130007,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":4349,"num_read_kb":4731,"num_write":48352,"num_write_kb":232418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228024320,"data_stored":426260014,"data_compressed":52327842,"data_compressed_allocated":69902336,"data_compressed_original":268197888,"omap_allocated":0,"internal_metadata":0},"log_size":39221,"ondisk_log_size":39221,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62916,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424511110,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71724,"kb_used_data":18340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":18780160,"data_stored":33648040,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511111,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151488,"kb_used_data":43960,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94220352,"statfs":{"total":96636764160,"available":96481640448,"internally_reserved":0,"allocated":45015040,"data_stored":88174574,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424511111,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84940,"kb_used_data":17668,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286900,"statfs":{"total":96636764160,"available":96549785600,"internally_reserved":0,"allocated":18092032,"data_stored":33648712,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424511112,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93264,"kb_used_data":25992,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278576,"statfs":{"total":96636764160,"available":96541261824,"internally_reserved":0,"allocated":26615808,"data_stored":48772550,"data_compressed":5793004,"data_compressed_allocated":7802880,"data_compressed_original":30134272,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424511111,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137712,"kb_used_data":30184,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94234128,"statfs":{"total":96636764160,"available":96495747072,"internally_reserved":0,"allocated":30908416,"data_stored":54620904,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511110,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148336,"kb_used_data":44968,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94223504,"statfs":{"total":96636764160,"available":96484868096,"internally_reserved":0,"allocated":46047232,"data_stored":81736600,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543816,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128480,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94243360,"statfs":{"total":96636764160,"available":96505200640,"internally_reserved":0,"allocated":17195008,"data_stored":35110341,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543815,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130280,"kb_used_data":26912,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94241560,"statfs":{"total":96636764160,"available":96503357440,"internally_reserved":0,"allocated":27557888,"data_stored":52477893,"data_compressed":6455074,"data_compressed_allocated":8462336,"data_compressed_original":33558528,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31458,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45789184,"data_stored":81642992,"data_compressed":9595769,"data_compressed_allocated":13062144,"data_compressed_original":48926720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26296320,"data_stored":48088574,"data_compressed":5761546,"data_compressed_allocated":7761920,"data_compressed_original":29560832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17833984,"data_stored":33555104,"data_compressed":4036434,"data_compressed_allocated":5255168,"data_compressed_original":20983808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44756992,"data_stored":88080966,"data_compressed":11211017,"data_compressed_allocated":14725120,"data_compressed_original":58052608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30650368,"data_stored":54527296,"data_compressed":6565334,"data_compressed_allocated":9089024,"data_compressed_original":32980992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":51793917,"data_compressed":6423616,"data_compressed_allocated":8421376,"data_compressed_original":32985088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18522112,"data_stored":33554432,"data_compressed":4104081,"data_compressed_allocated":5509120,"data_compressed_original":20541440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16936960,"data_stored":35016733,"data_compressed":4630045,"data_compressed_allocated":6078464,"data_compressed_original":24166400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T01:11:51.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-22T01:11:51.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e96ec640 1 Processor -- start 2024-04-22T01:11:51.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e96ec640 1 -- start start 2024-04-22T01:11:51.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e96ec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85e4151200 0x7f85e40c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e96ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85e41578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e96ec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e4071770 con 0x7f85e4071980 2024-04-22T01:11:51.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e96ec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f85e4157420 con 0x7f85e4151200 2024-04-22T01:11:51.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e96ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f85e4072b50 con 0x7f85e41515e0 2024-04-22T01:11:51.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e37fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f85e4071980 0x7f85e40c81a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45506/0 (socket says 172.21.15.110:45506) 2024-04-22T01:11:51.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.379+0000 7f85e37fe640 1 -- 172.21.15.110:0/2345516758 learned_addr learned my addr 172.21.15.110:0/2345516758 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:51.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.383+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593797427 0 0) 0x7f85e4071770 con 0x7f85e4071980 2024-04-22T01:11:51.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.383+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85cc003530 con 0x7f85e4071980 2024-04-22T01:11:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/2345516758 >> v2:172.21.15.154:3300/0 conn(0x7f85e4151200 0x7f85e40c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e27fc640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85e41578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1650417014 0 0) 0x7f85cc003530 con 0x7f85e4071980 2024-04-22T01:11:51.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 msgr2=0x7f85e41578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:51.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85e41578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 >> v2:172.21.15.154:3300/0 conn(0x7f85e4151200 msgr2=0x7f85e40c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 --2- 172.21.15.110:0/2345516758 >> v2:172.21.15.154:3300/0 conn(0x7f85e4151200 0x7f85e40c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e40c7f40 con 0x7f85e4071980 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f85dc001a00 con 0x7f85e4071980 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 >> v1:172.21.15.110:6789/0 conn(0x7f85e4071980 legacy=0x7f85e40c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85cc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85cc004040 0x7f85cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85cc004d50 0x7f85cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f85e4157420 con 0x7f85cc004040 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85e4072b50 con 0x7f85cc004d50 2024-04-22T01:11:51.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.387+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f85cc00bc10 con 0x7f85e41515e0 2024-04-22T01:11:51.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.395+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85cc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.395+0000 7f85e27fc640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85cc004040 0x7f85cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.395+0000 7f85e37fe640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85cc004d50 0x7f85cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.399+0000 7f85e2ffd640 1 -- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85cc004d50 msgr2=0x7f85cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:51.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.399+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85cc004d50 0x7f85cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.399+0000 7f85e2ffd640 1 -- 172.21.15.110:0/2345516758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85cc004040 msgr2=0x7f85cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:51.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.399+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85cc004040 0x7f85cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.399+0000 7f85e2ffd640 1 -- 172.21.15.110:0/2345516758 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85cc003530 con 0x7f85e41515e0 2024-04-22T01:11:51.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.411+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85cc0039c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba30 tx=0x7f85d801c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=486117991b256e11 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:51.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d800b600 con 0x7f85e41515e0 2024-04-22T01:11:51.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80b1070 con 0x7f85e41515e0 2024-04-22T01:11:51.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e1ffb640 1 -- 172.21.15.110:0/2345516758 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d80ac8c0 con 0x7f85e41515e0 2024-04-22T01:11:51.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e96ec640 1 -- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 msgr2=0x7f85cc0039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:51.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e96ec640 1 --2- 172.21.15.110:0/2345516758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85cc0039c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba30 tx=0x7f85d801c6e0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e37fe640 1 -- 172.21.15.110:0/2345516758 reap_dead start 2024-04-22T01:11:51.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e96ec640 1 -- 172.21.15.110:0/2345516758 shutdown_connections 2024-04-22T01:11:51.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e96ec640 1 -- 172.21.15.110:0/2345516758 >> 172.21.15.110:0/2345516758 conn(0x7f85e40cb710 msgr2=0x7f85e40cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:51.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e96ec640 1 -- 172.21.15.110:0/2345516758 shutdown_connections 2024-04-22T01:11:51.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e96ec640 1 -- 172.21.15.110:0/2345516758 wait complete. 2024-04-22T01:11:51.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.531+0000 7f85e96ec640 1 Processor -- start 2024-04-22T01:11:51.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.535+0000 7f85e96ec640 1 -- start start 2024-04-22T01:11:51.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.535+0000 7f85e96ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85e41539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.535+0000 7f85e96ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e41528e0 0x7f85e415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.535+0000 7f85e96ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e4159390 0x7f85e4146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.535+0000 7f85e96ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f85e40733b0 con 0x7f85e41528e0 2024-04-22T01:11:51.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.535+0000 7f85e96ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85e40730d0 con 0x7f85e4159390 2024-04-22T01:11:51.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.535+0000 7f85e96ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f85e40c88b0 con 0x7f85e41515e0 2024-04-22T01:11:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.539+0000 7f85e27fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e41528e0 0x7f85e415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.539+0000 7f85e27fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e41528e0 0x7f85e415b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51482/0 (socket says 172.21.15.110:51482) 2024-04-22T01:11:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.539+0000 7f85e27fc640 1 -- 172.21.15.110:0/2439402027 learned_addr learned my addr 172.21.15.110:0/2439402027 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:51.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.539+0000 7f85e37fe640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e4159390 0x7f85e4146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.543+0000 7f85e27fc640 1 -- 172.21.15.110:0/2439402027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 msgr2=0x7f85e41539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.543+0000 7f85e27fc640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85e41539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.543+0000 7f85e27fc640 1 -- 172.21.15.110:0/2439402027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e4159390 msgr2=0x7f85e4146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.543+0000 7f85e27fc640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e4159390 0x7f85e4146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.543+0000 7f85e27fc640 1 -- 172.21.15.110:0/2439402027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e4151e40 con 0x7f85e41528e0 2024-04-22T01:11:51.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.547+0000 7f85e27fc640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e41528e0 0x7f85e415b250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85d400f910 tx=0x7f85d400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:51.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.559+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d400db50 con 0x7f85e41528e0 2024-04-22T01:11:51.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.559+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d400dcf0 con 0x7f85e41528e0 2024-04-22T01:11:51.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.559+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d400dea0 con 0x7f85e41528e0 2024-04-22T01:11:51.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.559+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e4164510 con 0x7f85e41528e0 2024-04-22T01:11:51.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.559+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e415aa50 con 0x7f85e41528e0 2024-04-22T01:11:51.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.559+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e404f510 con 0x7f85e41528e0 2024-04-22T01:11:51.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.983+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85d4013660 con 0x7f85e41528e0 2024-04-22T01:11:51.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.983+0000 7f85cb7fe640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067940 0x7f85d0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:51.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.983+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067940 0x7f85d0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:51.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:51.983+0000 7f85e2ffd640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067940 0x7f85d0069e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f85d80b0000 tx=0x7f85d8004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:52.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.007+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f85d40550a0 con 0x7f85e41528e0 2024-04-22T01:11:52.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.007+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f85d4029020 con 0x7f85e41528e0 2024-04-22T01:11:52.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.187+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f85e4154d80 con 0x7f85e41528e0 2024-04-22T01:11:52.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.335+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f85d4017030 con 0x7f85e41528e0 2024-04-22T01:11:52.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.335+0000 7f85cb7fe640 1 -- 172.21.15.110:0/2439402027 <== mon.0 v2:172.21.15.110:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f85d4057700 con 0x7f85e41528e0 2024-04-22T01:11:52.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067940 msgr2=0x7f85d0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:52.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067940 0x7f85d0069e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f85d80b0000 tx=0x7f85d8004740 comp rx=0 tx=0).stop 2024-04-22T01:11:52.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e41528e0 msgr2=0x7f85e415b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e41528e0 0x7f85e415b250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85d400f910 tx=0x7f85d400fd10 comp rx=0 tx=0).stop 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 shutdown_connections 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f85d0067940 0x7f85d0069e00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85e4159390 0x7f85e4146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e41528e0 0x7f85e415b250 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 --2- 172.21.15.110:0/2439402027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85e41515e0 0x7f85e41539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 >> 172.21.15.110:0/2439402027 conn(0x7f85e40cb710 msgr2=0x7f85e40c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 shutdown_connections 2024-04-22T01:11:52.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.339+0000 7f85e96ec640 1 -- 172.21.15.110:0/2439402027 wait complete. 2024-04-22T01:11:52.358 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-22T01:11:52.358 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T01:11:52.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.475+0000 7faaff75d640 1 Processor -- start 2024-04-22T01:11:52.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.475+0000 7faaff75d640 1 -- start start 2024-04-22T01:11:52.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.475+0000 7faaff75d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faaf80727a0 0x7faaf80c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:52.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.475+0000 7faaff75d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faaf80c3450 0x7faaf80c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:52.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.475+0000 7faaff75d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf80733d0 con 0x7faaf8150f30 2024-04-22T01:11:52.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.475+0000 7faaff75d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7faaf80736b0 con 0x7faaf80c3450 2024-04-22T01:11:52.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.475+0000 7faaff75d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7faaf8157340 con 0x7faaf80727a0 2024-04-22T01:11:52.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.479+0000 7faafdcfa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faaf80c3450 0x7faaf80c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:52.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.483+0000 7faafd4f9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faaf8150f30 0x7faaf81577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.110:50946/0 (socket says 172.21.15.110:50946) 2024-04-22T01:11:52.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.483+0000 7faafd4f9640 1 -- 172.21.15.110:0/1674830837 learned_addr learned my addr 172.21.15.110:0/1674830837 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:52.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.483+0000 7faafccf8640 1 --2- 172.21.15.110:0/1674830837 >> v2:172.21.15.154:3300/0 conn(0x7faaf80727a0 0x7faaf80c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:52.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.491+0000 7faafdcfa640 1 -- 172.21.15.110:0/1674830837 >> v2:172.21.15.154:3300/0 conn(0x7faaf80727a0 msgr2=0x7faaf80c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:52.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.491+0000 7faafdcfa640 1 --2- 172.21.15.110:0/1674830837 >> v2:172.21.15.154:3300/0 conn(0x7faaf80727a0 0x7faaf80c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.491+0000 7faafdcfa640 1 -- 172.21.15.110:0/1674830837 >> v1:172.21.15.154:6789/0 conn(0x7faaf8150f30 legacy=0x7faaf81577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:52.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.491+0000 7faafdcfa640 1 -- 172.21.15.110:0/1674830837 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf80c7680 con 0x7faaf80c3450 2024-04-22T01:11:52.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.495+0000 7faafdcfa640 1 --2- 172.21.15.110:0/1674830837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80c3450 0x7faaf80c38c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faaf8070550 tx=0x7faae801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e1c9e9c99b08d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:52.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaf7fff640 1 -- 172.21.15.110:0/1674830837 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80b2070 con 0x7faaf80c3450 2024-04-22T01:11:52.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaf7fff640 1 -- 172.21.15.110:0/1674830837 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faae80a57f0 con 0x7faaf80c3450 2024-04-22T01:11:52.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaf7fff640 1 -- 172.21.15.110:0/1674830837 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80a5be0 con 0x7faaf80c3450 2024-04-22T01:11:52.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaff75d640 1 -- 172.21.15.110:0/1674830837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80c3450 msgr2=0x7faaf80c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:52.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaff75d640 1 --2- 172.21.15.110:0/1674830837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80c3450 0x7faaf80c38c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faaf8070550 tx=0x7faae801c930 comp rx=0 tx=0).stop 2024-04-22T01:11:52.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaff75d640 1 -- 172.21.15.110:0/1674830837 shutdown_connections 2024-04-22T01:11:52.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaff75d640 1 --2- 172.21.15.110:0/1674830837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80c3450 0x7faaf80c38c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaff75d640 1 --2- 172.21.15.110:0/1674830837 >> v2:172.21.15.154:3300/0 conn(0x7faaf80727a0 0x7faaf80c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.499+0000 7faaff75d640 1 -- 172.21.15.110:0/1674830837 >> 172.21.15.110:0/1674830837 conn(0x7faaf806e590 msgr2=0x7faaf806e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:52.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 -- 172.21.15.110:0/1674830837 shutdown_connections 2024-04-22T01:11:52.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 -- 172.21.15.110:0/1674830837 wait complete. 2024-04-22T01:11:52.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 Processor -- start 2024-04-22T01:11:52.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 -- start start 2024-04-22T01:11:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80727a0 0x7faaf81f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf80c3450 0x7faaf8148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaf8150f30 0x7faaf815ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faaf815a6d0 con 0x7faaf80727a0 2024-04-22T01:11:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faaf815a550 con 0x7faaf80c3450 2024-04-22T01:11:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faaff75d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faaf8072cb0 con 0x7faaf8150f30 2024-04-22T01:11:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faafd4f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80727a0 0x7faaf81f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faafccf8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf80c3450 0x7faaf8148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faafd4f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80727a0 0x7faaf81f3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51498/0 (socket says 172.21.15.110:51498) 2024-04-22T01:11:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.503+0000 7faafd4f9640 1 -- 172.21.15.110:0/2033122012 learned_addr learned my addr 172.21.15.110:0/2033122012 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:52.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.507+0000 7faafdcfa640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaf8150f30 0x7faaf815ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:52.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.507+0000 7faafd4f9640 1 -- 172.21.15.110:0/2033122012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaf8150f30 msgr2=0x7faaf815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:52.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.507+0000 7faafd4f9640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaf8150f30 0x7faaf815ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.507+0000 7faafd4f9640 1 -- 172.21.15.110:0/2033122012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf80c3450 msgr2=0x7faaf8148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:52.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.507+0000 7faafd4f9640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf80c3450 0x7faaf8148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:52.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.507+0000 7faafd4f9640 1 -- 172.21.15.110:0/2033122012 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf814fd30 con 0x7faaf80727a0 2024-04-22T01:11:52.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.511+0000 7faafd4f9640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80727a0 0x7faaf81f3d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c3a0 tx=0x7faaf000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:52.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.511+0000 7faaf5ffb640 1 -- 172.21.15.110:0/2033122012 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0017070 con 0x7faaf80727a0 2024-04-22T01:11:52.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.511+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf814e4a0 con 0x7faaf80727a0 2024-04-22T01:11:52.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.511+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf814ea60 con 0x7faaf80727a0 2024-04-22T01:11:52.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.515+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf804f510 con 0x7faaf80727a0 2024-04-22T01:11:52.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.515+0000 7faaf5ffb640 1 -- 172.21.15.110:0/2033122012 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faaf0005cf0 con 0x7faaf80727a0 2024-04-22T01:11:52.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.515+0000 7faaf5ffb640 1 -- 172.21.15.110:0/2033122012 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0021060 con 0x7faaf80727a0 2024-04-22T01:11:52.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.819+0000 7faaf5ffb640 1 -- 172.21.15.110:0/2033122012 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faaf001a070 con 0x7faaf80727a0 2024-04-22T01:11:52.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.819+0000 7faaf5ffb640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7faae40678f0 0x7faae4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:52.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.819+0000 7faafccf8640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7faae40678f0 0x7faae4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:52.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.819+0000 7faafccf8640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7faae40678f0 0x7faae4069db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faaf81f0f40 tx=0x7faaec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:52.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.855+0000 7faaf5ffb640 1 -- 172.21.15.110:0/2033122012 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7faaf0054010 con 0x7faaf80727a0 2024-04-22T01:11:52.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:52.855+0000 7faaf5ffb640 1 -- 172.21.15.110:0/2033122012 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7faaf0055d10 con 0x7faaf80727a0 2024-04-22T01:11:53.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.047+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaf81564a0 con 0x7faaf80727a0 2024-04-22T01:11:53.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaf5ffb640 1 -- 172.21.15.110:0/2033122012 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6842 (secure 0 0 0) 0x7faaf005a010 con 0x7faaf80727a0 2024-04-22T01:11:53.067 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:11:53.067 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3272126146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3272126146},{"type":"v1","addr":"172.21.15.154:6835","nonce":3272126146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1335792720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1335792720},{"type":"v1","addr":"172.21.15.110:6839","nonce":1335792720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1521497243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1521497243},{"type":"v1","addr":"172.21.15.154:6833","nonce":1521497243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1669982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1669982495},{"type":"v1","addr":"172.21.15.154:6837","nonce":1669982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T22:53:38.095934+0000","modified":"2024-04-21T22:53:44.722732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/1034856927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1034856927},{"type":"v1","addr":"172.21.15.110:6837","nonce":1034856927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-22T01:11:53.067 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2024-04-22T01:11:53.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7faae40678f0 msgr2=0x7faae4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7faae40678f0 0x7faae4069db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faaf81f0f40 tx=0x7faaec009190 comp rx=0 tx=0).stop 2024-04-22T01:11:53.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80727a0 msgr2=0x7faaf81f3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80727a0 0x7faaf81f3d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c3a0 tx=0x7faaf000c860 comp rx=0 tx=0).stop 2024-04-22T01:11:53.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 shutdown_connections 2024-04-22T01:11:53.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7faae40678f0 0x7faae4069db0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaf8150f30 0x7faaf815ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf80c3450 0x7faaf8148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 --2- 172.21.15.110:0/2033122012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaf80727a0 0x7faaf81f3d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 >> 172.21.15.110:0/2033122012 conn(0x7faaf806e590 msgr2=0x7faaf806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:53.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 shutdown_connections 2024-04-22T01:11:53.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.067+0000 7faaff75d640 1 -- 172.21.15.110:0/2033122012 wait complete. 2024-04-22T01:11:53.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T01:11:53.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.191+0000 7f9fff43b640 1 Processor -- start 2024-04-22T01:11:53.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.191+0000 7f9fff43b640 1 -- start start 2024-04-22T01:11:53.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9fff43b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff806c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9fff43b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ff80cde60 0x7f9ff80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9fff43b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff80cd9b0 con 0x7f9ff80ceb40 2024-04-22T01:11:53.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9fff43b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff815a5d0 con 0x7f9ff80cde60 2024-04-22T01:11:53.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9fff43b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff815a8b0 con 0x7f9ff806c380 2024-04-22T01:11:53.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9ffc9d6640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9ff80ceb40 0x7f9ff80cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45510/0 (socket says 172.21.15.110:45510) 2024-04-22T01:11:53.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9ffc9d6640 1 -- 172.21.15.110:0/4034840849 learned_addr learned my addr 172.21.15.110:0/4034840849 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:53.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9ffd1d7640 1 --2- 172.21.15.110:0/4034840849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff806c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9ffd9d8640 1 --2- 172.21.15.110:0/4034840849 >> v2:172.21.15.154:3300/0 conn(0x7f9ff80cde60 0x7f9ff80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9feffff640 1 -- 172.21.15.110:0/4034840849 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812631243 0 0) 0x7f9ff80cd9b0 con 0x7f9ff80ceb40 2024-04-22T01:11:53.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.195+0000 7f9feffff640 1 -- 172.21.15.110:0/4034840849 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fe4003530 con 0x7f9ff80ceb40 2024-04-22T01:11:53.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.203+0000 7f9ffd1d7640 1 -- 172.21.15.110:0/4034840849 >> v2:172.21.15.154:3300/0 conn(0x7f9ff80cde60 msgr2=0x7f9ff80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:53.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.203+0000 7f9ffd1d7640 1 --2- 172.21.15.110:0/4034840849 >> v2:172.21.15.154:3300/0 conn(0x7f9ff80cde60 0x7f9ff80ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.203+0000 7f9ffd1d7640 1 -- 172.21.15.110:0/4034840849 >> v1:172.21.15.110:6789/0 conn(0x7f9ff80ceb40 legacy=0x7f9ff80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.203+0000 7f9ffd1d7640 1 -- 172.21.15.110:0/4034840849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff80ce830 con 0x7f9ff806c380 2024-04-22T01:11:53.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.207+0000 7f9ffd1d7640 1 --2- 172.21.15.110:0/4034840849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff806c760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40097c0 tx=0x7f9ff401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8c8fb24229fc552 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:53.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9feffff640 1 -- 172.21.15.110:0/4034840849 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40b5070 con 0x7f9ff806c380 2024-04-22T01:11:53.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9feffff640 1 -- 172.21.15.110:0/4034840849 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ff40a8990 con 0x7f9ff806c380 2024-04-22T01:11:53.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9feffff640 1 -- 172.21.15.110:0/4034840849 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40a8d80 con 0x7f9ff806c380 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- 172.21.15.110:0/4034840849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 msgr2=0x7f9ff806c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 --2- 172.21.15.110:0/4034840849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff806c760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40097c0 tx=0x7f9ff401ec90 comp rx=0 tx=0).stop 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- 172.21.15.110:0/4034840849 shutdown_connections 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 --2- 172.21.15.110:0/4034840849 >> v2:172.21.15.154:3300/0 conn(0x7f9ff80cde60 0x7f9ff80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 --2- 172.21.15.110:0/4034840849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff806c760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- 172.21.15.110:0/4034840849 >> 172.21.15.110:0/4034840849 conn(0x7f9ff80b1640 msgr2=0x7f9ff80b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- 172.21.15.110:0/4034840849 shutdown_connections 2024-04-22T01:11:53.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- 172.21.15.110:0/4034840849 wait complete. 2024-04-22T01:11:53.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 Processor -- start 2024-04-22T01:11:53.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- start start 2024-04-22T01:11:53.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff80c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff80cde60 0x7f9ff80c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80ceb40 0x7f9ff81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff80cb130 con 0x7f9ff80cde60 2024-04-22T01:11:53.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff815ae70 con 0x7f9ff80ceb40 2024-04-22T01:11:53.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.219+0000 7f9fff43b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff815a2a0 con 0x7f9ff806c380 2024-04-22T01:11:53.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.223+0000 7f9ffd9d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80ceb40 0x7f9ff81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.223+0000 7f9ffd9d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80ceb40 0x7f9ff81560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.110:38470/0 (socket says 172.21.15.110:38470) 2024-04-22T01:11:53.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.223+0000 7f9ffd9d8640 1 -- 172.21.15.110:0/3060355657 learned_addr learned my addr 172.21.15.110:0/3060355657 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:53.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.223+0000 7f9ffd1d7640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff80c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.223+0000 7f9ffc9d6640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff80cde60 0x7f9ff80c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.227+0000 7f9ffc9d6640 1 -- 172.21.15.110:0/3060355657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 msgr2=0x7f9ff80c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.227+0000 7f9ffc9d6640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff80c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.227+0000 7f9ffc9d6640 1 -- 172.21.15.110:0/3060355657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80ceb40 msgr2=0x7f9ff81560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.227+0000 7f9ffc9d6640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80ceb40 0x7f9ff81560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.227+0000 7f9ffc9d6640 1 -- 172.21.15.110:0/3060355657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff81f0390 con 0x7f9ff80cde60 2024-04-22T01:11:53.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.231+0000 7f9ffc9d6640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff80cde60 0x7f9ff80c5e00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8001ec0 tx=0x7f9fe800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.235+0000 7f9fedffb640 1 -- 172.21.15.110:0/3060355657 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8017070 con 0x7f9ff80cde60 2024-04-22T01:11:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.235+0000 7f9fedffb640 1 -- 172.21.15.110:0/3060355657 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9fe8005cf0 con 0x7f9ff80cde60 2024-04-22T01:11:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.235+0000 7f9fedffb640 1 -- 172.21.15.110:0/3060355657 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80072d0 con 0x7f9ff80cde60 2024-04-22T01:11:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.235+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff81f0670 con 0x7f9ff80cde60 2024-04-22T01:11:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.235+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff81f0c30 con 0x7f9ff80cde60 2024-04-22T01:11:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.235+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff804f510 con 0x7f9ff80cde60 2024-04-22T01:11:53.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.511+0000 7f9fedffb640 1 -- 172.21.15.110:0/3060355657 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9fe801a070 con 0x7f9ff80cde60 2024-04-22T01:11:53.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.511+0000 7f9fedffb640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9fdc067910 0x7f9fdc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.511+0000 7f9ffd1d7640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9fdc067910 0x7f9fdc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.515+0000 7f9ffd1d7640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9fdc067910 0x7f9fdc069dd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b2000 tx=0x7f9ff4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:53.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.551+0000 7f9fedffb640 1 -- 172.21.15.110:0/3060355657 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9fe80539d0 con 0x7f9ff80cde60 2024-04-22T01:11:53.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.551+0000 7f9fedffb640 1 -- 172.21.15.110:0/3060355657 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f9fe8055930 con 0x7f9ff80cde60 2024-04-22T01:11:53.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.747+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ff80cf6d0 con 0x7f9ff80cde60 2024-04-22T01:11:53.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.783+0000 7f9fedffb640 1 -- 172.21.15.110:0/3060355657 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6842 (secure 0 0 0) 0x7f9fe8059c30 con 0x7f9ff80cde60 2024-04-22T01:11:53.783 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:11:53.784 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3272126146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3272126146},{"type":"v1","addr":"172.21.15.154:6835","nonce":3272126146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1335792720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1335792720},{"type":"v1","addr":"172.21.15.110:6839","nonce":1335792720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1521497243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1521497243},{"type":"v1","addr":"172.21.15.154:6833","nonce":1521497243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2932643099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2932643099},{"type":"v1","addr":"172.21.15.110:6835","nonce":2932643099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1669982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1669982495},{"type":"v1","addr":"172.21.15.154:6837","nonce":1669982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T22:53:38.095934+0000","modified":"2024-04-21T22:53:44.722732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/1034856927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1034856927},{"type":"v1","addr":"172.21.15.110:6837","nonce":1034856927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-22T01:11:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2024-04-22T01:11:53.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.783+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9fdc067910 msgr2=0x7f9fdc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.783+0000 7f9fff43b640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9fdc067910 0x7f9fdc069dd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b2000 tx=0x7f9ff4008040 comp rx=0 tx=0).stop 2024-04-22T01:11:53.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.783+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff80cde60 msgr2=0x7f9ff80c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.783+0000 7f9fff43b640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff80cde60 0x7f9ff80c5e00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8001ec0 tx=0x7f9fe800c820 comp rx=0 tx=0).stop 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 shutdown_connections 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f9fdc067910 0x7f9fdc069dd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80ceb40 0x7f9ff81560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff80cde60 0x7f9ff80c5e00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 --2- 172.21.15.110:0/3060355657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff806c380 0x7f9ff80c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 >> 172.21.15.110:0/3060355657 conn(0x7f9ff80b1640 msgr2=0x7f9ff80cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 shutdown_connections 2024-04-22T01:11:53.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.787+0000 7f9fff43b640 1 -- 172.21.15.110:0/3060355657 wait complete. 2024-04-22T01:11:53.804 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T01:11:53.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.939+0000 7f2ebd4e7640 1 Processor -- start 2024-04-22T01:11:53.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.939+0000 7f2ebd4e7640 1 -- start start 2024-04-22T01:11:53.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.939+0000 7f2ebd4e7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2eb8156950 0x7f2eb80c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.939+0000 7f2ebd4e7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb80c7300 con 0x7f2eb806ee90 2024-04-22T01:11:53.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.939+0000 7f2ebd4e7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb80c4da0 con 0x7f2eb8150c20 2024-04-22T01:11:53.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.939+0000 7f2ebd4e7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb80c5640 con 0x7f2eb8156950 2024-04-22T01:11:53.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.963+0000 7f2eb77fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2eb806ee90 0x7f2eb81612b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45522/0 (socket says 172.21.15.110:45522) 2024-04-22T01:11:53.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.963+0000 7f2eb77fe640 1 -- 172.21.15.110:0/4243634504 learned_addr learned my addr 172.21.15.110:0/4243634504 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.963+0000 7f2eaffff640 1 --2- 172.21.15.110:0/4243634504 >> v2:172.21.15.110:3300/0 conn(0x7f2eb8156950 0x7f2eb80c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.967+0000 7f2eb67fc640 1 -- 172.21.15.110:0/4243634504 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369922011 0 0) 0x7f2eb80c7300 con 0x7f2eb806ee90 2024-04-22T01:11:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.967+0000 7f2eb67fc640 1 -- 172.21.15.110:0/4243634504 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e98003530 con 0x7f2eb806ee90 2024-04-22T01:11:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.971+0000 7f2eaffff640 1 -- 172.21.15.110:0/4243634504 >> v1:172.21.15.154:6789/0 conn(0x7f2eb8150c20 legacy=0x7f2eb80c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.971+0000 7f2eaffff640 1 -- 172.21.15.110:0/4243634504 >> v1:172.21.15.110:6789/0 conn(0x7f2eb806ee90 legacy=0x7f2eb81612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.971+0000 7f2eaffff640 1 -- 172.21.15.110:0/4243634504 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb80c5080 con 0x7f2eb8156950 2024-04-22T01:11:53.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.975+0000 7f2eaffff640 1 --2- 172.21.15.110:0/4243634504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8156950 0x7f2eb80c2c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000a960 tx=0x7f2ea0020020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2427aebfc1e52a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:53.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.975+0000 7f2eb67fc640 1 -- 172.21.15.110:0/4243634504 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00b6070 con 0x7f2eb8156950 2024-04-22T01:11:53.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.975+0000 7f2eb67fc640 1 -- 172.21.15.110:0/4243634504 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2ea00a9e30 con 0x7f2eb8156950 2024-04-22T01:11:53.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.975+0000 7f2eb67fc640 1 -- 172.21.15.110:0/4243634504 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000b040 con 0x7f2eb8156950 2024-04-22T01:11:53.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/4243634504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8156950 msgr2=0x7f2eb80c2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/4243634504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8156950 0x7f2eb80c2c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000a960 tx=0x7f2ea0020020 comp rx=0 tx=0).stop 2024-04-22T01:11:53.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/4243634504 shutdown_connections 2024-04-22T01:11:53.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/4243634504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8156950 0x7f2eb80c2c10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/4243634504 >> 172.21.15.110:0/4243634504 conn(0x7f2eb80cb710 msgr2=0x7f2eb80cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:53.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/4243634504 shutdown_connections 2024-04-22T01:11:53.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/4243634504 wait complete. 2024-04-22T01:11:53.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 Processor -- start 2024-04-22T01:11:53.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- start start 2024-04-22T01:11:53.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb806ee90 0x7f2eb814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8150c20 0x7f2eb81eec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb8156950 0x7f2eb81dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:53.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8151000 con 0x7f2eb8150c20 2024-04-22T01:11:53.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80c75a0 con 0x7f2eb8156950 2024-04-22T01:11:53.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2ebd4e7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb80c24a0 con 0x7f2eb806ee90 2024-04-22T01:11:53.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2eaffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8150c20 0x7f2eb81eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:53.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2eaffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8150c20 0x7f2eb81eec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51538/0 (socket says 172.21.15.110:51538) 2024-04-22T01:11:53.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.979+0000 7f2eaffff640 1 -- 172.21.15.110:0/1396849502 learned_addr learned my addr 172.21.15.110:0/1396849502 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:53.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.983+0000 7f2eaffff640 1 -- 172.21.15.110:0/1396849502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb806ee90 msgr2=0x7f2eb814a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.983+0000 7f2eaffff640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb806ee90 0x7f2eb814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.983+0000 7f2eaffff640 1 -- 172.21.15.110:0/1396849502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb8156950 msgr2=0x7f2eb81dffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:53.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.983+0000 7f2eaffff640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb8156950 0x7f2eb81dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:53.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.983+0000 7f2eaffff640 1 -- 172.21.15.110:0/1396849502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb8148ec0 con 0x7f2eb8150c20 2024-04-22T01:11:53.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.987+0000 7f2eaffff640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8150c20 0x7f2eb81eec00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ea001cc30 tx=0x7f2ea001cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:53.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.987+0000 7f2eaf7fe640 1 -- 172.21.15.110:0/1396849502 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00b6040 con 0x7f2eb8150c20 2024-04-22T01:11:53.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.991+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb81491a0 con 0x7f2eb8150c20 2024-04-22T01:11:53.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.991+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb8149760 con 0x7f2eb8150c20 2024-04-22T01:11:53.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.991+0000 7f2eaf7fe640 1 -- 172.21.15.110:0/1396849502 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2ea0000e50 con 0x7f2eb8150c20 2024-04-22T01:11:53.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.991+0000 7f2eaf7fe640 1 -- 172.21.15.110:0/1396849502 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00c4410 con 0x7f2eb8150c20 2024-04-22T01:11:53.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:53.991+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb804f510 con 0x7f2eb8150c20 2024-04-22T01:11:54.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.011+0000 7f2eaf7fe640 1 -- 172.21.15.110:0/1396849502 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ea00c45b0 con 0x7f2eb8150c20 2024-04-22T01:11:54.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.011+0000 7f2eaf7fe640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e9c0678c0 0x7f2e9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:54.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.011+0000 7f2eb6ffd640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e9c0678c0 0x7f2e9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:54.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.011+0000 7f2eb6ffd640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e9c0678c0 0x7f2e9c069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8007fd0 tx=0x7f2ea80079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:54.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.275+0000 7f2eaf7fe640 1 -- 172.21.15.110:0/1396849502 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2ea00f2950 con 0x7f2eb8150c20 2024-04-22T01:11:54.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.275+0000 7f2eaf7fe640 1 -- 172.21.15.110:0/1396849502 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f2ea0019b80 con 0x7f2eb8150c20 2024-04-22T01:11:54.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.447+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2eb80c3260 con 0x7f2eb8150c20 2024-04-22T01:11:54.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2eaf7fe640 1 -- 172.21.15.110:0/1396849502 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16682 (secure 0 0 0) 0x7f2ea00f4fb0 con 0x7f2eb8150c20 2024-04-22T01:11:54.534 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-22T01:11:54.534 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"937714ee-3114-4e7a-bad0-9e54f3261824","created":"2024-04-21T22:52:33.777601+0000","modified":"2024-04-21T22:54:44.154650+0000","last_up_change":"2024-04-21T22:52:53.477519+0000","last_in_change":"2024-04-21T22:52:43.609435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:52:54.296733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:53:35.338548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:53:36.666246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0ad6034-326d-43a8-89d7-155ba7bbbebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6827","nonce":2616906515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6829","nonce":2616906515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6833","nonce":2616906515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2616906515},{"type":"v1","addr":"172.21.15.110:6831","nonce":2616906515}]},"public_addr":"172.21.15.110:6827/2616906515","cluster_addr":"172.21.15.110:6829/2616906515","heartbeat_back_addr":"172.21.15.110:6833/2616906515","heartbeat_front_addr":"172.21.15.110:6831/2616906515","state":["exists","up"]},{"osd":1,"uuid":"1c92af9e-f6a1-4140-9eef-edc99ad1c868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6811","nonce":3951369001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6813","nonce":3951369001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6817","nonce":3951369001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3951369001},{"type":"v1","addr":"172.21.15.110:6815","nonce":3951369001}]},"public_addr":"172.21.15.110:6811/3951369001","cluster_addr":"172.21.15.110:6813/3951369001","heartbeat_back_addr":"172.21.15.110:6817/3951369001","heartbeat_front_addr":"172.21.15.110:6815/3951369001","state":["exists","up"]},{"osd":2,"uuid":"72b6c77e-64b7-433e-a633-5dba71d0b398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6803","nonce":2146442210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6805","nonce":2146442210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6809","nonce":2146442210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2146442210},{"type":"v1","addr":"172.21.15.110:6807","nonce":2146442210}]},"public_addr":"172.21.15.110:6803/2146442210","cluster_addr":"172.21.15.110:6805/2146442210","heartbeat_back_addr":"172.21.15.110:6809/2146442210","heartbeat_front_addr":"172.21.15.110:6807/2146442210","state":["exists","up"]},{"osd":3,"uuid":"a95f70c3-76f1-4d46-97ed-1ed4582803e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6819","nonce":888134246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6821","nonce":888134246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6825","nonce":888134246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":888134246},{"type":"v1","addr":"172.21.15.110:6823","nonce":888134246}]},"public_addr":"172.21.15.110:6819/888134246","cluster_addr":"172.21.15.110:6821/888134246","heartbeat_back_addr":"172.21.15.110:6825/888134246","heartbeat_front_addr":"172.21.15.110:6823/888134246","state":["exists","up"]},{"osd":4,"uuid":"7578002a-8aec-4fe4-b5f5-d14527a05758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6825","nonce":2160786358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6827","nonce":2160786358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6831","nonce":2160786358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2160786358},{"type":"v1","addr":"172.21.15.154:6829","nonce":2160786358}]},"public_addr":"172.21.15.154:6825/2160786358","cluster_addr":"172.21.15.154:6827/2160786358","heartbeat_back_addr":"172.21.15.154:6831/2160786358","heartbeat_front_addr":"172.21.15.154:6829/2160786358","state":["exists","up"]},{"osd":5,"uuid":"fc7ff7a6-9fb4-4b30-bc3d-5daaeca577ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6805","nonce":828597106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6809","nonce":828597106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6815","nonce":828597106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":828597106},{"type":"v1","addr":"172.21.15.154:6813","nonce":828597106}]},"public_addr":"172.21.15.154:6805/828597106","cluster_addr":"172.21.15.154:6809/828597106","heartbeat_back_addr":"172.21.15.154:6815/828597106","heartbeat_front_addr":"172.21.15.154:6813/828597106","state":["exists","up"]},{"osd":6,"uuid":"04879f48-085f-4926-a995-c4e1af1d600e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6801","nonce":847095598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6804","nonce":847095598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6812","nonce":847095598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":847095598},{"type":"v1","addr":"172.21.15.154:6808","nonce":847095598}]},"public_addr":"172.21.15.154:6801/847095598","cluster_addr":"172.21.15.154:6804/847095598","heartbeat_back_addr":"172.21.15.154:6812/847095598","heartbeat_front_addr":"172.21.15.154:6808/847095598","state":["exists","up"]},{"osd":7,"uuid":"1d703942-79e0-4e05-9660-535cb4c620a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6817","nonce":2454373145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6819","nonce":2454373145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6823","nonce":2454373145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2454373145},{"type":"v1","addr":"172.21.15.154:6821","nonce":2454373145}]},"public_addr":"172.21.15.154:6817/2454373145","cluster_addr":"172.21.15.154:6819/2454373145","heartbeat_back_addr":"172.21.15.154:6823/2454373145","heartbeat_front_addr":"172.21.15.154:6821/2454373145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.798683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.520705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.515985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.634711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.611378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.441759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.582243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:52:49.519325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e9c0678c0 msgr2=0x7f2e9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e9c0678c0 0x7f2e9c069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8007fd0 tx=0x7f2ea80079a0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8150c20 msgr2=0x7f2eb81eec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8150c20 0x7f2eb81eec00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ea001cc30 tx=0x7f2ea001cdc0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 shutdown_connections 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f2e9c0678c0 0x7f2e9c069d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb8156950 0x7f2eb81dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb8150c20 0x7f2eb81eec00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 --2- 172.21.15.110:0/1396849502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb806ee90 0x7f2eb814a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 >> 172.21.15.110:0/1396849502 conn(0x7f2eb80cb710 msgr2=0x7f2eb80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:54.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 shutdown_connections 2024-04-22T01:11:54.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.531+0000 7f2ebd4e7640 1 -- 172.21.15.110:0/1396849502 wait complete. 2024-04-22T01:11:54.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-22T01:11:54.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83d120d640 1 Processor -- start 2024-04-22T01:11:54.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83d120d640 1 -- start start 2024-04-22T01:11:54.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83d120d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83cc156950 0x7f83cc0c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:54.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83d120d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc06ee90 0x7f83cc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:54.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83d120d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83cc0c7300 con 0x7f83cc150c20 2024-04-22T01:11:54.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83d120d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc0c5640 con 0x7f83cc156950 2024-04-22T01:11:54.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83d120d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc0c4da0 con 0x7f83cc06ee90 2024-04-22T01:11:54.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83cad9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f83cc150c20 0x7f83cc0c7ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45538/0 (socket says 172.21.15.110:45538) 2024-04-22T01:11:54.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83cad9d640 1 -- 172.21.15.110:0/2062903146 learned_addr learned my addr 172.21.15.110:0/2062903146 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:54.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83cb59e640 1 --2- 172.21.15.110:0/2062903146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc06ee90 0x7f83cc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:54.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.691+0000 7f83ca59c640 1 --2- 172.21.15.110:0/2062903146 >> v2:172.21.15.154:3300/0 conn(0x7f83cc156950 0x7f83cc0c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:54.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.695+0000 7f83c9d9b640 1 -- 172.21.15.110:0/2062903146 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137196156 0 0) 0x7f83cc0c7300 con 0x7f83cc150c20 2024-04-22T01:11:54.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.695+0000 7f83c9d9b640 1 -- 172.21.15.110:0/2062903146 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b4003530 con 0x7f83cc150c20 2024-04-22T01:11:54.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.699+0000 7f83cb59e640 1 -- 172.21.15.110:0/2062903146 >> v2:172.21.15.154:3300/0 conn(0x7f83cc156950 msgr2=0x7f83cc0c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:54.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.699+0000 7f83cb59e640 1 --2- 172.21.15.110:0/2062903146 >> v2:172.21.15.154:3300/0 conn(0x7f83cc156950 0x7f83cc0c2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.699+0000 7f83cb59e640 1 -- 172.21.15.110:0/2062903146 >> v1:172.21.15.110:6789/0 conn(0x7f83cc150c20 legacy=0x7f83cc0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:54.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.699+0000 7f83cb59e640 1 -- 172.21.15.110:0/2062903146 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc0c5080 con 0x7f83cc06ee90 2024-04-22T01:11:54.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.707+0000 7f83cb59e640 1 --2- 172.21.15.110:0/2062903146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc06ee90 0x7f83cc06f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83c400aea0 tx=0x7f83c4020260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5b82687c32ffac server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:54.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83c9d9b640 1 -- 172.21.15.110:0/2062903146 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c40b5070 con 0x7f83cc06ee90 2024-04-22T01:11:54.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83c9d9b640 1 -- 172.21.15.110:0/2062903146 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f83c4008440 con 0x7f83cc06ee90 2024-04-22T01:11:54.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83c9d9b640 1 -- 172.21.15.110:0/2062903146 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4008830 con 0x7f83cc06ee90 2024-04-22T01:11:54.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 -- 172.21.15.110:0/2062903146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc06ee90 msgr2=0x7f83cc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:54.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 --2- 172.21.15.110:0/2062903146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc06ee90 0x7f83cc06f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83c400aea0 tx=0x7f83c4020260 comp rx=0 tx=0).stop 2024-04-22T01:11:54.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 -- 172.21.15.110:0/2062903146 shutdown_connections 2024-04-22T01:11:54.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 --2- 172.21.15.110:0/2062903146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc06ee90 0x7f83cc06f320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 --2- 172.21.15.110:0/2062903146 >> v2:172.21.15.154:3300/0 conn(0x7f83cc156950 0x7f83cc0c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 -- 172.21.15.110:0/2062903146 >> 172.21.15.110:0/2062903146 conn(0x7f83cc0cb710 msgr2=0x7f83cc0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:54.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 -- 172.21.15.110:0/2062903146 shutdown_connections 2024-04-22T01:11:54.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.715+0000 7f83d120d640 1 -- 172.21.15.110:0/2062903146 wait complete. 2024-04-22T01:11:54.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 Processor -- start 2024-04-22T01:11:54.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 -- start start 2024-04-22T01:11:54.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83cc06ee90 0x7f83cc0c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:54.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc150c20 0x7f83cc0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:54.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83cc156950 0x7f83cc0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:54.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc151000 con 0x7f83cc06ee90 2024-04-22T01:11:54.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0c75a0 con 0x7f83cc156950 2024-04-22T01:11:54.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83d120d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc0c24a0 con 0x7f83cc150c20 2024-04-22T01:11:54.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83cad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83cc06ee90 0x7f83cc0c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:54.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83cad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83cc06ee90 0x7f83cc0c1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51550/0 (socket says 172.21.15.110:51550) 2024-04-22T01:11:54.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83cad9d640 1 -- 172.21.15.110:0/1529015148 learned_addr learned my addr 172.21.15.110:0/1529015148 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:54.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.719+0000 7f83cb59e640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83cc156950 0x7f83cc0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:54.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.723+0000 7f83ca59c640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc150c20 0x7f83cc0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:54.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.723+0000 7f83cad9d640 1 -- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc150c20 msgr2=0x7f83cc0c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:54.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.723+0000 7f83cad9d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc150c20 0x7f83cc0c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.723+0000 7f83cad9d640 1 -- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83cc156950 msgr2=0x7f83cc0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:54.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.723+0000 7f83cad9d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83cc156950 0x7f83cc0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:54.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.723+0000 7f83cad9d640 1 -- 172.21.15.110:0/1529015148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc06fa40 con 0x7f83cc06ee90 2024-04-22T01:11:54.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.727+0000 7f83cad9d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83cc06ee90 0x7f83cc0c1680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c480 tx=0x7f83bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:54.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.731+0000 7f83b37fe640 1 -- 172.21.15.110:0/1529015148 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc017070 con 0x7f83cc06ee90 2024-04-22T01:11:54.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.731+0000 7f83b37fe640 1 -- 172.21.15.110:0/1529015148 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f83bc005cf0 con 0x7f83cc06ee90 2024-04-22T01:11:54.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.731+0000 7f83b37fe640 1 -- 172.21.15.110:0/1529015148 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0072b0 con 0x7f83cc06ee90 2024-04-22T01:11:54.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.731+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc140520 con 0x7f83cc06ee90 2024-04-22T01:11:54.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.731+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc0cb2c0 con 0x7f83cc06ee90 2024-04-22T01:11:54.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.731+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc04f510 con 0x7f83cc06ee90 2024-04-22T01:11:54.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.751+0000 7f83b37fe640 1 -- 172.21.15.110:0/1529015148 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83bc01a070 con 0x7f83cc06ee90 2024-04-22T01:11:54.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.751+0000 7f83b37fe640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f83b8067910 0x7f83b8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:54.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.751+0000 7f83ca59c640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f83b8067910 0x7f83b8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:54.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:54.751+0000 7f83ca59c640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f83b8067910 0x7f83b8069dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f83cc142bf0 tx=0x7f83c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:55.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.031+0000 7f83b37fe640 1 -- 172.21.15.110:0/1529015148 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f83bc053a50 con 0x7f83cc06ee90 2024-04-22T01:11:55.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.031+0000 7f83b37fe640 1 -- 172.21.15.110:0/1529015148 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f83bc021020 con 0x7f83cc06ee90 2024-04-22T01:11:55.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.255+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f83cc0cb500 con 0x7f83cc06ee90 2024-04-22T01:11:55.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.663+0000 7f83b37fe640 1 -- 172.21.15.110:0/1529015148 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f83cc06fa40 con 0x7f83cc06ee90 2024-04-22T01:11:55.663 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-22T01:11:55.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f83b8067910 msgr2=0x7f83b8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:55.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f83b8067910 0x7f83b8069dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f83cc142bf0 tx=0x7f83c0008040 comp rx=0 tx=0).stop 2024-04-22T01:11:55.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83cc06ee90 msgr2=0x7f83cc0c1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:55.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83cc06ee90 0x7f83cc0c1680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c480 tx=0x7f83bc00c940 comp rx=0 tx=0).stop 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 shutdown_connections 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f83b8067910 0x7f83b8069dd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83cc156950 0x7f83cc0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83cc150c20 0x7f83cc0c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 --2- 172.21.15.110:0/1529015148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83cc06ee90 0x7f83cc0c1680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 >> 172.21.15.110:0/1529015148 conn(0x7f83cc0cb710 msgr2=0x7f83cc0744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 shutdown_connections 2024-04-22T01:11:55.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.667+0000 7f83d120d640 1 -- 172.21.15.110:0/1529015148 wait complete. 2024-04-22T01:11:55.688 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-22T01:11:55.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 Processor -- start 2024-04-22T01:11:55.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 -- start start 2024-04-22T01:11:55.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4840154550 0x7f484006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:55.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4840061ff0 0x7f48400c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:55.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f484006f390 0x7f484006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:55.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f48400c8020 con 0x7f484006f390 2024-04-22T01:11:55.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f48400c89f0 con 0x7f4840154550 2024-04-22T01:11:55.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4848633640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4840154930 con 0x7f4840061ff0 2024-04-22T01:11:55.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4846bd0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f484006f390 0x7f484006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:55.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4846bd0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f484006f390 0x7f484006de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51554/0 (socket says 172.21.15.110:51554) 2024-04-22T01:11:55.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.819+0000 7f4846bd0640 1 -- 172.21.15.110:0/4169872727 learned_addr learned my addr 172.21.15.110:0/4169872727 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:55.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.823+0000 7f4846bd0640 1 -- 172.21.15.110:0/4169872727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4840061ff0 msgr2=0x7f48400c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:55.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.823+0000 7f4846bd0640 1 --2- 172.21.15.110:0/4169872727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4840061ff0 0x7f48400c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.823+0000 7f4846bd0640 1 -- 172.21.15.110:0/4169872727 >> v2:172.21.15.154:3300/0 conn(0x7f4840154550 msgr2=0x7f484006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:55.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.823+0000 7f4846bd0640 1 --2- 172.21.15.110:0/4169872727 >> v2:172.21.15.154:3300/0 conn(0x7f4840154550 0x7f484006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.823+0000 7f4846bd0640 1 -- 172.21.15.110:0/4169872727 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484015ae30 con 0x7f484006f390 2024-04-22T01:11:55.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.827+0000 7f4846bd0640 1 --2- 172.21.15.110:0/4169872727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f484006f390 0x7f484006de70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f48400628d0 tx=0x7f483c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca725da10b395f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:55.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f48453cd640 1 -- 172.21.15.110:0/4169872727 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c0b5070 con 0x7f484006f390 2024-04-22T01:11:55.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f48453cd640 1 -- 172.21.15.110:0/4169872727 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f483c0a89d0 con 0x7f484006f390 2024-04-22T01:11:55.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f48453cd640 1 -- 172.21.15.110:0/4169872727 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c0a8dc0 con 0x7f484006f390 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 -- 172.21.15.110:0/4169872727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f484006f390 msgr2=0x7f484006de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 --2- 172.21.15.110:0/4169872727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f484006f390 0x7f484006de70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f48400628d0 tx=0x7f483c01ed10 comp rx=0 tx=0).stop 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 -- 172.21.15.110:0/4169872727 shutdown_connections 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 --2- 172.21.15.110:0/4169872727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f484006f390 0x7f484006de70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 --2- 172.21.15.110:0/4169872727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4840061ff0 0x7f48400c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 --2- 172.21.15.110:0/4169872727 >> v2:172.21.15.154:3300/0 conn(0x7f4840154550 0x7f484006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 -- 172.21.15.110:0/4169872727 >> 172.21.15.110:0/4169872727 conn(0x7f48400cc250 msgr2=0x7f48400cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 -- 172.21.15.110:0/4169872727 shutdown_connections 2024-04-22T01:11:55.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 -- 172.21.15.110:0/4169872727 wait complete. 2024-04-22T01:11:55.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 Processor -- start 2024-04-22T01:11:55.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.831+0000 7f4848633640 1 -- start start 2024-04-22T01:11:55.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4848633640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840061ff0 0x7f48401f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:55.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4848633640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f484006f390 0x7f484014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:55.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4848633640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4840154550 0x7f484006b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:55.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4848633640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f48400c79d0 con 0x7f4840061ff0 2024-04-22T01:11:55.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4848633640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48400c76f0 con 0x7f4840154550 2024-04-22T01:11:55.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4848633640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f48400c7cb0 con 0x7f484006f390 2024-04-22T01:11:55.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4845bce640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f484006f390 0x7f484014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:55.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4845bce640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f484006f390 0x7f484014d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:51310/0 (socket says 172.21.15.110:51310) 2024-04-22T01:11:55.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.835+0000 7f4845bce640 1 -- 172.21.15.110:0/756503208 learned_addr learned my addr 172.21.15.110:0/756503208 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:55.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.839+0000 7f4845bce640 1 -- 172.21.15.110:0/756503208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4840154550 msgr2=0x7f484006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:55.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.839+0000 7f4845bce640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4840154550 0x7f484006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.839+0000 7f4845bce640 1 -- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840061ff0 msgr2=0x7f48401f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:55.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.839+0000 7f4845bce640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840061ff0 0x7f48401f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:55.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.839+0000 7f4845bce640 1 -- 172.21.15.110:0/756503208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48401f44d0 con 0x7f484006f390 2024-04-22T01:11:55.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.843+0000 7f4845bce640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f484006f390 0x7f484014d6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f483000b580 tx=0x7f483000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:55.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.851+0000 7f4836ffd640 1 -- 172.21.15.110:0/756503208 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830015020 con 0x7f484006f390 2024-04-22T01:11:55.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.851+0000 7f4836ffd640 1 -- 172.21.15.110:0/756503208 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f48300118b0 con 0x7f484006f390 2024-04-22T01:11:55.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.851+0000 7f4836ffd640 1 -- 172.21.15.110:0/756503208 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830011cc0 con 0x7f484006f390 2024-04-22T01:11:55.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.855+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48401e54c0 con 0x7f484006f390 2024-04-22T01:11:55.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.855+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48401e5a80 con 0x7f484006f390 2024-04-22T01:11:55.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:55.855+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f484004f510 con 0x7f484006f390 2024-04-22T01:11:56.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:56.151+0000 7f4836ffd640 1 -- 172.21.15.110:0/756503208 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4830018020 con 0x7f484006f390 2024-04-22T01:11:56.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:56.151+0000 7f4836ffd640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4824067940 0x7f4824069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:56.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:56.151+0000 7f48463cf640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4824067940 0x7f4824069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:56.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:56.151+0000 7f48463cf640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4824067940 0x7f4824069e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f483800ab90 tx=0x7f4838009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:56.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:56.167+0000 7f4836ffd640 1 -- 172.21.15.110:0/756503208 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5824+0+0 (secure 0 0 0) 0x7f4830054870 con 0x7f484006f390 2024-04-22T01:11:56.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:56.191+0000 7f4836ffd640 1 -- 172.21.15.110:0/756503208 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f483001f020 con 0x7f484006f390 2024-04-22T01:11:56.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:56.395+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4840157c50 con 0x7f484006f390 2024-04-22T01:11:57.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.703+0000 7f4836ffd640 1 -- 172.21.15.110:0/756503208 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f483000d040 con 0x7f484006f390 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4824067940 msgr2=0x7f4824069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4824067940 0x7f4824069e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f483800ab90 tx=0x7f4838009250 comp rx=0 tx=0).stop 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f484006f390 msgr2=0x7f484014d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f484006f390 0x7f484014d6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f483000b580 tx=0x7f483000ba40 comp rx=0 tx=0).stop 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 shutdown_connections 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f4824067940 0x7f4824069e00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4840154550 0x7f484006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f484006f390 0x7f484014d6c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 --2- 172.21.15.110:0/756503208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840061ff0 0x7f48401f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 >> 172.21.15.110:0/756503208 conn(0x7f48400cc250 msgr2=0x7f48400c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 shutdown_connections 2024-04-22T01:11:57.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.707+0000 7f4848633640 1 -- 172.21.15.110:0/756503208 wait complete. 2024-04-22T01:11:57.729 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-22T01:11:57.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 Processor -- start 2024-04-22T01:11:57.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 -- start start 2024-04-22T01:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68a0154300 0x7f68a015e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68a01546e0 0x7f68a00c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a00ca3b0 0x7f68a006f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f68a015e670 con 0x7f68a01546e0 2024-04-22T01:11:57.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f68a006db50 con 0x7f68a0154300 2024-04-22T01:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a6dfd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f68a006dfe0 con 0x7f68a00ca3b0 2024-04-22T01:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f689ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68a01546e0 0x7f68a00c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:57.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f689ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68a01546e0 0x7f68a00c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51570/0 (socket says 172.21.15.110:51570) 2024-04-22T01:11:57.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f689ffff640 1 -- 172.21.15.110:0/1000277928 learned_addr learned my addr 172.21.15.110:0/1000277928 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:57.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.851+0000 7f68a4b99640 1 --2- 172.21.15.110:0/1000277928 >> v2:172.21.15.154:3300/0 conn(0x7f68a0154300 0x7f68a015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:57.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.855+0000 7f689ffff640 1 -- 172.21.15.110:0/1000277928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a00ca3b0 msgr2=0x7f68a006f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:57.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.855+0000 7f689ffff640 1 --2- 172.21.15.110:0/1000277928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a00ca3b0 0x7f68a006f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.855+0000 7f689ffff640 1 -- 172.21.15.110:0/1000277928 >> v2:172.21.15.154:3300/0 conn(0x7f68a0154300 msgr2=0x7f68a015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:57.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.855+0000 7f689ffff640 1 --2- 172.21.15.110:0/1000277928 >> v2:172.21.15.154:3300/0 conn(0x7f68a0154300 0x7f68a015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.855+0000 7f689ffff640 1 -- 172.21.15.110:0/1000277928 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a00c8d40 con 0x7f68a01546e0 2024-04-22T01:11:57.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.859+0000 7f689ffff640 1 --2- 172.21.15.110:0/1000277928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a01546e0 0x7f68a00c9e70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b3d90 tx=0x7f688801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8d6c049f2a3493 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:57.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f689f7fe640 1 -- 172.21.15.110:0/1000277928 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68880ab5f0 con 0x7f68a01546e0 2024-04-22T01:11:57.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f689f7fe640 1 -- 172.21.15.110:0/1000277928 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f68880b0070 con 0x7f68a01546e0 2024-04-22T01:11:57.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f689f7fe640 1 -- 172.21.15.110:0/1000277928 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68880ab9d0 con 0x7f68a01546e0 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 -- 172.21.15.110:0/1000277928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a01546e0 msgr2=0x7f68a00c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/1000277928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a01546e0 0x7f68a00c9e70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b3d90 tx=0x7f688801c520 comp rx=0 tx=0).stop 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 -- 172.21.15.110:0/1000277928 shutdown_connections 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/1000277928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a00ca3b0 0x7f68a006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/1000277928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a01546e0 0x7f68a00c9e70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/1000277928 >> v2:172.21.15.154:3300/0 conn(0x7f68a0154300 0x7f68a015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 -- 172.21.15.110:0/1000277928 >> 172.21.15.110:0/1000277928 conn(0x7f68a00714b0 msgr2=0x7f68a00718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 -- 172.21.15.110:0/1000277928 shutdown_connections 2024-04-22T01:11:57.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.863+0000 7f68a6dfd640 1 -- 172.21.15.110:0/1000277928 wait complete. 2024-04-22T01:11:57.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 Processor -- start 2024-04-22T01:11:57.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 -- start start 2024-04-22T01:11:57.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00ca3b0 0x7f68a014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:57.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a0154300 0x7f68a013c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:57.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a01546e0 0x7f68a0147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:57.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00c8a80 con 0x7f68a00ca3b0 2024-04-22T01:11:57.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00c8900 con 0x7f68a01546e0 2024-04-22T01:11:57.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a6dfd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f68a015a190 con 0x7f68a0154300 2024-04-22T01:11:57.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a4b99640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00ca3b0 0x7f68a014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:57.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a4b99640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00ca3b0 0x7f68a014edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51584/0 (socket says 172.21.15.110:51584) 2024-04-22T01:11:57.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a4b99640 1 -- 172.21.15.110:0/3047181853 learned_addr learned my addr 172.21.15.110:0/3047181853 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:57.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.867+0000 7f68a539a640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a01546e0 0x7f68a0147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:57.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.871+0000 7f68a4b99640 1 -- 172.21.15.110:0/3047181853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a0154300 msgr2=0x7f68a013c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:57.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.871+0000 7f68a4b99640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a0154300 0x7f68a013c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.871+0000 7f68a4b99640 1 -- 172.21.15.110:0/3047181853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a01546e0 msgr2=0x7f68a0147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:57.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.871+0000 7f68a4b99640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a01546e0 0x7f68a0147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:57.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.871+0000 7f68a4b99640 1 -- 172.21.15.110:0/3047181853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a013cd10 con 0x7f68a00ca3b0 2024-04-22T01:11:57.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.875+0000 7f68a4b99640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00ca3b0 0x7f68a014edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6898007ef0 tx=0x7f689800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.891+0000 7f689d7fa640 1 -- 172.21.15.110:0/3047181853 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898014620 con 0x7f68a00ca3b0 2024-04-22T01:11:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.891+0000 7f689d7fa640 1 -- 172.21.15.110:0/3047181853 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6898019070 con 0x7f68a00ca3b0 2024-04-22T01:11:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.891+0000 7f689d7fa640 1 -- 172.21.15.110:0/3047181853 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898014a20 con 0x7f68a00ca3b0 2024-04-22T01:11:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.891+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a0159490 con 0x7f68a00ca3b0 2024-04-22T01:11:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.891+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a0159a50 con 0x7f68a00ca3b0 2024-04-22T01:11:57.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.891+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a00685b0 con 0x7f68a00ca3b0 2024-04-22T01:11:57.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.915+0000 7f689d7fa640 1 -- 172.21.15.110:0/3047181853 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6898014bc0 con 0x7f68a00ca3b0 2024-04-22T01:11:57.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.915+0000 7f689d7fa640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f68800678c0 0x7f6880069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:57.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.915+0000 7f689ffff640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f68800678c0 0x7f6880069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:57.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:57.915+0000 7f689ffff640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f68800678c0 0x7f6880069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f68880af000 tx=0x7f6888004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:58.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.199+0000 7f689d7fa640 1 -- 172.21.15.110:0/3047181853 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5824+0+0 (secure 0 0 0) 0x7f6898055920 con 0x7f68a00ca3b0 2024-04-22T01:11:58.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.203+0000 7f689d7fa640 1 -- 172.21.15.110:0/3047181853 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f6898057f80 con 0x7f68a00ca3b0 2024-04-22T01:11:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.379+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f68a01400f0 con 0x7f68a00ca3b0 2024-04-22T01:11:58.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.831+0000 7f689d7fa640 1 -- 172.21.15.110:0/3047181853 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f6898057880 con 0x7f68a00ca3b0 2024-04-22T01:11:58.832 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' removed 2024-04-22T01:11:58.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f68800678c0 msgr2=0x7f6880069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:58.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f68800678c0 0x7f6880069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f68880af000 tx=0x7f6888004740 comp rx=0 tx=0).stop 2024-04-22T01:11:58.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00ca3b0 msgr2=0x7f68a014edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00ca3b0 0x7f68a014edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6898007ef0 tx=0x7f689800e4b0 comp rx=0 tx=0).stop 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 shutdown_connections 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f68800678c0 0x7f6880069d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a01546e0 0x7f68a0147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68a0154300 0x7f68a013c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 --2- 172.21.15.110:0/3047181853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00ca3b0 0x7f68a014edb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 >> 172.21.15.110:0/3047181853 conn(0x7f68a00714b0 msgr2=0x7f68a015a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 shutdown_connections 2024-04-22T01:11:58.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.835+0000 7f68a6dfd640 1 -- 172.21.15.110:0/3047181853 wait complete. 2024-04-22T01:11:58.860 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-22T01:11:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecfb7e640 1 Processor -- start 2024-04-22T01:11:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecfb7e640 1 -- start start 2024-04-22T01:11:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecfb7e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ec8154290 0x7f5ec80c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecfb7e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec8154670 con 0x7f5ec8070cc0 2024-04-22T01:11:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecfb7e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec815ad70 con 0x7f5ec815a1e0 2024-04-22T01:11:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecfb7e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec815e100 con 0x7f5ec8154290 2024-04-22T01:11:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecd119640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5ec8070cc0 0x7f5ec80c9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45548/0 (socket says 172.21.15.110:45548) 2024-04-22T01:11:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.983+0000 7f5ecd119640 1 -- 172.21.15.110:0/222026908 learned_addr learned my addr 172.21.15.110:0/222026908 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-04-22T01:11:58.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.991+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610120291 0 0) 0x7f5ec8154670 con 0x7f5ec8070cc0 2024-04-22T01:11:58.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:58.991+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb0003530 con 0x7f5ec8070cc0 2024-04-22T01:11:59.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1757160466 0 0) 0x7f5eb0003530 con 0x7f5ec8070cc0 2024-04-22T01:11:59.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 >> v2:172.21.15.154:3300/0 conn(0x7f5ec8154290 msgr2=0x7f5ec80c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:59.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 --2- 172.21.15.110:0/222026908 >> v2:172.21.15.154:3300/0 conn(0x7f5ec8154290 0x7f5ec80c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 >> v1:172.21.15.154:6789/0 conn(0x7f5ec815a1e0 legacy=0x7f5ec8164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec815b050 con 0x7f5ec8070cc0 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1628418205 0 0) 0x7f5ebc001680 con 0x7f5ec8070cc0 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 >> v1:172.21.15.110:6789/0 conn(0x7f5ec8070cc0 legacy=0x7f5ec80c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb0003a10 0x7f5eb0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb00052f0 0x7f5eb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec815e100 con 0x7f5eb0003a10 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb000c230 con 0x7f5eb00052f0 2024-04-22T01:11:59.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.003+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb000c430 con 0x7f5eb0004810 2024-04-22T01:11:59.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.007+0000 7f5ecd119640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:59.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ecd91a640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb0003a10 0x7f5eb0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:59.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ecd119640 1 -- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb00052f0 msgr2=0x7f5eb000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:59.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ecd119640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb00052f0 0x7f5eb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:59.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ecd119640 1 -- 172.21.15.110:0/222026908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb0003a10 msgr2=0x7f5eb0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T01:11:59.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ecd119640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb0003a10 0x7f5eb0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:59.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ecd119640 1 -- 172.21.15.110:0/222026908 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb0003530 con 0x7f5eb0004810 2024-04-22T01:11:59.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ecd91a640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb0003a10 0x7f5eb0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T01:11:59.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.015+0000 7f5ece11b640 1 -- 172.21.15.110:0/222026908 reap_dead start 2024-04-22T01:11:59.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.023+0000 7f5ecd119640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00c0e0 tx=0x7f5ebc01f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd00a8b2f8883265 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.035+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc007c50 con 0x7f5eb0004810 2024-04-22T01:11:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.035+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5ebc0ac020 con 0x7f5eb0004810 2024-04-22T01:11:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.035+0000 7f5ecc918640 1 -- 172.21.15.110:0/222026908 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0058e0 con 0x7f5eb0004810 2024-04-22T01:11:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.035+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eb0004810 msgr2=0x7f5eb0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.035+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00c0e0 tx=0x7f5ebc01f2b0 comp rx=0 tx=0).stop 2024-04-22T01:11:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.039+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/222026908 shutdown_connections 2024-04-22T01:11:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.039+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/222026908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c90 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00c0e0 tx=0x7f5ebc01f2b0 comp rx=0 tx=0).stop 2024-04-22T01:11:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.039+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/222026908 >> 172.21.15.110:0/222026908 conn(0x7f5ec80cc9a0 msgr2=0x7f5ec80ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:11:59.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.043+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/222026908 shutdown_connections 2024-04-22T01:11:59.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.043+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/222026908 wait complete. 2024-04-22T01:11:59.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.043+0000 7f5ecfb7e640 1 Processor -- start 2024-04-22T01:11:59.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecfb7e640 1 -- start start 2024-04-22T01:11:59.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecfb7e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec814c510 0x7f5ec81f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:59.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecfb7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ec814c8f0 0x7f5ec8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:59.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecfb7e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ec81f8c00 0x7f5ec8151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:59.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecfb7e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec815dd90 con 0x7f5ec814c510 2024-04-22T01:11:59.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecfb7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec815dab0 con 0x7f5ec814c8f0 2024-04-22T01:11:59.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecfb7e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec815e590 con 0x7f5ec81f8c00 2024-04-22T01:11:59.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ece11b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ec81f8c00 0x7f5ec8151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:59.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ecd119640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ec814c8f0 0x7f5ec8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:59.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ece11b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ec81f8c00 0x7f5ec8151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.110:35924/0 (socket says 172.21.15.110:35924) 2024-04-22T01:11:59.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.047+0000 7f5ece11b640 1 -- 172.21.15.110:0/3339034500 learned_addr learned my addr 172.21.15.110:0/3339034500 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-22T01:11:59.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.051+0000 7f5ece11b640 1 -- 172.21.15.110:0/3339034500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ec814c8f0 msgr2=0x7f5ec8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:59.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.051+0000 7f5ece11b640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ec814c8f0 0x7f5ec8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:59.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.051+0000 7f5ece11b640 1 -- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec814c510 msgr2=0x7f5ec81f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:11:59.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.051+0000 7f5ece11b640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec814c510 0x7f5ec81f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:11:59.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.051+0000 7f5ece11b640 1 -- 172.21.15.110:0/3339034500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec815cf10 con 0x7f5ec81f8c00 2024-04-22T01:11:59.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.055+0000 7f5ece11b640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ec81f8c00 0x7f5ec8151690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80cd9f0 tx=0x7f5ec000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:59.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.055+0000 7f5ec67fc640 1 -- 172.21.15.110:0/3339034500 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0007230 con 0x7f5ec81f8c00 2024-04-22T01:11:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.059+0000 7f5ec67fc640 1 -- 172.21.15.110:0/3339034500 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5ec0007410 con 0x7f5ec81f8c00 2024-04-22T01:11:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.059+0000 7f5ec67fc640 1 -- 172.21.15.110:0/3339034500 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0004a00 con 0x7f5ec81f8c00 2024-04-22T01:11:59.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.063+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec815d1f0 con 0x7f5ec81f8c00 2024-04-22T01:11:59.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.063+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec81f4de0 con 0x7f5ec81f8c00 2024-04-22T01:11:59.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.063+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec80c9d70 con 0x7f5ec81f8c00 2024-04-22T01:11:59.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.083+0000 7f5ec67fc640 1 -- 172.21.15.110:0/3339034500 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ec0004ba0 con 0x7f5ec81f8c00 2024-04-22T01:11:59.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.083+0000 7f5ec67fc640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5eb40678f0 0x7f5eb4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T01:11:59.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.083+0000 7f5ecd91a640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5eb40678f0 0x7f5eb4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T01:11:59.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.083+0000 7f5ecd91a640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5eb40678f0 0x7f5eb4069db0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007d50 tx=0x7f5eb8007260 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T01:11:59.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.331+0000 7f5ec67fc640 1 -- 172.21.15.110:0/3339034500 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5386+0+0 (secure 0 0 0) 0x7f5ec0053b10 con 0x7f5ec81f8c00 2024-04-22T01:11:59.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.343+0000 7f5ec67fc640 1 -- 172.21.15.110:0/3339034500 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177503 (secure 0 0 0) 0x7f5ec001b070 con 0x7f5ec81f8c00 2024-04-22T01:11:59.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:11:59.507+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5ec8154860 con 0x7f5ec81f8c00 2024-04-22T01:12:00.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.247+0000 7f5ec67fc640 1 -- 172.21.15.110:0/3339034500 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f5ec0055f10 con 0x7f5ec81f8c00 2024-04-22T01:12:00.246 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' removed 2024-04-22T01:12:00.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.247+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5eb40678f0 msgr2=0x7f5eb4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:12:00.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.247+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5eb40678f0 0x7f5eb4069db0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007d50 tx=0x7f5eb8007260 comp rx=0 tx=0).stop 2024-04-22T01:12:00.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.247+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ec81f8c00 msgr2=0x7f5ec8151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T01:12:00.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.247+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ec81f8c00 0x7f5ec8151690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80cd9f0 tx=0x7f5ec000c820 comp rx=0 tx=0).stop 2024-04-22T01:12:00.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 shutdown_connections 2024-04-22T01:12:00.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:6800/3950016020,v1:172.21.15.110:6801/3950016020] conn(0x7f5eb40678f0 0x7f5eb4069db0 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007d50 tx=0x7f5eb8007260 comp rx=0 tx=0).stop 2024-04-22T01:12:00.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ec81f8c00 0x7f5ec8151690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:12:00.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ec814c8f0 0x7f5ec8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:12:00.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 --2- 172.21.15.110:0/3339034500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ec814c510 0x7f5ec81f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T01:12:00.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 >> 172.21.15.110:0/3339034500 conn(0x7f5ec80cc9a0 msgr2=0x7f5ec8072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T01:12:00.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 shutdown_connections 2024-04-22T01:12:00.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-22T01:12:00.251+0000 7f5ecfb7e640 1 -- 172.21.15.110:0/3339034500 wait complete. 2024-04-22T01:12:00.276 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-22T01:12:00.276 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-22T01:12:00.276 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:00.285 INFO:tasks.ceph.mds.a.smithi110.stderr:2024-04-22T01:12:00.275+0000 b9e7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 31614) UID: 0 2024-04-22T01:12:00.285 INFO:tasks.ceph.mds.a.smithi110.stderr:2024-04-22T01:12:00.279+0000 b9e7640 -1 mds.a *** got signal Terminated *** 2024-04-22T01:12:03.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-22T01:12:03.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-22T01:12:06.378 INFO:tasks.ceph.mds.a:Stopped 2024-04-22T01:12:06.378 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-22T01:12:06.378 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:06.378 INFO:tasks.ceph.mds.c:Stopped 2024-04-22T01:12:06.378 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-22T01:12:06.379 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:06.401 INFO:tasks.ceph.mds.e.smithi110.stderr:2024-04-22T01:12:06.379+0000 b9e7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 31617) UID: 0 2024-04-22T01:12:06.401 INFO:tasks.ceph.mds.e.smithi110.stderr:2024-04-22T01:12:06.379+0000 b9e7640 -1 mds.e *** got signal Terminated *** 2024-04-22T01:12:10.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-22T01:12:10.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-22T01:12:12.481 INFO:tasks.ceph.mds.e:Stopped 2024-04-22T01:12:12.481 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-22T01:12:12.481 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:12.504 INFO:tasks.ceph.mds.b.smithi154.stderr:2024-04-22T01:12:12.484+0000 b9e7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 31621) UID: 0 2024-04-22T01:12:12.504 INFO:tasks.ceph.mds.b.smithi154.stderr:2024-04-22T01:12:12.484+0000 b9e7640 -1 mds.b *** got signal Terminated *** 2024-04-22T01:12:16.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-22T01:12:18.582 INFO:tasks.ceph.mds.b:Stopped 2024-04-22T01:12:18.583 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-22T01:12:18.583 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:18.606 INFO:tasks.ceph.mds.d.smithi154.stderr:2024-04-22T01:12:18.588+0000 b9e7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 31623) UID: 0 2024-04-22T01:12:18.606 INFO:tasks.ceph.mds.d.smithi154.stderr:2024-04-22T01:12:18.588+0000 b9e7640 -1 mds.d *** got signal Terminated *** 2024-04-22T01:12:23.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-22T01:12:23.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-22T01:12:24.685 INFO:tasks.ceph.mds.d:Stopped 2024-04-22T01:12:24.685 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-22T01:12:24.685 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:24.708 INFO:tasks.ceph.mds.f.smithi154.stderr:2024-04-22T01:12:24.688+0000 b9e7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 31625) UID: 0 2024-04-22T01:12:24.708 INFO:tasks.ceph.mds.f.smithi154.stderr:2024-04-22T01:12:24.688+0000 b9e7640 -1 mds.f *** got signal Terminated *** 2024-04-22T01:12:28.677 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:20:08.869 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:28.701 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:20:08.893 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:28.713 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:20:08.971 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:28.725 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:20:08.983 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:28.769 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:20:08.961 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:28.788 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:20:08.980 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:28.889 INFO:tasks.ceph.mon.a.smithi110.stderr:==00:02:20:09.147 27810== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:28.976 INFO:tasks.ceph.mon.b.smithi154.stderr:==00:02:20:09.168 27790== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:29.009 INFO:tasks.ceph.mon.c.smithi154.stderr:==00:02:20:09.201 27791== Warning: unimplemented fcntl command: 1036 2024-04-22T01:12:29.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-22T01:12:29.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-22T01:12:30.787 INFO:tasks.ceph.mds.f:Stopped 2024-04-22T01:12:30.788 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-22T01:12:30.788 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-22T01:12:30.788 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:30.790 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-22T01:12:30.787+0000 7f7bf1208640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27998) UID: 0 2024-04-22T01:12:30.790 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-22T01:12:30.791+0000 7f7bf1208640 -1 osd.0 33 *** Got signal Terminated *** 2024-04-22T01:12:35.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-22T01:12:35.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-22T01:12:36.891 INFO:tasks.ceph.osd.0:Stopped 2024-04-22T01:12:36.891 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-22T01:12:36.891 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:36.892 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-22T01:12:36.891+0000 7f95b0152640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 28001) UID: 0 2024-04-22T01:12:36.893 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-04-22T01:12:36.891+0000 7f95b0152640 -1 osd.1 34 *** Got signal Terminated *** 2024-04-22T01:12:41.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-22T01:12:41.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-22T01:12:42.993 INFO:tasks.ceph.osd.1:Stopped 2024-04-22T01:12:42.994 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-22T01:12:42.994 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:42.995 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-22T01:12:42.994+0000 7f407cf37640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 28003) UID: 0 2024-04-22T01:12:42.995 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-04-22T01:12:42.994+0000 7f407cf37640 -1 osd.2 36 *** Got signal Terminated *** 2024-04-22T01:12:47.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-22T01:12:47.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-22T01:12:49.095 INFO:tasks.ceph.osd.2:Stopped 2024-04-22T01:12:49.096 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-22T01:12:49.096 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:49.097 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-22T01:12:49.098+0000 7f749d13a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 28006) UID: 0 2024-04-22T01:12:49.097 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-04-22T01:12:49.098+0000 7f749d13a640 -1 osd.3 37 *** Got signal Terminated *** 2024-04-22T01:12:53.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-22T01:12:53.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-22T01:12:55.198 INFO:tasks.ceph.osd.3:Stopped 2024-04-22T01:12:55.199 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-22T01:12:55.199 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:12:55.200 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-22T01:12:55.199+0000 7f62aeef5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28106) UID: 0 2024-04-22T01:12:55.200 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-04-22T01:12:55.199+0000 7f62aeef5640 -1 osd.4 38 *** Got signal Terminated *** 2024-04-22T01:12:59.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-22T01:12:59.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-22T01:13:01.301 INFO:tasks.ceph.osd.4:Stopped 2024-04-22T01:13:01.301 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-22T01:13:01.301 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:01.302 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-22T01:13:01.307+0000 7f6a19e03640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28108) UID: 0 2024-04-22T01:13:01.302 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-04-22T01:13:01.307+0000 7f6a19e03640 -1 osd.5 39 *** Got signal Terminated *** 2024-04-22T01:13:05.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-22T01:13:05.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-22T01:13:07.403 INFO:tasks.ceph.osd.5:Stopped 2024-04-22T01:13:07.403 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-22T01:13:07.403 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:07.405 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-22T01:13:07.403+0000 7fcec945b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28109) UID: 0 2024-04-22T01:13:07.405 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-04-22T01:13:07.403+0000 7fcec945b640 -1 osd.6 40 *** Got signal Terminated *** 2024-04-22T01:13:10.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-22T01:13:10.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-22T01:13:13.505 INFO:tasks.ceph.osd.6:Stopped 2024-04-22T01:13:13.505 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-22T01:13:13.505 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:13.506 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-22T01:13:13.507+0000 7fd17b030640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28112) UID: 0 2024-04-22T01:13:13.506 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-04-22T01:13:13.507+0000 7fd17b030640 -1 osd.7 40 *** Got signal Terminated *** 2024-04-22T01:13:16.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-22T01:13:16.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-22T01:13:19.607 INFO:tasks.ceph.osd.7:Stopped 2024-04-22T01:13:19.607 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-22T01:13:19.608 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-22T01:13:19.608 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:19.609 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-22T01:13:19.610+0000 7f11bb641640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 27812) UID: 0 2024-04-22T01:13:19.609 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-04-22T01:13:19.610+0000 7f11bb641640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-22T01:13:19.638 INFO:tasks.ceph.mgr.y:Stopped 2024-04-22T01:13:19.638 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-22T01:13:19.638 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:19.688 INFO:tasks.ceph.mgr.x:Stopped 2024-04-22T01:13:19.688 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-22T01:13:19.688 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-22T01:13:19.688 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:19.698 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-04-22T01:13:19.690+0000 a388640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27807) UID: 0 2024-04-22T01:13:19.698 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-04-22T01:13:19.690+0000 a388640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-22T01:13:21.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-22T01:13:21.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-22T01:13:25.790 INFO:tasks.ceph.mon.a:Stopped 2024-04-22T01:13:25.790 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-22T01:13:25.790 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:25.830 INFO:tasks.ceph.mon.b.smithi154.stderr:2024-04-22T01:13:25.794+0000 a388640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 27783) UID: 0 2024-04-22T01:13:25.830 INFO:tasks.ceph.mon.b.smithi154.stderr:2024-04-22T01:13:25.794+0000 a388640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-22T01:13:26.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-22T01:13:26.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-22T01:13:31.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2024-04-22T01:13:31.892 INFO:tasks.ceph.mon.b:Stopped 2024-04-22T01:13:31.893 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-22T01:13:31.893 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T01:13:31.916 INFO:tasks.ceph.mon.c.smithi154.stderr:2024-04-22T01:13:31.898+0000 a388640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 27786) UID: 0 2024-04-22T01:13:31.917 INFO:tasks.ceph.mon.c.smithi154.stderr:2024-04-22T01:13:31.898+0000 a388640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-04-22T01:13:36.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-22T01:13:36.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-22T01:13:37.995 INFO:tasks.ceph.mon.c:Stopped 2024-04-22T01:13:37.995 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-22T01:13:37.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-04-22T01:13:38.016 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-22T01:13:38.016 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-22T01:13:38.274 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-22T01:13:38.275 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-22T01:13:38.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-22T01:13:38.480 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-22T01:13:38.655 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-22T01:13:38.656 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-22T01:13:38.819 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-22T01:13:38.819 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-22T01:13:39.101 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-22T01:13:39.101 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-22T01:13:39.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-22T01:13:39.265 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-22T01:13:39.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-22T01:13:39.469 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-22T01:13:39.680 INFO:tasks.ceph:Archiving mon data... 2024-04-22T01:13:39.681 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/data/mon.a.tgz 2024-04-22T01:13:39.682 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-04-22T01:13:39.688 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.bOkcGmWQ7V 2024-04-22T01:13:39.688 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bOkcGmWQ7V 2024-04-22T01:13:39.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.bOkcGmWQ7V 2024-04-22T01:13:39.882 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.bOkcGmWQ7V is 414KB 2024-04-22T01:13:39.948 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.bOkcGmWQ7V 2024-04-22T01:13:39.954 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/data/mon.b.tgz 2024-04-22T01:13:39.954 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-04-22T01:13:39.960 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.I6bTgTLwz9 2024-04-22T01:13:39.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.I6bTgTLwz9 2024-04-22T01:13:40.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.I6bTgTLwz9 2024-04-22T01:13:40.157 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.I6bTgTLwz9 is 420KB 2024-04-22T01:13:40.176 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.I6bTgTLwz9 2024-04-22T01:13:40.180 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/data/mon.c.tgz 2024-04-22T01:13:40.181 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-04-22T01:13:40.229 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.HxOnLuhAHl 2024-04-22T01:13:40.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HxOnLuhAHl 2024-04-22T01:13:40.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.HxOnLuhAHl 2024-04-22T01:13:40.422 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.HxOnLuhAHl is 420KB 2024-04-22T01:13:40.439 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.HxOnLuhAHl 2024-04-22T01:13:40.444 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-22T01:13:40.444 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T01:13:40.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T01:13:40.693 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-04-22T01:13:40.810 INFO:tasks.ceph:Archiving crash dumps... 2024-04-22T01:13:40.812 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/remote/smithi110/crash 2024-04-22T01:13:40.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T01:13:40.827 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/remote/smithi154/crash 2024-04-22T01:13:40.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T01:13:40.841 INFO:tasks.ceph:Shutting down logrotate 2024-04-22T01:13:40.842 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-04-22T01:13:40.843 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-22T01:13:40.854 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-04-22T01:13:40.854 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-22T01:13:40.855 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T01:13:40.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T01:13:40.953 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-22T01:13:40.962 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-22T01:13:40.963 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T01:13:40.965 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T01:13:40.980 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-04-22T01:13:40.980 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-04-22T01:13:40.980 INFO:teuthology.orchestra.run.smithi154.stdout:*hv01.front.sepi 44.4.53.2 2 u 47 256 377 0.144 -5.953 0.844 2024-04-22T01:13:40.980 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 256 377 0.222 -6.234 0.965 2024-04-22T01:13:40.980 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 76 256 377 0.162 -4.896 0.951 2024-04-22T01:13:40.980 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-22T01:13:40.982 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-04-22T01:13:40.982 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-04-22T01:13:40.982 INFO:teuthology.orchestra.run.smithi110.stdout:*hv01.front.sepi 44.4.53.2 2 u 244 256 377 0.158 -2.703 0.461 2024-04-22T01:13:40.982 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 63.231.80.2 3 u 250 256 377 0.161 -3.133 0.300 2024-04-22T01:13:40.982 INFO:teuthology.orchestra.run.smithi110.stdout:+hv03.front.sepi 74.6.168.72 3 u 239 256 377 0.138 -3.245 0.814 2024-04-22T01:13:40.982 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-22T01:13:40.982 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-22T01:13:40.991 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-22T01:13:40.992 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-22T01:13:41.015 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-22T01:13:41.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-22T01:13:41.083 INFO:teuthology.task.internal:Duration was 9420.872906 seconds 2024-04-22T01:13:41.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-22T01:13:41.116 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-22T01:13:41.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T01:13:41.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T01:13:41.157 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-22T01:13:41.157 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-04-22T01:13:41.157 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T01:13:41.207 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-04-22T01:13:41.207 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T01:13:41.218 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-22T01:13:41.218 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T01:13:41.251 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T01:13:41.296 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-22T01:13:41.296 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T01:13:41.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T01:13:41.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-22T01:13:41.415 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-22T01:13:41.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T01:13:41.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T01:13:41.441 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-22T01:13:41.458 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T01:13:41.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T01:13:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-04-22T01:13:41.495 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-04-22T01:13:41.523 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T01:13:41.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T01:13:41.545 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T01:13:41.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T01:13:41.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-22T01:13:41.580 INFO:teuthology.task.internal:Transferring archived files... 2024-04-22T01:13:41.581 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/remote/smithi110 2024-04-22T01:13:41.581 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T01:13:41.611 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565/remote/smithi154 2024-04-22T01:13:41.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T01:13:41.632 INFO:teuthology.task.internal:Removing archive directory... 2024-04-22T01:13:41.633 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T01:13:41.651 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T01:13:41.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-22T01:13:41.700 INFO:teuthology.task.internal:Not uploading archives. 2024-04-22T01:13:41.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-22T01:13:41.775 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-22T01:13:41.777 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T01:13:41.779 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T01:13:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 01:13 /home/ubuntu/cephtest 2024-04-22T01:13:41.785 INFO:teuthology.orchestra.run.smithi154.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 01:13 /home/ubuntu/cephtest 2024-04-22T01:13:41.787 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-22T01:13:41.826 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-22T01:13:41.860 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi110 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-04-22T01:13:41.860 INFO:teuthology.nuke:Checking targets against current locks 2024-04-22T01:13:41.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-22T01:13:41.885 DEBUG:teuthology.nuke:shortname: smithi110 2024-04-22T01:13:41.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T01:13:41.911 DEBUG:teuthology.nuke:shortname: smithi154 2024-04-22T01:13:41.911 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T01:13:41.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:27:38.617363', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAYLhHPaMCkV3T08Pozmj+2JCrLSjQ+bFMvY0UiJot7pDHdauDC6mn6ULbS2PBCvxQAXZVeogxkVMcHs4i2ut8s='} 2024-04-22T01:13:41.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667565', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:27:38.615858', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxlERhlpHunrYThHrnrhMAhRqrN+rq0V6FKLncqVuRCVCYV5A/0beJwUrRg4PLa4LNmQDJV/4YxFHNHAkA61qU='} 2024-04-22T01:13:41.960 INFO:teuthology.orchestra.console.smithi110:Power off 2024-04-22T01:13:41.960 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-22T01:13:41.984 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-04-22T01:13:41.984 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T01:13:42.002 INFO:teuthology.orchestra.console.smithi154:Power off 2024-04-22T01:13:42.002 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-22T01:13:42.012 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-22T01:13:42.028 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-04-22T01:13:42.028 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T01:13:42.050 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-22T01:13:46.013 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T01:13:46.051 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T01:13:46.124 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-22T01:13:46.162 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-22T01:13:50.129 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T01:13:50.163 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T01:13:50.240 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-22T01:13:50.273 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-22T01:13:50.374 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-04-22T01:13:54.244 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T01:13:54.353 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-04-22T01:13:54.454 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-04-22T01:13:54.559 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/fsstress validater/valgrind} duration: 9420.872906446457 failure_reason: 'Command failed on smithi110 with status 3: ''sudo logrotate /etc/logrotate.d/ceph-test.conf''' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-22T01:13:54.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T01:13:54.642 INFO:teuthology.run:FAIL